00010000:00010000:3.0:1785774767.178943:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09d2c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.178958:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774767.178961:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774767.178966:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785774767.178975:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17e:0x0]: returning size 4096 00010000:00010000:3.0:1785774767.178988:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.178995:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179001:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179008:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179015:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.179020:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179028:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179039:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774767.179043:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.179047:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179053:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2ba lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774767.179081:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002740b586 reply state 0000000044e835a2 transno 4294968377 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09d2c1 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179091:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09d2c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.179098:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff9b7602507000) 00010000:00010000:3.0:1785774767.179101:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774767.179103:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1785774767.179278:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17638:x1872519648403200:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 5775us (6031us total) trans 4294968377 rc 0/0 00000100:00100000:3.0:1785774767.179289:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23497 00000100:00100000:3.0:1785774767.239708:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648403328 00000100:00100000:3.0:1785774767.239722:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648403328 00000100:00100000:3.0:1785774767.239799:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23498 00000100:00100000:3.0:1785774767.239812:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17643:x1872519648403328:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774767.239845:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774767.239875:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2cf lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b8e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.239966:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.239984:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.239999:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240013:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240026:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240032:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240124:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09d2e4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240133:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09d2e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240140:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09d2e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774767.240213:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17e:0x0]: returning size 4096 00000004:00200000:3.0:1785774767.240218:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785774767.240242:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09d2e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240259:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240267:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240275:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240283:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240295:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.240300:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240309:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240324:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774767.240328:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.240334:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240341:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2d6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240353:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240360:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.240366:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.242475:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.242481:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.242492:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.242523:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff9b7602507000) 00010000:00010000:3.0:1785774767.242526:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.242531:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.242538:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2dd lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.244709:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2cf lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b8e0 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.244749:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09d2e4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b8e0 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.244759:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774767.244762:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774767.244765:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:3.0:1785774767.244879:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:17643:x1872519648403328:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 5068us (5334us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774767.244891:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23498 00000100:00100000:3.0:1785774767.253304:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648403584 00000100:00100000:3.0:1785774767.253317:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648403584 00000100:00100000:3.0:1785774767.253470:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23499 00000100:00100000:3.0:1785774767.253484:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:17643:x1872519648403584:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774767.253565:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774767.253610:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09d2e4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b8e0 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253637:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774767.253642:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774767.253675:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253691:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253703:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253716:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2f2 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253724:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253731:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253820:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253828:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.253835:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774767.254107:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x17e:0x0]: returning size 4096 00010000:00010000:3.0:1785774767.254126:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254134:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254141:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254147:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.254152:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254196:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254208:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774767.254211:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774767.254215:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254221:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09d2f9 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254239:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254245:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254251:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254257:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254263:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.254266:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254272:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254280:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774767.254282:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.254285:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254291:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d2eb lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774767.254305:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f8ce572 reply state 00000000f4a33af9 transno 4294968378 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254317:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09d2f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1640014e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.254324:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1640014e (ffff9b7602507000) 00010000:00010000:3.0:1785774767.254327:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774767.254330:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774767.254427:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17643:x1872519648403584:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 946us (1696us total) trans 4294968378 rc 0/0 00000100:00100000:3.0:1785774767.254436:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23499 00000100:00100000:3.0:1785774767.269473:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774767.269520:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671105792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774767.269752:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.297987:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648403712 00000100:00100000:3.0:1785774767.298003:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648403712 00000100:00100000:3.0:1785774767.298082:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23500 00000100:00100000:3.0:1785774767.298093:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17644:x1872519648403712:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774767.298122:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774767.298148:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09d300 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b8e7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298265:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298284:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298299:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298317:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298325:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298333:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298385:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298392:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298404:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298411:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298418:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.298423:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298431:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298444:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7706383900) 00010000:00010000:3.0:1785774767.298447:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.298453:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298460:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09d307 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298475:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298481:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298487:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298492:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.298495:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.298501:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.302715:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x61ea7fc2 (ffff9b7602507300) 00010000:00010000:3.0:1785774767.302721:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.302730:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.302739:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d30e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.302807:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09d300 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b8e7 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.302820:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7706383900) 00010000:00010000:3.0:1785774767.302823:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.302827:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09d300 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b8e7 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.302837:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf000, rc 0) 00000100:00100000:3.0:1785774767.302933:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17644:x1872519648403712:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 4841us (6723us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774767.302944:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23500 00000100:00100000:3.0:1785774767.306845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.344196:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671106176:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774767.344220:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0800/0x7b7109e1d09d323 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d32a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.344234:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0800/0x7b7109e1d09d323 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d32a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.348596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774767.354457:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0800/0x7b7109e1d09d323 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d32a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.354469:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0800/0x7b7109e1d09d323 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d32a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774767.354502:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774767.354567:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf000/0x7b7109e1d09d331 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.354576:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf000/0x7b7109e1d09d331 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.354586:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf000/0x7b7109e1d09d331 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.354603:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671106560:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1785774767.354636:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.363585:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.365029:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671106560:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774767.365058:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf000/0x7b7109e1d09d331 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d338 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.365076:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf000/0x7b7109e1d09d331 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d338 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774767.365109:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1785774767.365209:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671106688:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774767.365264:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.365288:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.371942:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671106944 00000100:00100000:3.0:1785774767.371950:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671106944 00000100:00100000:3.0:1785774767.372008:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187 00000100:00100000:3.0:1785774767.372018:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6529:x1872519671106944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774767.372121:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6529:x1872519671106944:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (268us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774767.372129:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187 00000100:00100000:3.0:1785774767.376922:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671107328 00000100:00100000:3.0:1785774767.376930:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671107328 00000100:00100000:3.0:1785774767.376976:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:3.0:1785774767.376985:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6529:x1872519671107328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774767.377055:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6529:x1872519671107328:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774767.377063:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:3.0:1785774767.563458:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648404480 00000100:00100000:3.0:1785774767.563472:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648404480 00000100:00100000:3.0:1785774767.563554:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23503 00000100:00100000:3.0:1785774767.563566:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17645:x1872519648404480:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:3.0:1785774767.563786:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17645:x1872519648404480:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 222us (632us total) trans 0 rc -17/-17 00000100:00100000:3.0:1785774767.563794:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23503 00000100:00100000:3.0:1785774767.653756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.668786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.721257:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648405376 00000100:00100000:3.0:1785774767.721291:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648405376 00000100:00100000:3.0:1785774767.721396:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23508 00000100:00100000:3.0:1785774767.721409:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17646:x1872519648405376:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774767.721508:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774767.721553:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1200/0x7b7109e1d09d37e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x17f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b8fc expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.721962:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17f:0x0].0x0 (ffff9b7706383d00) 00010000:00010000:3.0:1785774767.721969:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774767.722037:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf600/0x7b7109e1d09d3a1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.722047:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf600/0x7b7109e1d09d3a1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.722059:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf600/0x7b7109e1d09d3a1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.722086:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108608:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774767.722192:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.722228:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.723965:0:6530:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983430 gen 2 00000004:00080000:3.0:1785774767.723974:0:6530:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983429 committed transno 4294983430 00000004:00080000:3.0:1785774767.724001:0:6530:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983430 committed transno 4294983430 00000100:00100000:3.0:1785774767.724022:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108608:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774767.724043:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf600/0x7b7109e1d09d3a1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d3a8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.724057:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf600/0x7b7109e1d09d3a1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d3a8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774767.724076:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774767.724107:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.724113:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.724122:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.724134:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108736:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774767.724195:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.724216:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.724698:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108736:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774767.724709:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d3b6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.724718:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d3b6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774767.724731:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1785774767.724765:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108864:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774767.724790:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.724820:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.727983:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108864:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774767.728080:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108992:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774767.728139:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.728183:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.728205:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671108992 00000100:00100000:3.0:1785774767.728211:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671108992 00000100:00100000:3.0:1785774767.728258:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:3.0:1785774767.728266:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671108992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774767.728385:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671108992:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (246us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774767.728393:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:3.0:1785774767.728424:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671108992:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1785774767.728481:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cec00/0x7b7109e1d09d3bd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.728492:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cec00/0x7b7109e1d09d3bd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.728514:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cec00/0x7b7109e1d09d3bd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x17f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.728526:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671109120:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774767.728549:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.728562:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.728678:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671109120 00000100:00100000:3.0:1785774767.728682:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671109120 00000100:00100000:3.0:1785774767.728704:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:3.0:1785774767.728710:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671109120:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774767.728722:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774767.728739:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09d3c4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09d3bd expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.728765:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09d3c4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09d3bd expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.728780:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09d3c4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d3bd expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.728789:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17f:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:3.0:1785774767.728792:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774767.728796:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:3.0:1785774767.729923:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6530:x1872519671109120:12345-0@lo:101:mdt00_001.0 Request processed in 1209us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774767.729933:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:3.0:1785774767.754030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.754141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.754262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.771045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.773305:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648405888 00000100:00100000:3.0:1785774767.773329:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648405888 00010000:00010000:3.0:1785774767.774032:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09d38c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b903 expref: 18 pid: 6531 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.774088:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1542 00000100:00100000:3.0:1785774767.774099:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648405888:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774767.774121:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774767.774129:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09d38c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b903 expref: 18 pid: 6531 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.774144:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09d38c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b903 expref: 18 pid: 6531 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.776683:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09d38c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b903 expref: 18 pid: 6531 timeout: 1109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.776720:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff9b7706383500) 00010000:00010000:3.0:1785774767.776726:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1600/0x7b7109e1d09d3d2 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.776739:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1600/0x7b7109e1d09d3d2 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.776751:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1600/0x7b7109e1d09d3d2 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.776800:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774767.778781:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648405888:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 4679us (7746us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774767.778796:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1542 00000100:00100000:3.0:1785774767.798875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.801082:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671109376:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774767.801101:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09d3d9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d3e0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.802959:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f710700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671109760:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1785774767.803035:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.803074:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.806286:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f710700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671109760:0@lo:403:mdt00_001.0 00000004:00080000:3.0:1785774767.817713:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 718 rpc_version 718 00000020:00100000:3.0:1785774767.817771:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774767.817784:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b771f710700 x1872519671110016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774767.817814:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f710700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671110016:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774767.817906:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.817949:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.822969:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f710700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671110016:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1785774767.833682:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774767.894065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.921960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774767.922022:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648406400 00000100:00100000:3.0:1785774767.922034:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648406400 00000100:00100000:3.0:1785774767.922115:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23511 00000100:00100000:3.0:1785774767.922128:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17647:x1872519648406400:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774767.922184:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774767.922223:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d411 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b91f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.922297:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09d418 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.922315:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09d418 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.922341:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09d418 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774767.922412:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1785774767.922418:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774767.922461:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d411 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b91f expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.922480:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09d418 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b91f expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.922490:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7602507f00) 00010000:00010000:3.0:1785774767.922494:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774767.922507:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf000, rc 0) 00000100:00100000:3.0:1785774767.922684:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17647:x1872519648406400:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 558us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774767.922691:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23511 00010000:00010000:3.0:1785774767.969518:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969542:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969556:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969586:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969593:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969599:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969645:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09d43b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969654:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09d43b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.969666:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09d43b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774767.969692:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f712680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671110784:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1785774767.969765:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774767.969819:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774767.973839:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f712680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671110784:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774767.973876:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09d43b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d442 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.973894:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09d43b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d442 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774767.973930:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000830f86f6 reply state 00000000a95f6f31 transno 4294983432 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.973949:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.973958:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:3.0:1785774767.973961:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774767.973966:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774767.973973:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09d43b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d442 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.973982:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09d43b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d442 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774767.973996:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xca:0x0] 00000004:00010000:3.0:1785774767.974004:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000830f86f6 reply state 00000000a95f6f31 transno 4294983432 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974012:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974019:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774767.974021:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774767.974023:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1785774767.974030:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1521:0x0]: returning size 4096 00010000:00010000:3.0:1785774767.974043:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974050:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974057:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974066:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974073:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774767.974078:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974087:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974098:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:3.0:1785774767.974101:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774767.974104:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974112:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0200/0x7b7109e1d09d41f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774767.974130:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000830f86f6 reply state 00000000a95f6f31 transno 4294983432 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974137:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774767.974144:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x101e480e (ffff9b7605fcca00) 00010000:00010000:3.0:1785774767.974146:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774767.974148:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1785774767.974277:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17647:x1872519648406656:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 19647us (19861us total) trans 4294983432 rc 0/0 00000100:00100000:3.0:1785774767.974287:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23512 00000100:00100000:3.0:1785774768.133290:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648407168 00000100:00100000:3.0:1785774768.133307:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648407168 00000100:00100000:3.0:1785774768.133395:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23515 00000100:00100000:3.0:1785774768.133407:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17649:x1872519648407168:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774768.133436:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774768.133462:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09d465 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b92d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.133555:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.133572:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.133586:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774768.133660:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xca:0x0]: returning size 4096 00000004:00200000:3.0:1785774768.133666:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774768.133711:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09d465 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b92d expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.133733:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b92d expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.133742:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:3.0:1785774768.133745:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774768.133749:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:3.0:1785774768.133822:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17649:x1872519648407168:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 418us (2516us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774768.133833:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23515 00000100:00100000:3.0:1785774768.145306:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648407296 00000100:00100000:3.0:1785774768.145320:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648407296 00000100:00100000:3.0:1785774768.145405:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23516 00000100:00100000:3.0:1785774768.145417:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17649:x1872519648407296:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774768.145447:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774768.145475:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09d473 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b934 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.145562:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09d47a lrc: 3/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.145581:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d442 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d43b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.145591:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09d47a lrc: 4/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.145690:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d442 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09d43b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.145709:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671110912:0@lo:104: 00000100:00100000:3.0:1785774768.145770:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774768.145822:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774768.153297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671111040 00000100:00100000:3.0:1785774768.153321:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671111040 00010000:00010000:3.0:1785774768.153393:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d442 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09d43b expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.153463:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1785774768.153475:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3655:x1872519671111040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774768.153506:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774768.170526:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09d3b6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774768.170555:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09d3b6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.170624:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d3b6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.170631:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774768.181388:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce600/0x7b7109e1d09d3af lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x61ea7fc2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d3b6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.181436:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d243 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09d24a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774768.181449:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d243 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x917910c6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09d24a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.188746:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648407552 00000100:00100000:3.0:1785774768.188758:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648407552 00000100:00100000:3.0:1785774768.188823:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23517 00000100:00100000:3.0:1785774768.188835:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17649:x1872519648407552:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774768.188912:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774768.188944:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09d45e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b926 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.188971:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774768.188976:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774768.189012:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09d481 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189028:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09d481 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189040:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09d481 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189052:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x101e480e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189060:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189067:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189208:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09d48f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189216:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09d48f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189222:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09d48f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189244:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d496 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189253:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b92d expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189262:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d496 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189303:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b92d expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.189318:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b92d expref: 16 pid: 6529 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.189335:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671111936:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774768.189431:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1785774768.199881:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09d46c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b92d expref: 16 pid: 6529 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.199902:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671111936:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774768.199926:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d496 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.199936:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d496 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.199942:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d496 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.199997:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 3/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.200005:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 3/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.200016:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 3/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.200039:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671112064:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774768.200077:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774768.200110:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774768.208024:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968381 gen 2 00000004:00080000:3.0:1785774768.208033:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968372 committed transno 4294968381 00000020:00080000:3.0:1785774768.208040:0:8469:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605fd0480 refcount 2 committed 0 result 0 batchid 376 00000020:00080000:3.0:1785774768.208044:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605fd0e40 00000020:00080000:3.0:1785774768.208047:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].365 00000020:00080000:3.0:1785774768.208050:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ecf200 00000020:00080000:3.0:1785774768.208053:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].366 00000004:00080000:3.0:1785774768.208083:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968374 committed transno 4294968381 00000004:00080000:3.0:1785774768.208095:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968375 committed transno 4294968381 00000004:00080000:3.0:1785774768.208108:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968381 committed transno 4294968381 00000100:00100000:3.0:1785774768.208123:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671112064:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774768.208153:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 4/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.208190:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 4/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.221769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648407808 00000100:00100000:3.0:1785774768.221782:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648407808 00010000:00010000:3.0:1785774768.221831:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09d47a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b934 expref: 8 pid: 6530 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.221882:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1546 00000100:00100000:3.0:1785774768.221893:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648407808:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774768.221913:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774768.221922:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09d47a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b934 expref: 8 pid: 6530 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.221939:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09d47a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b934 expref: 8 pid: 6530 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.221965:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09d47a lrc: 0/0,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b934 expref: 8 pid: 6530 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.221983:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff9b7605dfda00) 00010000:00010000:3.0:1785774768.221990:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09d4a4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d49d expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.222003:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09d4a4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09d49d expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.222012:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09d4a4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09d49d expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.222055:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09d4a4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d49d expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.222072:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671112320:0@lo:105: 00000100:00100000:3.0:1785774768.222130:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774768.222208:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1785774768.264395:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 698 rpc_version 698 00010000:00010000:3.0:1785774768.274306:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774768.274315:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.274323:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774768.274328:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774768.274336:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.274374:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 2/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.274381:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774768.274403:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 1/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.274412:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d49d lrc: 0/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d4a4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.274433:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774768.274435:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774768.274437:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774768.274460:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671112832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774768.274515:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774768.280893:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671112832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774768.331724:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648407936 00000100:00100000:3.0:1785774768.331742:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648407936 00000100:00100000:3.0:1785774768.331828:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23518 00000100:00100000:3.0:1785774768.331840:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17650:x1872519648407936:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774768.331873:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774768.331918:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d4ab lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b93b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.331999:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332016:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332029:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332042:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332048:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332054:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332109:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332115:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332122:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332130:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332137:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.332142:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332150:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332182:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7706383c00) 00010000:00010000:3.0:1785774768.332649:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.332659:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332668:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d4b2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332684:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332692:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332699:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332704:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.332707:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332713:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332721:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xe7d4651 (ffff9b7709388400) 00010000:00010000:3.0:1785774768.332723:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.332726:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332732:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d4b9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332768:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d4ab lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b93b expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332779:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7706383c00) 00010000:00010000:3.0:1785774768.332782:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.332786:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d4ab lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b93b expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.332795:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774768.332932:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17650:x1872519648407936:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1094us (3883us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774768.332940:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23518 00000100:00100000:3.0:1785774768.360289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774768.363447:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17650:x1872519648408064:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 2605us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774768.363457:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23519 00000100:00100000:3.0:1785774768.407976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000040:00080000:3.0:1785774768.434585:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].379, 2168 off579624 00000040:00080000:3.0:1785774768.434748:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].379, 2368 off624960 00000004:00080000:3.0:1785774768.434759:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605e4d540 with version 721 00000100:00100000:3.0:1785774768.641369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774768.663417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774768.706814:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648408960 00000100:00100000:3.0:1785774768.706825:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648408960 00000100:00100000:3.0:1785774768.706884:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23524 00000100:00100000:3.0:1785774768.706894:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17652:x1872519648408960:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774768.706916:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774768.706943:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b957 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.707004:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d529 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.707019:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d09d4f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d4ea expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.707028:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d529 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.707062:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d09d4f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09d4ea expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.707078:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6529:1872519671113600:0@lo:104: 00000100:00100000:3.0:1785774768.707126:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774768.707199:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ea80 going to sleep for 11 seconds 00010000:00010000:3.0:1785774768.717292:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774768.717312:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09d4ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09d4f1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.717328:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774768.717337:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09d4ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09d4f1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774768.717349:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09d4ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09d4f1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.717408:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09d4ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d4f1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.717413:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774768.717449:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09d4ea lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d4f1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.717456:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09d4ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d4f1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.717479:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774768.717482:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774768.717484:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774768.751652:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751670:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751678:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751683:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.751688:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751696:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751713:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x101e480e (ffff9b7605fcca00) 00010000:00010000:3.0:1785774768.751716:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.751721:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751727:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09d426 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751750:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751757:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751762:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751769:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.751772:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751778:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751785:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774768.751788:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.751791:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751796:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09d42d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751812:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751819:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751824:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751829:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.751832:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751837:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751848:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:3.0:1785774768.751851:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.751854:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751859:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09d434 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751876:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751882:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751888:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751893:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.751896:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751902:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751909:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x101e480e (ffff9b7605fcca00) 00010000:00010000:3.0:1785774768.751911:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.751913:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.751918:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09d488 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x101e480e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.756886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774768.770252:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671114112:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774768.770292:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.776138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774768.778540:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.778554:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.778608:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.778616:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.778628:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.778649:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671114240:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774768.778702:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774768.778734:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774768.790453:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671114368:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774768.790488:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09d553 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d54c expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.790517:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff9b7702c6af00) 00010000:00010000:3.0:1785774768.790520:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774768.790524:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09d553 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d54c expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.790532:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09d553 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d54c expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.790539:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:3.0:1785774768.790611:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:8627:x1872519671114240:12345-0@lo:101:mdt00_004.0 Request processed in 11590us (11908us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774768.790621:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212 00000100:00100000:3.0:1785774768.790670:0:8627:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983436 gen 2 00000004:00080000:3.0:1785774768.790676:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983431 committed transno 4294983436 00000020:00080000:3.0:1785774768.790683:0:8627:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605d0e240 refcount 2 committed 0 result 0 batchid 377 00000020:00080000:3.0:1785774768.790687:0:8627:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544fa00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605d0e540 00000020:00080000:3.0:1785774768.790691:0:8627:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].377 00000020:00080000:3.0:1785774768.790694:0:8627:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544ff00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76046b1200 00000020:00080000:3.0:1785774768.790697:0:8627:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].378 00000004:00080000:3.0:1785774768.790720:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983433 committed transno 4294983436 00000004:00080000:3.0:1785774768.790730:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983434 committed transno 4294983436 00000004:00080000:3.0:1785774768.790737:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983436 committed transno 4294983436 00000100:00100000:3.0:1785774768.790755:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671114240:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774768.790779:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d553 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.790796:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d553 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1785774768.790815:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 377 committed batchid 373 00000020:00080000:3.0:1785774768.790876:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 373 00000100:00100000:3.0:1785774768.796777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774768.797861:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d553 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.797871:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d553 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774768.800834:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671114624:0@lo:403:mdt00_004.0 00000100:00100000:3.0:1785774768.800904:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774768.800939:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774768.804663:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671114624:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1785774768.809813:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].380, 664 off580288 00000040:00080000:3.0:1785774768.809998:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].380, 744 off625704 00000004:00080000:3.0:1785774768.810005:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605d0e300 with version 722 00000100:00100000:3.0:1785774768.812785:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671114880 00000100:00100000:3.0:1785774768.812798:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671114880 00000100:00100000:3.0:1785774768.812849:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1785774768.812858:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7474:x1872519671114880:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774768.813116:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7474:x1872519671114880:12345-0@lo:1000:osp_up0-1.0 Request processed in 259us (2597us total) trans 4294983437 rc 0/0 00000100:00100000:3.0:1785774768.813129:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000004:00200000:3.0:1785774768.821478:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x180:0x0]: returning size 4096 00010000:00010000:3.0:1785774768.821514:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821525:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821533:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821539:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.821544:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821552:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821567:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff9b760572ba00) 00010000:00010000:3.0:1785774768.821571:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774768.821575:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821582:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09d545 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821597:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d553 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821605:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d553 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821618:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d54c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d553 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821640:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774768.821650:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc8:0x0] 00010000:00010000:3.0:1785774768.821658:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09d53e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x180:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821665:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09d53e lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x180:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821671:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09d53e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x180:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821677:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.821680:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09d53e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x180:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821686:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09d53e lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x180:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821694:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x180:0x0].0x0 (ffff9b760572b100) 00010000:00010000:3.0:1785774768.821697:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774768.821700:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09d53e lrc: 2/0,0 mode: --/EX res: [0x240000402:0x180:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821706:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09d53e lrc: 0/0,0 mode: --/EX res: [0x240000402:0x180:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821724:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821731:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821737:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821742:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821747:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774768.821750:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821757:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821764:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b760572b900) 00010000:00010000:3.0:1785774768.821767:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774768.821769:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821775:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09d530 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774768.821792:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be6dc27f reply state 000000009d4544df transno 4294968385 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09d537 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821804:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09d537 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xe7d4651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774768.821811:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xe7d4651 (ffff9b7605dfdb00) 00010000:00010000:3.0:1785774768.821815:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774768.821818:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774768.821899:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17652:x1872519648409216:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 64854us (65018us total) trans 4294968385 rc 0/0 00000100:00100000:3.0:1785774768.821909:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23525 00000100:00100000:3.0:1785774768.907967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774769.148365:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671116160 00000100:00100000:3.0:1785774769.148372:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671116160 00000100:00100000:3.0:1785774769.148405:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:3.0:1785774769.148413:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7474:x1872519671116160:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774769.148531:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7474:x1872519671116160:12345-0@lo:1000:osp_up0-1.0 Request processed in 118us (410us total) trans 4294983440 rc 0/0 00000100:00100000:3.0:1785774769.148538:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00100000:3.0:1785774769.150444:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671116416 00000100:00100000:3.0:1785774769.150452:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671116416 00000100:00100000:3.0:1785774769.150496:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:3.0:1785774769.150503:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7474:x1872519671116416:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774769.151932:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7474:x1872519671116416:12345-0@lo:1000:osp_up0-1.0 Request processed in 1425us (1951us total) trans 4294983441 rc 0/0 00000100:00100000:3.0:1785774769.151943:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00100000:3.0:1785774769.173075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774769.191878:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744400/0x7b7109e1d09d5ca lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b973 expref: 16 pid: 6531 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774769.191897:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671116800:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774769.191916:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.191928:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.191934:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.191973:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.191981:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.191991:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774769.192007:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671116928:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774769.192043:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774769.192075:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ec00 going to sleep for 11 seconds 00010000:00010000:3.0:1785774769.237444:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d5d8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b97a expref: 7 pid: 6529 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774769.237483:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671117056:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774769.237517:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d602 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d5fb expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.237529:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcb:0x0].0x0 (ffff9b760572b000) 00010000:00010000:3.0:1785774769.237532:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774769.237534:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745200, rc 0) 00000100:00100000:3.0:1785774769.237612:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8469:x1872519671116928:12345-0@lo:101:mdt00_003.0 Request processed in 35869us (45566us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.237620:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00100000:3.0:1785774769.237659:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968386 gen 2 00000004:00080000:3.0:1785774769.237674:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968382 committed transno 4294968386 00000020:00080000:3.0:1785774769.237680:0:8469:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605ce4600 refcount 2 committed 0 result 0 batchid 379 00000020:00080000:3.0:1785774769.237684:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ce4840 00000020:00080000:3.0:1785774769.237687:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].367 00000020:00080000:3.0:1785774769.237690:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603611000 00000020:00080000:3.0:1785774769.237692:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].368 00000004:00080000:3.0:1785774769.237716:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968384 committed transno 4294968386 00000004:00080000:3.0:1785774769.237725:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968386 committed transno 4294968386 00000100:00100000:3.0:1785774769.237737:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671116928:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774769.237754:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774769.238414:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671117312:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1785774769.238457:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774769.238479:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ec00 going to sleep for 11 seconds 00000020:00080000:3.0:1785774769.238504:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 379 committed batchid 377 00000020:00080000:3.0:1785774769.238549:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 377 00000100:00100000:3.0:1785774769.238563:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671117312 00000100:00100000:3.0:1785774769.238569:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671117312 00000100:00100000:3.0:1785774769.238608:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222 00000100:00100000:3.0:1785774769.238616:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8469:x1872519671117312:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1785774769.240302:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8469:x1872519671117312:12345-0@lo:403:mdt00_003.0 Request processed in 1682us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.240314:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222 00000100:00100000:3.0:1785774769.240368:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671117312:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1785774769.253652:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].370, 952 off566792 00000040:00080000:3.0:1785774769.253833:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].369, 1032 off618696 00000004:00080000:3.0:1785774769.253841:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605d0ec00 with version 701 00000100:00100000:3.0:1785774769.258433:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671117568 00000100:00100000:3.0:1785774769.258444:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671117568 00000100:00100000:3.0:1785774769.258506:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3223 00000100:00100000:3.0:1785774769.258516:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671117568:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774769.258896:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671117568:12345-0@lo:1000:osp_up1-0.0 Request processed in 382us (3597us total) trans 4294968387 rc 0/0 00000100:00100000:3.0:1785774769.258904:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3223 00000100:00100000:3.0:1785774769.258962:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671117568:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1785774769.258991:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00010000:00010000:3.0:1785774769.259010:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259020:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259029:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259035:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.259039:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259046:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259061:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcb:0x0].0x0 (ffff9b760572b800) 00010000:00010000:3.0:1785774769.259064:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774769.259069:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259075:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09d5f4 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259088:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259096:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259103:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259119:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774769.259126:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xcb:0x0] 00010000:00010000:3.0:1785774769.259133:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774769.259138:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259146:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774769.259150:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774769.259173:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259206:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 2/0,0 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259212:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774769.259233:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 1/0,0 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259240:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09d5fb lrc: 0/0,0 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d602 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259254:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774769.259256:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774769.259258:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774769.259269:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d5ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259276:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d5ed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259282:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d5ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259287:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.259290:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d5ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259297:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d5ed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259305:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff9b760572b400) 00010000:00010000:3.0:1785774769.259308:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774769.259310:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d5ed lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.259315:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d5ed lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264887:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264901:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264907:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264913:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264918:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35bc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.264922:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264929:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264944:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572bb00) 00010000:00010000:3.0:1785774769.264946:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.264950:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264956:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d5df lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774769.264978:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000238f1a94 reply state 0000000091d52f84 transno 4294983443 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264989:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.264996:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x7ed215cf (ffff9b760572bf00) 00010000:00010000:3.0:1785774769.264998:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774769.265001:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774769.265100:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17655:x1872519648410880:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 91171us (92030us total) trans 4294983443 rc 0/0 00000100:00100000:3.0:1785774769.265108:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23533 00000100:00100000:3.0:1785774769.316924:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671117824 00000100:00100000:3.0:1785774769.316932:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671117824 00000100:00100000:3.0:1785774769.317016:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3224 00000100:00100000:3.0:1785774769.317024:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1872519671117824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1785774769.317057:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445036032 avail 1298796544 00000100:00100000:3.0:1785774769.317099:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1872519671117824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.317106:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3224 00000100:00100000:3.0:1785774769.317396:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774769.319572:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671118592 00000100:00100000:3.0:1785774769.319576:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671118592 00000100:00100000:3.0:1785774769.319606:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671119104 00000100:00100000:3.0:1785774769.319609:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671119104 00000100:00100000:3.0:1785774769.319625:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671118208 00000100:00100000:3.0:1785774769.319628:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671118208 00000100:00100000:3.0:1785774769.319640:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1785774769.319646:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671118592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774769.319699:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671118592:12345-0@lo:400:kworker.0 Request processed in 52us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.319705:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1785774769.319719:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1785774769.319725:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671119104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774769.319751:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671119104:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.319757:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1785774769.319768:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1785774769.319774:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671118208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774769.319799:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671118208:12345-0@lo:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.319805:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00080000:3.0:1785774769.322929:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774769.403228:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648411648 00000100:00100000:3.0:1785774769.403238:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648411648 00000100:00100000:3.0:1785774769.403298:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23536 00000100:00100000:3.0:1785774769.403308:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17659:x1872519648411648:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1785774769.403373:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774769.403402:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09d576 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b965 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.403426:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7706383600) 00010000:00010000:3.0:1785774769.403438:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774769.403531:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.403545:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.403554:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.403566:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09d633 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x5a271237 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.404339:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09d633 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.404357:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09d633 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774769.409083:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].381, 2168 off582456 00000040:00080000:3.0:1785774769.409190:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].381, 2368 off628072 00000004:00080000:3.0:1785774769.409199:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605ce4840 with version 727 00000100:00100000:3.0:1785774769.411082:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671119488 00000100:00100000:3.0:1785774769.411090:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671119488 00000100:00100000:3.0:1785774769.411247:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225 00000100:00100000:3.0:1785774769.411257:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7474:x1872519671119488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774769.413900:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7474:x1872519671119488:12345-0@lo:1000:osp_up0-1.0 Request processed in 2639us (4232us total) trans 4294983444 rc 0/0 00000100:00100000:3.0:1785774769.413912:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225 00010000:00010000:3.0:1785774769.419722:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d63a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x182:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419739:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d63a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419751:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d63a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419769:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d641 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419776:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419781:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419813:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d648 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419820:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d648 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.419830:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d648 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774769.419849:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671119616:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774769.419906:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774769.419957:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774769.425867:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671119616:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774769.425894:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d648 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d64f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.425905:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d648 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d64f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774769.425934:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012f1a74a reply state 00000000e27d8e86 transno 4294968388 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.425948:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d641 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.425954:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff9b7709388600) 00010000:00010000:3.0:1785774769.425957:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774769.425960:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774769.425965:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d648 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d64f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.425972:0:8469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d648 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d64f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774769.425982:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xc9:0x0] 00000004:00010000:3.0:1785774769.425988:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012f1a74a reply state 00000000e27d8e86 transno 4294968388 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d63a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.425993:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d63a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.425998:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x182:0x0].0x0 (ffff9b7709388f00) 00010000:00010000:3.0:1785774769.426000:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774769.426002:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1785774769.426007:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x182:0x0]: returning size 4096 00010000:00010000:3.0:1785774769.426017:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426021:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426027:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426032:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426037:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.426040:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426046:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426055:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388800) 00010000:00010000:3.0:1785774769.426056:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.426059:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426064:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d62c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774769.426080:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012f1a74a reply state 00000000e27d8e86 transno 4294968388 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09d633 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426088:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09d633 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.426093:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5a271237 (ffff9b7709388c00) 00010000:00010000:3.0:1785774769.426096:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774769.426098:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1785774769.426211:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:17659:x1872519648411648:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 22902us (24123us total) trans 4294968388 rc 0/0 00000100:00100000:3.0:1785774769.426221:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23536 00000100:00100000:3.0:1785774769.514531:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774769.571875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774769.571908:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648412032 00000100:00100000:3.0:1785774769.571917:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648412032 00000100:00100000:3.0:1785774769.571964:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23538 00000100:00100000:3.0:1785774769.571974:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:17667:x1872519648412032:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774769.571994:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774769.572015:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d656 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b98f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572078:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572093:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572103:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572113:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572120:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572126:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572224:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d66b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x182:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572233:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d66b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572240:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d66b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774769.572309:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x182:0x0]: returning size 4096 00000004:00200000:3.0:1785774769.572313:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785774769.572331:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d66b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572343:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572349:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572355:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572362:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572367:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.572371:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572378:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572390:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388800) 00010000:00010000:3.0:1785774769.572393:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.572397:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572403:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d65d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572413:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572418:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572423:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572428:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.572430:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572436:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572442:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5a271237 (ffff9b7709388c00) 00010000:00010000:3.0:1785774769.572444:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.572447:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572453:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d664 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x5a271237 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572645:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d656 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b98f expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572670:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d66b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b98f expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.572676:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x182:0x0].0x0 (ffff9b7709388f00) 00010000:00010000:3.0:1785774769.572678:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774769.572680:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774769.572736:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:17667:x1872519648412032:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 763us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.572743:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23538 00000100:00100000:3.0:1785774769.600745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774769.647021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774769.657438:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b400/0x7b7109e1d09d584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657448:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b400/0x7b7109e1d09d584 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657455:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b400/0x7b7109e1d09d584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657472:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.657477:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b400/0x7b7109e1d09d584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657495:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b400/0x7b7109e1d09d584 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657505:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x7ed215cf (ffff9b760572bf00) 00010000:00010000:3.0:1785774769.657509:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.657520:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b400/0x7b7109e1d09d584 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657526:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b400/0x7b7109e1d09d584 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657536:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09d58b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657542:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09d58b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657548:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09d58b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657553:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.657556:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09d58b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657562:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09d58b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657569:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff9b760572b400) 00010000:00010000:3.0:1785774769.657571:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.657574:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09d58b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657578:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09d58b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657593:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09d592 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657599:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09d592 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657604:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09d592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657610:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.657613:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09d592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657619:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09d592 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657626:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcb:0x0].0x0 (ffff9b760572b800) 00010000:00010000:3.0:1785774769.657628:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.657631:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09d592 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657637:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09d592 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657650:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657656:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657662:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657666:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.657669:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657675:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657681:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x7ed215cf (ffff9b760572bf00) 00010000:00010000:3.0:1785774769.657684:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.657687:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.657692:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09d5e6 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x7ed215cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774769.659230:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 702 rpc_version 702 00000020:00100000:3.0:1785774769.659258:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774769.659266:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b774183d880 x1872519671120128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774769.659285:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671120128:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774769.659329:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774769.659361:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774769.663580:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671120128:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1785774769.663598:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 703 rpc_version 703 00000020:00100000:3.0:1785774769.663620:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774769.663628:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b774183f480 x1872519671120384/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774769.663647:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671120384:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774769.663689:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774769.663712:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774769.663731:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671120384 00000100:00100000:3.0:1785774769.663737:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671120384 00000100:00100000:3.0:1785774769.663771:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228 00000100:00100000:3.0:1785774769.663778:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671120384:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774769.663883:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671120384:12345-0@lo:1000:osp_up1-0.0 Request processed in 105us (193us total) trans 4294968390 rc 0/0 00000100:00100000:3.0:1785774769.663890:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228 00000100:00100000:3.0:1785774769.663925:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671120384:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774769.666414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774769.715629:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09d687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b99d expref: 14 pid: 6531 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774769.715650:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aad80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671120768:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774769.715668:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09d6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d6aa expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.715676:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc9:0x0].0x0 (ffff9b7702c6af00) 00010000:00010000:3.0:1785774769.715679:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774769.715681:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744600, rc 0) 00000100:00100000:3.0:1785774769.715730:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8627:x1872519671120640:12345-0@lo:101:mdt00_004.0 Request processed in 7117us (15877us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.715737:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229 00000100:00100000:3.0:1785774769.845366:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648412928 00000100:00100000:3.0:1785774769.845376:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648412928 00000100:00100000:3.0:1785774769.845437:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23542 00000100:00100000:3.0:1785774769.845447:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17668:x1872519648412928:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774769.845470:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774769.845501:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d6b8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9a4 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845575:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845589:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845600:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845614:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845621:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845627:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845674:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845695:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845702:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845709:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845715:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.845720:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845728:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845740:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572bd00) 00010000:00010000:3.0:1785774769.845743:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.845747:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845753:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d6bf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845766:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845772:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845778:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845783:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.845786:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845791:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845802:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x60da72aa (ffff9b7709388800) 00010000:00010000:3.0:1785774769.845804:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.845806:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845811:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d6c6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845840:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d6b8 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9a4 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845849:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572bd00) 00010000:00010000:3.0:1785774769.845851:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.845855:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d6b8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9a4 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.845863:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774769.845929:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17668:x1872519648412928:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 483us (735us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774769.845936:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23542 00000100:00100000:3.0:1785774769.848968:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671121536 00000100:00100000:3.0:1785774769.848974:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671121536 00000100:00100000:3.0:1785774769.849019:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1785774769.849026:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671121536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774769.849046:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774769.849086:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671121536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.849095:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1785774769.849131:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671121536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774769.874287:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648413056 00000100:00100000:3.0:1785774769.874297:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648413056 00000100:00100000:3.0:1785774769.874360:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23543 00000100:00100000:3.0:1785774769.874371:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17668:x1872519648413056:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774769.874395:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774769.874418:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d6cd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9ab expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.874488:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d6d4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.874503:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d6d4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.874524:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d6d4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774769.874573:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1785774769.874578:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774769.874615:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d6cd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9ab expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.874634:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d6d4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9ab expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.874643:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388700) 00010000:00010000:3.0:1785774769.874647:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774769.874650:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774769.874725:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17668:x1872519648413056:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 356us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774769.874733:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23543 00000100:00100000:3.0:1785774769.915099:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671121920:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774769.915118:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09d6f7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d6fe expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915138:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09d6f7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d6fe expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774769.915186:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4a1be82 reply state 000000005d8205ef transno 4294983446 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09d6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915201:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09d6f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915208:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774769.915210:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774769.915213:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774769.915218:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09d6f7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d6fe expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915224:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09d6f7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d6fe expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774769.915236:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xcc:0x0] 00000004:00010000:3.0:1785774769.915244:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4a1be82 reply state 000000005d8205ef transno 4294983446 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0a00/0x7b7109e1d09d6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915252:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0a00/0x7b7109e1d09d6e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915258:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:3.0:1785774769.915261:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774769.915262:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1785774769.915267:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1525:0x0]: returning size 4096 00010000:00010000:3.0:1785774769.915286:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915293:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915299:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915306:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915311:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774769.915315:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915322:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915332:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572b000) 00010000:00010000:3.0:1785774769.915334:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774769.915338:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915358:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09d6db lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774769.915375:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4a1be82 reply state 000000005d8205ef transno 4294983446 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09d6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915384:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09d6e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774769.915390:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x60da72aa (ffff9b760572b600) 00010000:00010000:3.0:1785774769.915393:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774769.915394:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1785774769.915467:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17668:x1872519648413312:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 23562us (23731us total) trans 4294983446 rc 0/0 00000100:00100000:3.0:1785774769.915474:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23544 00000100:00100000:3.0:1785774769.953574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.028962:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648413824 00000100:00100000:3.0:1785774770.028972:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648413824 00000100:00100000:3.0:1785774770.029028:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23547 00000100:00100000:3.0:1785774770.029038:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17670:x1872519648413824:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774770.029059:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.029081:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d721 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9b9 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.029148:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.029574:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.029589:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774770.029655:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcc:0x0]: returning size 4096 00000004:00200000:3.0:1785774770.029660:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774770.029914:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d721 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.029932:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.029940:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774770.029943:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774770.029946:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774770.030689:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17670:x1872519648413824:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 1643us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.030697:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23547 00000100:00100000:3.0:1785774770.047666:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648413952 00000100:00100000:3.0:1785774770.047676:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648413952 00000100:00100000:3.0:1785774770.047732:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23548 00000100:00100000:3.0:1785774770.047743:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17670:x1872519648413952:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774770.047763:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.047783:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09d72f lrc: 2/0,0 mode: --/CR res: [0x240000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.047838:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d736 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.047856:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1800/0x7b7109e1d09d6fe lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d6f7 expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.047864:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d736 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.047895:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1800/0x7b7109e1d09d6fe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09d6f7 expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.047911:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671122048:0@lo:104: 00000100:00100000:3.0:1785774770.047957:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.048008:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.049800:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671122048:0@lo:104: 00010000:00010000:3.0:1785774770.049818:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d736 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1785774770.061077:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 380 committed batchid 379 00000004:00080000:3.0:1785774770.061223:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8300 with version 729 00000020:00080000:3.0:1785774770.061233:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 378 cancel update log [0x200000401:0x3:0x0].379: rc = 0 00000020:00080000:3.0:1785774770.061275:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 378 cancel update log [0x240000400:0x3:0x0].379: rc = 0 00000004:00080000:3.0:1785774770.061296:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8900 with version 730 00000020:00080000:3.0:1785774770.061299:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 379 cancel update log [0x200000401:0x3:0x0].380: rc = 0 00000020:00080000:3.0:1785774770.061317:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 379 cancel update log [0x240000400:0x3:0x0].380: rc = 0 00000020:00080000:3.0:1785774770.061323:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 379 00000100:00100000:3.0:1785774770.084536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.084586:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648414208 00000100:00100000:3.0:1785774770.084597:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648414208 00000100:00100000:3.0:1785774770.084649:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23549 00000100:00100000:3.0:1785774770.084658:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17670:x1872519648414208:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774770.084725:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.084753:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09d71a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b2 expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084776:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:3.0:1785774770.084781:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774770.084805:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084818:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084827:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084837:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d744 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x60da72aa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084844:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d744 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084849:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d744 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084930:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084938:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084946:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084962:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084971:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.084979:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.085009:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.085023:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 16 pid: 8627 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.085038:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671122816:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774770.085109:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.091554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.091888:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648414336 00000100:00100000:3.0:1785774770.091897:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648414336 00010000:00010000:3.0:1785774770.091934:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 17 pid: 8627 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.091966:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1557 00000100:00100000:3.0:1785774770.091977:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648414336:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774770.091994:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.092000:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 17 pid: 8627 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.092012:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 17 pid: 8627 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.092034:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774770.092039:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.092048:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.092055:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.092073:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774770.092122:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648414336:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 146us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.092420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1557 00010000:00010000:3.0:1785774770.094144:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d728 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9b9 expref: 16 pid: 8627 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.094179:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671122816:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774770.094199:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.094209:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.094216:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.094261:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.094268:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.094277:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.094296:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671122944:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774770.096249:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.096295:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1785774770.116597:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d760 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.116607:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d760 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.117280:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671123328:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1785774770.117326:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.117349:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8240 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.121709:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671123328:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1785774770.122573:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].372, 952 off569912 00000040:00080000:3.0:1785774770.122746:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].371, 1032 off622096 00000004:00080000:3.0:1785774770.122753:0:6530:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605fc8240 with version 705 00000004:00200000:3.0:1785774770.136043:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1525:0x0]: returning size 4096 00010000:00010000:3.0:1785774770.136066:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136077:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136085:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136091:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.136096:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136103:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136118:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774770.136122:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774770.136136:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136144:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d752 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136184:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d760 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136193:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d760 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136200:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09d759 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d760 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136221:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774770.136229:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xcc:0x0] 00010000:00010000:3.0:1785774770.136237:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136243:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136249:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136255:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.136258:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136264:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136272:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:3.0:1785774770.136275:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774770.136278:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136283:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d74b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136299:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136306:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136312:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136317:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136322:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.136325:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136330:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136337:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7709388800) 00010000:00010000:3.0:1785774770.136340:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.136343:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136348:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d73d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774770.136365:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c79f652 reply state 000000000beaa4ec transno 4294983449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d744 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136378:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d744 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x60da72aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.136385:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x60da72aa (ffff9b760572b600) 00010000:00010000:3.0:1785774770.136387:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774770.136390:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774770.136451:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17670:x1872519648414208:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 51792us (51922us total) trans 4294983449 rc 0/0 00000100:00100000:3.0:1785774770.136458:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23549 00000100:00100000:3.0:1785774770.137865:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671123712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774770.205063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.212232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.253152:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648414848 00000100:00100000:3.0:1785774770.253182:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648414848 00000100:00100000:3.0:1785774770.253232:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23552 00000100:00100000:3.0:1785774770.253242:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17671:x1872519648414848:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774770.253262:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.253284:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d791 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9d5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.253336:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d798 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.253651:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d798 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.253664:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d798 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774770.253714:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1785774770.253719:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774770.253751:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d791 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9d5 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.253767:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d798 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9d5 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.253783:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7709388800) 00010000:00010000:3.0:1785774770.253786:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774770.253790:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0a00, rc 0) 00000100:00100000:3.0:1785774770.253849:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17671:x1872519648414848:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 609us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.253857:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23552 00000100:00100000:3.0:1785774770.353966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.371179:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648415616 00000100:00100000:3.0:1785774770.371197:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648415616 00000100:00100000:3.0:1785774770.371244:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23555 00000100:00100000:3.0:1785774770.371252:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17673:x1872519648415616:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774770.371272:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.371292:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09d7d7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9dc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.371775:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d7de lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.371790:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d7de lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.371801:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d7de lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.371812:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.371823:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d7ad expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.371832:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.371862:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09d7ad expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.371877:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f710e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671125888:0@lo:104: 00000100:00100000:3.0:1785774770.371922:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.371962:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.375049:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f710e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671125888:0@lo:104: 00010000:00010000:3.0:1785774770.375070:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774770.384322:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983450 is committed 00000001:00080000:3.0:1785774770.384357:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983449 is committed 00000020:00080000:3.0:1785774770.384364:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 381 batchid updated 00000020:00080000:3.0:1785774770.384376:0:6508:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b77093ad780 refcount 2 committed 0 result 0 batchid 382 00000020:00080000:3.0:1785774770.384381:0:6508:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7605cac200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77093ad240 00000020:00080000:3.0:1785774770.384384:0:6508:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].370 00000020:00080000:3.0:1785774770.384386:0:6508:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7605cacf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ecf200 00000020:00080000:3.0:1785774770.384389:0:6508:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].371 00000020:00080000:3.0:1785774770.384399:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 380 batchid updated 00010000:00010000:3.0:1785774770.384485:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d7b4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09d7ad expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.384506:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x1903f68f (ffff9b7602508600) 00010000:00010000:3.0:1785774770.384512:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.384522:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.384530:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.384554:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774770.384945:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3655:x1872519671126016:12345-0@lo:103:ldlm_bl.0 Request processed in 8029us (10041us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.384956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00010000:00010000:3.0:1785774770.385014:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.385022:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.385142:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671126144:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774770.385203:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.385226:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.385312:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671126144 00000100:00100000:3.0:1785774770.385318:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671126144 00000100:00100000:3.0:1785774770.385617:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1785774770.385628:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6530:x1872519671126144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774770.386002:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6530:x1872519671126144:12345-0@lo:1000:mdt00_001.0 Request processed in 375us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.386010:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1785774770.401413:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648415744 00000100:00100000:3.0:1785774770.401422:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648415744 00000100:00100000:3.0:1785774770.401486:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23556 00000100:00100000:3.0:1785774770.401496:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:17673:x1872519648415744:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774770.401518:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.401537:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d7f3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9e3 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.401714:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d7fa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.401730:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d7fa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.401741:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d7fa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774770.401848:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x184:0x0]: returning size 4096 00000004:00200000:3.0:1785774770.401854:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774770.401886:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09d7f3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9e3 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.401902:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d7fa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9e3 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.401910:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff9b7602508900) 00010000:00010000:3.0:1785774770.401913:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774770.401916:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774770.402150:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17673:x1872519648415744:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 651us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.402178:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23556 00000100:00100000:3.0:1785774770.428807:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785774770.428818:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671126784 00000100:00100000:3.0:1785774770.428822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671126784 00000100:00100000:3.0:1785774770.428857:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1785774770.428863:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6530:x1872519671126784:12345-0@lo:104: 00010000:00010000:3.0:1785774770.428875:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09d7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.428923:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774770.428928:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6530:x1872519671126784:12345-0@lo:104: Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.428935:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00010000:00010000:3.0:1785774770.428970:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774770.428976:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09d7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.428984:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774770.428989:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d7c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09d7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774770.428997:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d7c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09d7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.429021:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d7c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.429028:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774770.429047:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d7c9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.429054:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09d7c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d7d0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.429069:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774770.429072:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774770.429073:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774770.429085:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671126912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774770.429113:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.429147:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671126912 00000100:00100000:3.0:1785774770.429150:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671126912 00010000:00010000:3.0:1785774770.429187:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09d7d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09d7c9 expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.429213:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:3.0:1785774770.429219:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3656:x1872519671126912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774770.429227:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1785774770.430013:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671126784:0@lo:104: 00010000:00010000:3.0:1785774770.430032:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1785774770.431800:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 382 batchid updated 00000100:00100000:3.0:1785774770.432834:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671126912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774770.432855:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.432862:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774770.432903:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xca:0x0]: returning size 4096 00000004:00200000:3.0:1785774770.432907:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774770.432945:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09d80f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f1 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.432965:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f1 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.432972:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xca:0x0].0x0 (ffff9b7605fcc900) 00010000:00010000:3.0:1785774770.432974:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774770.432976:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745e00, rc 0) 00000100:00100000:3.0:1785774770.433022:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17673:x1872519648416000:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 4758us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.433027:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23558 00000100:00100000:3.0:1785774770.449041:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648416384 00000100:00100000:3.0:1785774770.449046:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648416384 00000100:00100000:3.0:1785774770.449083:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23559 00000100:00100000:3.0:1785774770.449090:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17673:x1872519648416384:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774770.449148:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.449185:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d7fa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x184:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9e3 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.449411:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff9b7602508900) 00010000:00010000:3.0:1785774770.449415:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774770.449529:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d81d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.449543:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d81d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.449552:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d81d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.449629:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671127296:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774770.449672:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.449758:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.450584:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983450 gen 2 00000004:00080000:3.0:1785774770.450590:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983445 committed transno 4294983450 00000020:00080000:3.0:1785774770.450595:0:8469:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605e48d80 refcount 2 committed 0 result 0 batchid 381 00000020:00080000:3.0:1785774770.450599:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605e48480 00000020:00080000:3.0:1785774770.450602:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].382 00000020:00080000:3.0:1785774770.450604:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603611a00 00000020:00080000:3.0:1785774770.450607:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].382 00000004:00080000:3.0:1785774770.450628:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983447 committed transno 4294983450 00000004:00080000:3.0:1785774770.450636:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983448 committed transno 4294983450 00000004:00080000:3.0:1785774770.450643:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983450 committed transno 4294983450 00000100:00100000:3.0:1785774770.450658:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671127296:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774770.450672:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d81d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d824 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.450775:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09d81d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d824 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774770.450792:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774770.450814:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09d82b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.450821:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09d82b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.450829:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09d82b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.450842:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671127424:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774770.450868:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.450890:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.464585:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671127680:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785774770.464637:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09d839 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.464647:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09d839 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.464657:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09d839 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.464667:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671127808:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774770.464700:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.464719:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.479196:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648416512 00000100:00100000:3.0:1785774770.479206:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648416512 00010000:00010000:3.0:1785774770.479243:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09d808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9ea expref: 11 pid: 8627 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.479273:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1562 00000100:00100000:3.0:1785774770.479282:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648416512:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774770.479308:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.479315:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09d808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9ea expref: 11 pid: 8627 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.479327:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09d808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9ea expref: 11 pid: 8627 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.479355:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09d808 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9ea expref: 11 pid: 8627 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.479375:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff9b7602508d00) 00010000:00010000:3.0:1785774770.479380:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d84e lrc: 3/0,1 mode: --/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.479389:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d84e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.479397:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09d84e lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.479423:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774770.480030:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648416512:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 747us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.480039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1562 00000100:00100000:3.0:1785774770.480653:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671128064 00000100:00100000:3.0:1785774770.480659:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671128064 00000100:00100000:3.0:1785774770.480778:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260 00000100:00100000:3.0:1785774770.480785:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8469:x1872519671128064:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774770.480800:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.480813:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d85c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09d855 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.480832:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f1 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.480840:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d85c lrc: 4/0,0 mode: --/EX res: [0x200000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09d855 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.480859:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f1 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.480870:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f1 expref: 13 pid: 6530 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.480880:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d78000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671128192:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774770.480923:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc89c0 going to sleep for 11 seconds 00010000:00010000:3.0:1785774770.490885:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09d816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f1 expref: 14 pid: 6530 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.490905:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d78000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671128192:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774770.490928:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09d85c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d855 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.490937:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xca:0x0].0x0 (ffff9b7605fcc900) 00010000:00010000:3.0:1785774770.490940:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774770.490943:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774770.490990:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8469:x1872519671128064:12345-0@lo:101:mdt00_003.0 Request processed in 10205us (10726us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.490997:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260 00000100:00100000:3.0:1785774770.504199:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671128704 00000100:00100000:3.0:1785774770.504207:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671128704 00000100:00100000:3.0:1785774770.504259:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262 00000100:00100000:3.0:1785774770.504268:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7474:x1872519671128704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774770.504597:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7474:x1872519671128704:12345-0@lo:1000:osp_up0-1.0 Request processed in 329us (509us total) trans 4294983451 rc 0/0 00000100:00100000:3.0:1785774770.504605:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262 00010000:00010000:3.0:1785774770.507625:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774770.566137:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648416768 00000100:00100000:3.0:1785774770.566146:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648416768 00000100:00100000:3.0:1785774770.566223:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23560 00000100:00100000:3.0:1785774770.566233:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17674:x1872519648416768:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774770.566252:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.566273:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d863 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259b9f8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566331:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566353:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566365:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566383:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566390:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566396:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566440:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566457:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566464:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566470:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566484:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.566488:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566495:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566506:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774770.566509:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.566513:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566520:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d86a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566532:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566537:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566542:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566548:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.566550:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566557:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566572:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xa20ac6a2 (ffff9b7605fd8a00) 00010000:00010000:3.0:1785774770.566575:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.566578:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566584:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d871 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566612:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d863 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f8 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566628:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774770.566631:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.566635:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d863 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9f8 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.566646:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774770.567027:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17674:x1872519648416768:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 795us (1027us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774770.567034:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23560 00000100:00100000:3.0:1785774770.640571:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671129472 00000100:00100000:3.0:1785774770.640579:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671129472 00000100:00100000:3.0:1785774770.640623:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264 00000100:00100000:3.0:1785774770.640632:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6531:x1872519671129472:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1785774770.640786:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.640804:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d8be lrc: 2/0,0 mode: --/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09d8b7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.640826:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d8be lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09d8b7 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.640838:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d8be lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d8b7 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.640847:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774770.640850:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.640853:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774770.640894:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6531:x1872519671129472:12345-0@lo:101:mdt00_002.0 Request processed in 263us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.640901:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264 00000100:00100000:3.0:1785774770.688635:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648417536 00000100:00100000:3.0:1785774770.688646:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648417536 00000100:00100000:3.0:1785774770.688714:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23564 00000100:00100000:3.0:1785774770.688724:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17675:x1872519648417536:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:3.0:1785774770.688895:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17675:x1872519648417536:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 172us (468us total) trans 0 rc -17/-17 00000100:00100000:3.0:1785774770.688902:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23564 00000100:00100000:3.0:1785774770.727146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.727197:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648417664 00000100:00100000:3.0:1785774770.727207:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648417664 00000100:00100000:3.0:1785774770.727258:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23565 00000100:00100000:3.0:1785774770.727267:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17676:x1872519648417664:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774770.727289:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.727312:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d8c5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba0d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727376:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727390:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727401:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727413:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727421:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727427:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727511:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d8da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727519:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d8da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727526:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d8da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774770.727614:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 4096 00000004:00200000:3.0:1785774770.727619:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785774770.727638:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d8da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727651:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727657:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.727664:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728230:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728240:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.728245:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728252:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728263:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:3.0:1785774770.728266:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.728270:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728276:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d8cc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728289:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728295:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728301:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728306:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.728309:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728315:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.728327:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xa20ac6a2 (ffff9b7602508800) 00010000:00010000:3.0:1785774770.728329:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.728333:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.729616:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8d3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.729655:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d8c5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba0d expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.730292:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09d8da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba0d expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.730302:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff9b7605fcca00) 00010000:00010000:3.0:1785774770.730305:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774770.730307:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774770.730549:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17676:x1872519648417664:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 3281us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.734823:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23565 00000100:00100000:3.0:1785774770.743286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.750967:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648417920 00000100:00100000:3.0:1785774770.750975:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648417920 00000100:00100000:3.0:1785774770.751030:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23567 00000100:00100000:3.0:1785774770.751039:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17676:x1872519648417920:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774770.751074:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.751094:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d8ef lrc: 2/0,0 mode: --/CR res: [0x240000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba1b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.751155:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.751188:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d8be lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d8b7 expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.751198:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.751228:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d8be lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09d8b7 expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.751252:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671129600:0@lo:104: 00000100:00100000:3.0:1785774770.751294:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.751331:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.754586:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671129600:0@lo:104: 00010000:00010000:3.0:1785774770.754608:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.754625:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774770.754631:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0800/0x7b7109e1d09d8b7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09d8be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.754639:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774770.754645:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0800/0x7b7109e1d09d8b7 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09d8be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774770.754662:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0800/0x7b7109e1d09d8b7 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09d8be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.754697:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0800/0x7b7109e1d09d8b7 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d8be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.754704:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774770.754724:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0800/0x7b7109e1d09d8b7 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d8be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.754732:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0800/0x7b7109e1d09d8b7 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09d8be expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.754749:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774770.754751:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774770.754753:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774770.754765:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671129728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774770.754795:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.754830:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671129728 00000100:00100000:3.0:1785774770.754833:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671129728 00010000:00010000:3.0:1785774770.754851:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d8be lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09d8b7 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.754869:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1785774770.754874:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3656:x1872519671129728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774770.754884:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.761039:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09d82b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09d832 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774770.761057:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09d82b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09d832 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761107:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09d82b lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d832 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761112:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774770.761142:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09d82b lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d832 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774770.761156:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968399 is committed 00000001:00080000:3.0:1785774770.761194:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968398 is committed 00000020:00080000:3.0:1785774770.761202:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 381 batchid updated 00000020:00080000:3.0:1785774770.761212:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7606095600 refcount 2 committed 0 result 0 batchid 382 00000020:00080000:3.0:1785774770.761216:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b76060950c0 00000020:00080000:3.0:1785774770.761218:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].383 00000020:00080000:3.0:1785774770.761220:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604761600 00000020:00080000:3.0:1785774770.761223:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].383 00000020:00080000:3.0:1785774770.761239:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 380 batchid updated 00000100:00100000:3.0:1785774770.761261:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671129856:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1785774770.761316:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785774770.761359:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d7bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761367:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d7bb lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761375:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d7bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761381:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.761386:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d7bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761393:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d7bb lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761405:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff9b7602508900) 00010000:00010000:3.0:1785774770.761408:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.761412:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d7bb lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761418:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09d7bb lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761436:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d7c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761443:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d7c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761448:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d7c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761453:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.761456:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d7c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761462:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d7c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761468:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff9b7602508d00) 00010000:00010000:3.0:1785774770.761481:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.761485:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d7c2 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761491:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09d7c2 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1785774770.761509:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 382 committed batchid 381 00000004:00080000:3.0:1785774770.761604:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8b40 with version 733 00000020:00080000:3.0:1785774770.761612:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 380 cancel update log [0x200000401:0x3:0x0].381: rc = 0 00000020:00080000:3.0:1785774770.761645:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 380 cancel update log [0x240000400:0x3:0x0].381: rc = 0 00000004:00080000:3.0:1785774770.761673:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8cc0 with version 734 00000020:00080000:3.0:1785774770.761847:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 381 cancel update log [0x200000401:0x3:0x0].382: rc = 0 00000020:00080000:3.0:1785774770.761872:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 381 cancel update log [0x240000400:0x3:0x0].382: rc = 0 00000020:00080000:3.0:1785774770.761878:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 381 00010000:00010000:3.0:1785774770.761920:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d8be lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09d8b7 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761931:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774770.761936:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761945:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761953:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.761971:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774770.762003:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671129728:12345-0@lo:103:ldlm_bl.0 Request processed in 7128us (7206us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.762016:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1785774770.762034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671129856 00000100:00100000:3.0:1785774770.762040:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671129856 00000100:00100000:3.0:1785774770.762071:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1785774770.762078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671129856:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1785774770.762088:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.762100:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09d832 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x1903f68f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09d82b expref: 7 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.762110:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x1903f68f (ffff9b760572b600) 00010000:00010000:3.0:1785774770.762116:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774770.762317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1872519671129856:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 239us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.762323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000004:00080000:3.0:1785774770.762340:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 733 rpc_version 733 00000020:00100000:3.0:1785774770.762356:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774770.762363:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603d78700 x1872519671130112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774770.762376:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d78700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671130112:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774770.762399:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.762413:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8f00 going to sleep for 11 seconds 00010000:00010000:3.0:1785774770.762425:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.762432:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774770.762486:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xcd:0x0]: returning size 4096 00000004:00200000:3.0:1785774770.762491:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774770.762524:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d8ef lrc: 0/0,0 mode: --/CR res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba1b expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.762537:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba1b expref: 8 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.762543:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774770.762545:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774770.762547:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774770.763259:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:17676:x1872519648417920:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 12218us (12452us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.763266:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23567 00000100:00100000:3.0:1785774770.763307:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671129728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774770.763341:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671129856:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1785774770.763358:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671130112 00000100:00100000:3.0:1785774770.763362:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671130112 00000100:00100000:3.0:1785774770.763387:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1785774770.763394:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7474:x1872519671130112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774770.763524:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7474:x1872519671130112:12345-0@lo:1000:osp_up0-1.0 Request processed in 129us (1123us total) trans 4294983453 rc 0/0 00000100:00100000:3.0:1785774770.763531:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1785774770.763571:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d78700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671130112:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1785774770.763579:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 734 rpc_version 734 00000020:00100000:3.0:1785774770.763590:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774770.763596:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603d7b480 x1872519671130368/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774770.763609:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671130368:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774770.763632:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.763645:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7701377480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.763667:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671130368 00000100:00100000:3.0:1785774770.763670:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671130368 00000100:00100000:3.0:1785774770.764276:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:3.0:1785774770.764282:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7474:x1872519671130368:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774770.764353:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7474:x1872519671130368:12345-0@lo:1000:osp_up0-1.0 Request processed in 70us (718us total) trans 4294983454 rc 0/0 00000100:00100000:3.0:1785774770.764359:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:3.0:1785774770.764386:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671130368:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774770.806721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.829870:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648418432 00000100:00100000:3.0:1785774770.829878:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648418432 00010000:00010000:3.0:1785774770.829913:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba1b expref: 8 pid: 8469 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.829954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1566 00000100:00100000:3.0:1785774770.829963:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648418432:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774770.829978:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.829985:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba1b expref: 8 pid: 8469 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.829998:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09d8f6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba1b expref: 8 pid: 8469 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830024:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774770.830031:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09d920 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09d919 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830041:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09d920 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09d919 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830050:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09d920 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09d919 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830080:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09d920 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d919 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774770.830094:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6514:1872519671130880:0@lo:105: 00000100:00100000:3.0:1785774770.830147:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774770.830197:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774770.830210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671130880 00000100:00100000:3.0:1785774770.830214:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671130880 00000100:00100000:3.0:1785774770.830248:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1785774770.830255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671130880:12345-0@lo:105: 00010000:00010000:3.0:1785774770.830266:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745800/0x7b7109e1d09d919 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d920 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830275:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745800/0x7b7109e1d09d919 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d920 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830284:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745800/0x7b7109e1d09d919 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d920 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830293:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745800/0x7b7109e1d09d919 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09d920 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830301:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745800/0x7b7109e1d09d919 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09d920 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830309:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745800/0x7b7109e1d09d919 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09d920 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.830321:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7711745800) 00000100:00100000:3.0:1785774770.830362:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671130880:12345-0@lo:105: Request processed in 107us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.830368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1785774770.830400:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6514:1872519671130880:0@lo:105: 00010000:00010000:3.0:1785774770.830413:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774770.830443:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648418432:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 482us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.830450:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1566 00000100:00100000:3.0:1785774770.838318:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671131008 00000100:00100000:3.0:1785774770.838328:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671131008 00000100:00100000:3.0:1785774770.862896:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671131136 00000100:00100000:3.0:1785774770.862910:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671131136 00000100:00100000:3.0:1785774770.862978:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1785774770.862988:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3654:x1872519671131136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774770.863006:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774770.863030:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09d920 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09d919 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.863047:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774770.863057:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774770.873066:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671131136:12345-0@lo:103:ldlm_bl.0 Request processed in 10071us (15108us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.873081:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1785774770.904628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.904668:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648418560 00000100:00100000:3.0:1785774770.904685:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648418560 00000100:00100000:3.0:1785774770.904738:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23569 00000100:00100000:3.0:1785774770.904748:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17677:x1872519648418560:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774770.904768:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774770.904790:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d927 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba22 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904845:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904859:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904869:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904883:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904890:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904902:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904941:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904947:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904952:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904958:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904962:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.904966:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904973:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904982:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7709388a00) 00010000:00010000:3.0:1785774770.904985:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.904988:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.904993:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09d92e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905001:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905007:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905023:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905028:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774770.905030:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905035:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905041:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9b7709388400) 00010000:00010000:3.0:1785774770.905043:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.905045:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905050:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d935 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905074:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d927 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba22 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905083:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7709388a00) 00010000:00010000:3.0:1785774770.905085:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774770.905088:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d927 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba22 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774770.905099:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774770.905178:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17677:x1872519648418560:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 431us (558us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774770.905185:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23569 00000100:00100000:3.0:1785774770.959052:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.998037:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774770.999236:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671131264 00000100:00100000:3.0:1785774770.999241:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671131264 00000100:00100000:3.0:1785774770.999270:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1785774770.999276:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671131264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774770.999351:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671131264:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774770.999358:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1785774771.002092:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671131392 00000100:00100000:3.0:1785774771.002099:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671131392 00000100:00100000:3.0:1785774771.002146:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1785774771.002153:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671131392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774771.002440:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671131392:12345-0@lo:1000:mdt00_001.0 Request processed in 286us (899us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774771.002449:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1785774771.002779:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671131520 00000100:00100000:3.0:1785774771.002784:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671131520 00000100:00100000:3.0:1785774771.002815:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:3.0:1785774771.002821:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6530:x1872519671131520:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774771.002830:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774771.002846:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09d95f expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.002874:0:7692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09d958 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba30 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.002884:0:7692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.002905:0:7692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09d958 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba30 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.002917:0:7692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09d958 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba30 expref: 15 pid: 6529 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774771.002927:0:7692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671131648:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774771.002980:0:7692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774771.008575:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671131648:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774771.008612:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.008624:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572b300) 00010000:00010000:3.0:1785774771.008626:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774771.008631:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.008640:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1400, rc 0) 00000100:00100000:3.0:1785774771.012374:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6530:x1872519671131520:12345-0@lo:101:mdt00_001.0 Request processed in 9543us (9727us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.012388:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00100000:3.0:1785774771.014697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774771.014726:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648419200 00000100:00100000:3.0:1785774771.014733:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648419200 00010000:00010000:3.0:1785774771.014771:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09d958 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba30 expref: 16 pid: 6529 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774771.014800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1567 00000100:00100000:3.0:1785774771.014809:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648419200:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774771.014825:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774771.014831:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09d958 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba30 expref: 16 pid: 6529 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.014844:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09d958 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba30 expref: 16 pid: 6529 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.014865:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09d958 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba30 expref: 16 pid: 6529 timeout: 1112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.014880:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572b300) 00010000:00010000:3.0:1785774771.014887:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.014897:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.014906:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.014936:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774771.014950:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671131776:0@lo:105: 00000100:00100000:3.0:1785774771.014989:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774771.015018:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8f00 going to sleep for 11 seconds 00000100:00080000:3.0:1785774771.015030:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785774771.015275:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015283:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015291:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015300:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015315:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ef0200) 00010000:00010000:0.0:1785774771.015323:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015331:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774771.015363:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774771.015393:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015400:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015408:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774771.015420:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671131904:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1785774771.015446:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.015464:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076d80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.015490:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671131904 00000100:00100000:0.0:1785774771.015493:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671131904 00000100:00100000:0.0:1785774771.015520:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272 00000100:00100000:0.0:1785774771.015526:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6530:x1872519671131904:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774771.015539:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774771.015552:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09d974 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09d96d expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015569:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09d974 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09d96d expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015579:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09d974 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d96d expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015587:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9b7602508500) 00010000:00010000:0.0:1785774771.015590:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774771.015592:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744800, rc 0) 00000100:00100000:0.0:1785774771.015621:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671131904:12345-0@lo:101:mdt00_001.0 Request processed in 95us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.015627:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272 00000100:00100000:0.0:1785774771.015649:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671131904:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774771.015659:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d974 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.015668:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d974 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774771.015685:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1785774771.015710:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132032:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.015733:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.015743:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.015754:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671132032 00000100:00100000:0.0:1785774771.015757:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671132032 00000100:00100000:0.0:1785774771.015773:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273 00000100:00100000:0.0:1785774771.015778:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.015823:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132032:12345-0@lo:1000:mdt00_001.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.015829:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273 00000100:00100000:0.0:1785774771.015849:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132032:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.015878:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132160:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.015896:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.015906:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.015916:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671132160 00000100:00100000:0.0:1785774771.015919:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671132160 00000100:00100000:0.0:1785774771.015935:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274 00000100:00100000:0.0:1785774771.015940:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.015993:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132160:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (96us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774771.015998:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274 00000100:00100000:0.0:1785774771.016018:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132160:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016074:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132288:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016095:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.016106:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.016115:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671132288 00000100:00100000:0.0:1785774771.016117:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671132288 00000100:00100000:0.0:1785774771.016132:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:0.0:1785774771.016136:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016188:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132288:12345-0@lo:1000:mdt00_001.0 Request processed in 51us (92us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774771.016194:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00100000:0.0:1785774771.016213:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132288:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016248:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132416:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016267:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.016277:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.016286:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671132416 00000100:00100000:0.0:1785774771.016288:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671132416 00000100:00100000:0.0:1785774771.016303:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:0.0:1785774771.016308:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016345:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132416:12345-0@lo:1000:mdt00_001.0 Request processed in 37us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.016351:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:0.0:1785774771.016369:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132416:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016398:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132544:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016416:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.016427:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.016435:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671132544 00000100:00100000:0.0:1785774771.016437:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671132544 00000100:00100000:0.0:1785774771.016452:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:0.0:1785774771.016457:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016514:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132544:12345-0@lo:1000:mdt00_001.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.016520:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00000100:00100000:0.0:1785774771.016540:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132544:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016568:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132672:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016588:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.016598:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.016607:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671132672 00000100:00100000:0.0:1785774771.016610:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671132672 00000100:00100000:0.0:1785774771.016625:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00100000:0.0:1785774771.016630:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.016661:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6530:x1872519671132672:12345-0@lo:1000:mdt00_001.0 Request processed in 31us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.016667:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:0.0:1785774771.016686:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671132672:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1785774771.017357:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].385, 2168 off588120 00000040:00080000:0.0:1785774771.017423:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].385, 2368 off634296 00000004:00080000:0.0:1785774771.017429:0:6530:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7711076d80 with version 735 00000100:00100000:0.0:1785774771.017506:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671131776:12345-0@lo:105: Request processed in 2258us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.017514:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000004:00080000:3.0:1785774771.022834:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 735 rpc_version 735 00000020:00100000:3.0:1785774771.022899:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774771.022910:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fab3100 x1872519671132928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774771.022934:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671132928:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774771.023026:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774771.023053:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774771.023141:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671131776:0@lo:105: 00010000:00010000:3.0:1785774771.023188:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774771.023252:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648419200:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 8441us (8559us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.023265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1567 00000100:00100000:3.0:1785774771.023307:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671132928 00000100:00100000:3.0:1785774771.023315:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671132928 00000100:00100000:3.0:1785774771.023369:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:3.0:1785774771.023378:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7474:x1872519671132928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774771.024027:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7474:x1872519671132928:12345-0@lo:1000:osp_up0-1.0 Request processed in 649us (1001us total) trans 4294983455 rc 0/0 00000100:00100000:3.0:1785774771.024038:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:3.0:1785774771.024097:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671132928:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1785774771.024223:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x185:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024239:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024251:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024270:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024277:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024283:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024309:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024317:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.024327:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774771.024340:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671133056:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774771.024367:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774771.024386:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774771.024398:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671133056 00000100:00100000:3.0:1785774771.024403:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671133056 00000100:00100000:3.0:1785774771.024432:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:3.0:1785774771.024439:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6530:x1872519671133056:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774771.024450:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774771.024465:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d990 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09d989 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.033723:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09d989 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.033743:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09d990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09d989 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.033752:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9b7709388f00) 00010000:00010000:3.0:1785774771.033755:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774771.033759:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774771.033833:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6530:x1872519671133056:12345-0@lo:101:mdt00_001.0 Request processed in 9393us (9463us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.033841:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:0.0:1785774771.035646:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671133056:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774771.035681:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d989 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d990 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035695:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d989 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d990 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774771.035721:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8c14c01 reply state 00000000ddd4e1c4 transno 4294968400 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035735:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035743:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcb:0x0].0x0 (ffff9b7709388400) 00010000:00010000:0.0:1785774771.035746:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774771.035749:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774771.035754:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d989 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d990 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035762:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0a00/0x7b7109e1d09d989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d990 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774771.035772:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xcb:0x0] 00000004:00010000:0.0:1785774771.035779:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8c14c01 reply state 00000000ddd4e1c4 transno 4294968400 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035786:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035791:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x185:0x0].0x0 (ffff9b7709388a00) 00010000:00010000:0.0:1785774771.035793:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774771.035794:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1785774771.035798:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x185:0x0]: returning size 4096 00000004:00080000:0.0:1785774771.035808:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774771.035817:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035823:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035830:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035853:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774771.035857:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774771.035862:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d974 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.035868:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09d974 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774771.035955:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:17677:x1872519648419072:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 37638us (37925us total) trans 4294968400 rc 0/0 00000100:00100000:0.0:1785774771.035962:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23572 00010000:00010000:3.0:1785774771.036279:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774771.036287:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.036295:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774771.036300:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774771.036312:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.036353:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.036360:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774771.036381:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.036388:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09d95f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d966 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.036406:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774771.036407:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774771.036409:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774771.036416:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774771.036439:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671133184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774771.036504:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774771.036541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671133184 00000100:00100000:3.0:1785774771.036559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671133184 00000100:00100000:3.0:1785774771.036606:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1785774771.036615:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3656:x1872519671133184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774771.036627:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774771.036643:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d966 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09d95f expref: 12 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.036666:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572b300) 00010000:00010000:3.0:1785774771.036673:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774771.036703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3656:x1872519671133184:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.036710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1785774771.036761:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671133184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774771.083810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774771.090350:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23573 00000100:00100000:0.0:1785774771.090361:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17683:x1872519648419456:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:0.0:1785774771.091584:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17683:x1872519648419456:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 1222us (7778us total) trans 0 rc -17/-17 00000100:00100000:0.0:1785774771.091594:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23573 00000100:00100000:0.0:1785774771.132679:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671133312 00000100:00100000:0.0:1785774771.132692:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671133312 00000100:00100000:0.0:1785774771.132774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1785774771.132783:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6531:x1872519671133312:12345-0@lo:104: 00010000:00010000:0.0:1785774771.132799:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744000/0x7b7109e1d09d96d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09d974 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.132881:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785774771.132887:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6531:x1872519671133312:12345-0@lo:104: Request processed in 106us (4107us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.132893:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1785774771.137564:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671133440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774771.137635:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774771.170876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774771.170914:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648419712 00000100:00100000:3.0:1785774771.170922:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648419712 00000100:00100000:3.0:1785774771.170987:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23575 00000100:00100000:3.0:1785774771.170997:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:17688:x1872519648419712:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774771.171021:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774771.171042:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d9b3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x185:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba3e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.171100:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d9ba lrc: 3/1,0 mode: --/PR res: [0x240000402:0x185:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.171114:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d9ba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x185:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.171127:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d9ba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x185:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774771.171237:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x185:0x0]: returning size 4096 00000004:00200000:3.0:1785774771.171242:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774771.171278:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1400/0x7b7109e1d09d9b3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba3e expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.171301:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09d9ba lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x185:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba3e expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.171309:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x185:0x0].0x0 (ffff9b7709388a00) 00010000:00010000:3.0:1785774771.171312:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774771.171315:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:3.0:1785774771.173194:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17688:x1872519648419712:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 2190us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.173205:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23575 00000100:00080000:3.0:1785774771.173234:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00080000:3.0:1785774771.282835:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 385 00000004:00080000:3.0:1785774771.282907:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605fc8900 with version 711 00000020:00080000:3.0:1785774771.282924:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 384 cancel update log [0x240000401:0x3:0x0].373: rc = 0 00000020:00080000:3.0:1785774771.283002:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 384 cancel update log [0x200000400:0x3:0x0].373: rc = 0 00000020:00080000:3.0:1785774771.283011:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 385 00000100:00100000:3.0:1785774771.325292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774771.339696:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602758380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671135360:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774771.339732:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09da1c lrc: 3/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09da15 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.339744:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9b7709388f00) 00010000:00010000:0.0:1785774771.339747:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774771.339752:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09da1c lrc: 3/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09da15 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.339762:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09da1c lrc: 3/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09da15 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.339770:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1a00, rc 0) 00000100:00100000:0.0:1785774771.339835:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6530:x1872519671135232:12345-0@lo:101:mdt00_001.0 Request processed in 13799us (13876us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.339844:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:3.0:1785774771.358623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774771.359525:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785774771.359537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671135488 00000100:00100000:3.0:1785774771.359541:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671135488 00000100:00100000:3.0:1785774771.359586:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1785774771.359594:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773c367850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671135488:12345-0@lo:105: 00010000:00010000:3.0:1785774771.359606:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09da15 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09da1c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.359615:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09da15 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09da1c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.359624:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09da15 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09da1c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.359631:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09da15 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09da1c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.359638:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09da15 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09da1c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.359645:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09da15 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09da1c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.359671:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ef0a00) 00000100:00100000:3.0:1785774771.359708:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773c367850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671135488:12345-0@lo:105: Request processed in 115us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.359715:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1785774771.361732:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671135616 00000100:00100000:3.0:1785774771.361738:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671135616 00000100:00100000:3.0:1785774771.361777:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:3.0:1785774771.361784:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6530:x1872519671135616:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1785774771.369876:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6530:x1872519671135616:12345-0@lo:403:mdt00_001.0 Request processed in 8085us (9030us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.369889:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000004:00080000:3.0:1785774771.374017:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 736 rpc_version 736 00000020:00100000:3.0:1785774771.374058:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774771.374075:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fab2300 x1872519671135872/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774771.374097:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671135872:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774771.374789:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774771.374823:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774771.379705:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab2300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671135872:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774771.475637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774771.477320:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648420736 00000100:00100000:0.0:1785774771.477342:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648420736 00000100:00100000:0.0:1785774771.477405:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23579 00000100:00100000:0.0:1785774771.477414:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17689:x1872519648420736:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774771.477437:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774771.477457:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09da23 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba53 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477530:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477544:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477556:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477571:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477578:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477584:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477629:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477637:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477642:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477653:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477659:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774771.477663:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477670:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477682:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388700) 00010000:00010000:0.0:1785774771.477685:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774771.477689:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477695:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09da2a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477712:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477719:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477725:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477730:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774771.477733:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477742:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477749:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xff310312 (ffff9b7602508200) 00010000:00010000:0.0:1785774771.477751:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774771.477754:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477759:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09da31 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477792:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09da23 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba53 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477802:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388700) 00010000:00010000:0.0:1785774771.477805:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774771.477808:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09da23 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba53 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.477818:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745a00, rc 0) 00000100:00100000:0.0:1785774771.477880:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17689:x1872519648420736:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 467us (2251us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774771.477887:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23579 00000100:00100000:3.0:1785774771.602311:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671136512:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1785774771.602404:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.602414:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.602424:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774771.602443:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671136640:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774771.602504:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774771.602541:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc89c0 going to sleep for 11 seconds 00010000:00010000:3.0:1785774771.612682:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09d6d4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259b9ab expref: 10 pid: 6531 timeout: 1113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774771.612698:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7692:1872519671136768:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774771.612721:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09da4d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09da46 expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.612729:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388700) 00010000:00010000:3.0:1785774771.612732:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774771.612735:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0400, rc 0) 00000100:00100000:3.0:1785774771.612786:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6530:x1872519671136640:12345-0@lo:101:mdt00_001.0 Request processed in 9378us (10283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.612794:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294 00000100:00100000:3.0:1785774771.614356:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671137024 00000100:00100000:3.0:1785774771.614361:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671137024 00000100:00100000:3.0:1785774771.614399:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:3.0:1785774771.614405:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6530:x1872519671137024:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774771.614419:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774771.614434:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09da5b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09da54 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.614453:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09da5b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09da54 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.614474:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09da5b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09da54 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.614482:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xff310312 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774771.614485:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774771.614487:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1200, rc 0) 00000100:00100000:3.0:1785774771.614516:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137024:12345-0@lo:101:mdt00_001.0 Request processed in 111us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.614522:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:0.0:1785774771.619146:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671137280 00000100:00100000:0.0:1785774771.619151:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671137280 00000100:00100000:0.0:1785774771.619197:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:0.0:1785774771.619205:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.619276:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137280:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (201us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774771.619283:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:0.0:1785774771.621926:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671137408 00000100:00100000:0.0:1785774771.621932:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671137408 00000100:00100000:0.0:1785774771.621968:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298 00000100:00100000:0.0:1785774771.621976:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.622058:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137408:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774771.622065:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298 00000100:00100000:0.0:1785774771.625716:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671137664 00000100:00100000:0.0:1785774771.625721:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671137664 00000100:00100000:0.0:1785774771.625756:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:0.0:1785774771.625765:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774771.625840:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137664:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.625847:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00100000:3.0:1785774771.628566:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671137792 00000100:00100000:3.0:1785774771.628574:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671137792 00000100:00100000:3.0:1785774771.628614:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301 00000100:00100000:3.0:1785774771.628621:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137792:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774771.628684:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6530:x1872519671137792:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774771.628692:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301 00000100:00100000:0.0:1785774771.643421:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671138048 00000100:00100000:0.0:1785774771.643430:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671138048 00000100:00100000:0.0:1785774771.643493:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3302 00000100:00100000:0.0:1785774771.643502:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671138048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774771.648212:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671138048:12345-0@lo:1000:osp_up1-0.0 Request processed in 4705us (5199us total) trans 4294968404 rc 0/0 00000100:00100000:0.0:1785774771.648236:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3302 00000100:00100000:3.0:1785774771.648501:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671138048:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1785774771.649308:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09da62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649324:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09da62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649349:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09da62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649367:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09da69 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649374:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09da69 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649381:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09da69 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649412:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649418:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649427:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774771.649592:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671138176:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1785774771.649634:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.649710:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77110769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774771.649728:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671138176 00000100:00100000:0.0:1785774771.649733:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671138176 00000100:00100000:0.0:1785774771.649767:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303 00000100:00100000:0.0:1785774771.649774:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6530:x1872519671138176:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774771.649792:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774771.649806:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d09da77 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09da70 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649825:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d09da77 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09da70 expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649836:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d09da77 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09da70 expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649845:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xce:0x0].0x0 (ffff9b7602508500) 00010000:00010000:0.0:1785774771.649848:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774771.649852:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:0.0:1785774771.649878:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6530:x1872519671138176:12345-0@lo:101:mdt00_001.0 Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.649883:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303 00000100:00100000:0.0:1785774771.649912:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671138176:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774771.649923:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09da77 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649933:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09da77 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774771.649952:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e34a222 reply state 00000000b7ed67c6 transno 4294983457 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09da69 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649964:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09da69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649970:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xce:0x0].0x0 (ffff9b7602508300) 00010000:00010000:0.0:1785774771.649973:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774771.649976:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774771.649981:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09da77 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.649989:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09da77 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774771.649997:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xce:0x0] 00000004:00010000:0.0:1785774771.650002:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e34a222 reply state 00000000b7ed67c6 transno 4294983457 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09da62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650009:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09da62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650015:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff9b7602508200) 00010000:00010000:0.0:1785774771.650018:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774771.650019:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1785774771.650023:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152b:0x0]: returning size 4096 00000004:00080000:0.0:1785774771.650030:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774771.650037:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650044:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650051:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650066:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774771.650069:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774771.650073:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b800/0x7b7109e1d09da54 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09da5b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650081:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b800/0x7b7109e1d09da54 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09da5b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774771.650140:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17689:x1872519648421120:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 66196us (67512us total) trans 4294983457 rc 0/0 00000100:00100000:0.0:1785774771.650146:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23581 00010000:00010000:0.0:1785774771.650184:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774771.650190:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650198:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774771.650203:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774771.650212:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650234:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650240:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774771.650255:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650262:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1400/0x7b7109e1d09da46 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09da4d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.650282:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774771.650284:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774771.650286:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774771.650294:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671138304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774771.650318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.658454:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671138304 00000100:00100000:0.0:1785774771.658487:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671138304 00000100:00100000:0.0:1785774771.658559:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1785774771.658569:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3653:x1872519671138304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774771.658585:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774771.658607:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09da4d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09da46 expref: 11 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.658626:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388700) 00010000:00010000:0.0:1785774771.658636:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774771.658794:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3653:x1872519671138304:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (8474us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.658801:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1785774771.658844:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671138304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774771.929933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774771.934018:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774771.934035:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671138560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774771.934095:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785774771.951995:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1000/0x7b7109e1d09d9eb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09d9f2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774771.952015:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1000/0x7b7109e1d09d9eb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09d9f2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952058:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1000/0x7b7109e1d09d9eb lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d9f2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952066:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774771.952093:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1000/0x7b7109e1d09d9eb lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09d9f2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774771.952121:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968404 is committed 00000001:00080000:3.0:1785774771.952137:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968403 is committed 00000020:00080000:3.0:1785774771.952144:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 383 batchid updated 00000020:00080000:3.0:1785774771.952155:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7711076900 refcount 2 committed 0 result 0 batchid 384 00000020:00080000:3.0:1785774771.952176:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7711076d80 00000020:00080000:3.0:1785774771.952180:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].385 00000020:00080000:3.0:1785774771.952182:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604760a00 00000020:00080000:3.0:1785774771.952185:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].385 00000020:00080000:3.0:1785774771.952201:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 382 batchid updated 00010000:00010000:3.0:1785774771.952220:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952228:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952235:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952241:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774771.952246:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952252:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952265:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x185:0x0].0x0 (ffff9b7709388a00) 00010000:00010000:3.0:1785774771.952268:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774771.952272:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952279:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09d97b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952293:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952300:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952306:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952312:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774771.952316:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952322:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774771.952340:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1785774771.952342:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcb:0x0].0x0 (ffff9b7709388400) 00010000:00010000:3.0:1785774771.952347:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774771.952350:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774771.952356:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09d982 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774771.952363:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671138688:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:3.0:1785774771.952379:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 384 committed batchid 383 00000100:00100000:0.0:1785774771.952431:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.952491:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671138688 00000100:00100000:0.0:1785774771.952497:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671138688 00000100:00100000:0.0:1785774771.952538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1785774771.952545:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3656:x1872519671138688:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1785774771.952567:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774771.952584:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1800/0x7b7109e1d09d9f2 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09d9eb expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774771.952597:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9b7605fcc000) 00010000:00010000:0.0:1785774771.952604:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1785774771.952620:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8240 with version 737 00000020:00080000:3.0:1785774771.952632:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 382 cancel update log [0x200000401:0x3:0x0].383: rc = 0 00000100:00100000:0.0:1785774771.952652:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3656:x1872519671138688:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774771.952659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1785774771.952697:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671138688:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:3.0:1785774771.954810:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 382 cancel update log [0x240000400:0x3:0x0].383: rc = 0 00000004:00080000:3.0:1785774771.954867:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8f00 with version 738 00000020:00080000:3.0:1785774771.954872:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 383 cancel update log [0x200000401:0x3:0x0].384: rc = 0 00000020:00080000:3.0:1785774771.954902:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 383 cancel update log [0x240000400:0x3:0x0].384: rc = 0 00000020:00080000:3.0:1785774771.954909:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 383 00000004:00080000:3.0:1785774771.954919:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 737 rpc_version 737 00000020:00100000:3.0:1785774771.954944:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774771.954952:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fab3100 x1872519671138944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774771.954972:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671138944:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774771.955021:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774771.986140:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671138944 00000100:00100000:0.0:1785774771.986155:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671138944 00000100:00100000:0.0:1785774771.986246:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671139072 00000100:00100000:0.0:1785774771.986250:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671139072 00000100:00100000:0.0:1785774771.986269:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304 00000100:00100000:0.0:1785774771.986278:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7474:x1872519671138944:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774771.988420:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7474:x1872519671138944:12345-0@lo:1000:osp_up0-1.0 Request processed in 2131us (33386us total) trans 4294983458 rc 0/0 00000100:00100000:0.0:1785774771.988428:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304 00000100:00100000:3.0:1785774771.994280:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671139328 00000100:00100000:3.0:1785774771.994289:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671139328 00000100:00100000:0.0:1785774771.995257:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1785774771.995266:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7474:x1872519671139328:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774771.995583:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7474:x1872519671139328:12345-0@lo:1000:osp_up0-1.0 Request processed in 318us (2717us total) trans 4294983459 rc 0/0 00000100:00100000:0.0:1785774771.995591:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00010000:00010000:3.0:1785774772.008720:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774772.056262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774772.057245:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671139456 00000100:00100000:3.0:1785774772.057249:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671139456 00000100:00100000:3.0:1785774772.057280:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1785774772.057287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:8627:x1872519671139456:12345-0@lo:104: 00010000:00010000:3.0:1785774772.057298:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744000/0x7b7109e1d09da70 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09da77 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.057360:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774772.057366:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:8627:x1872519671139456:12345-0@lo:104: Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.057373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1785774772.057453:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671139456:0@lo:104: 00010000:00010000:0.0:1785774772.057501:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dabd lrc: 3/1,0 mode: --/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774772.057934:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671139584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774772.057968:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1785774772.079282:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 384 00000004:00080000:0.0:1785774772.079351:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b76060a13c0 with version 739 00000020:00080000:0.0:1785774772.079365:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 384 cancel update log [0x200000401:0x3:0x0].385: rc = 0 00000020:00080000:0.0:1785774772.079439:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 384 cancel update log [0x240000400:0x3:0x0].385: rc = 0 00000020:00080000:0.0:1785774772.079446:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 384 00000004:00080000:0.0:1785774772.079455:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 739 rpc_version 739 00000020:00100000:0.0:1785774772.079492:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774772.079502:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b77012a9880 x1872519671139840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774772.079523:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671139840:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774772.079577:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.079599:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.079621:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671139840 00000100:00100000:0.0:1785774772.079626:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671139840 00000100:00100000:0.0:1785774772.079662:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307 00000100:00100000:0.0:1785774772.079670:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7474:x1872519671139840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774772.079783:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7474:x1872519671139840:12345-0@lo:1000:osp_up0-1.0 Request processed in 113us (204us total) trans 4294983460 rc 0/0 00000100:00100000:0.0:1785774772.079790:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307 00000100:00100000:0.0:1785774772.079837:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671139840:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774772.100799:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648422144 00000100:00100000:0.0:1785774772.100809:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648422144 00000100:00100000:0.0:1785774772.100865:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1343 00000100:00100000:0.0:1785774772.100874:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2419:x1872519648422144:12345-192.168.202.31@tcp:103:rmdir.0 00010000:00010000:0.0:1785774772.100888:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774772.100910:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09da93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba61 expref: 8 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.100925:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff9b7731f88400) 00010000:00010000:0.0:1785774772.100935:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774772.100983:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648422144:12345-192.168.202.31@tcp:103:rmdir.0 Request processed in 110us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.100990:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1343 00000100:00100000:3.0:1785774772.144216:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671139968 00000100:00100000:3.0:1785774772.144221:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671139968 00000100:00100000:3.0:1785774772.144265:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:3.0:1785774772.144272:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1872519671139968:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774772.144283:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774772.144298:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dacb lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dac4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.144321:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dacb lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dac4 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.144334:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dacb lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dac4 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.144355:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:3.0:1785774772.144358:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.144361:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774772.144401:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8469:x1872519671139968:12345-0@lo:101:mdt00_003.0 Request processed in 129us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.144407:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1785774772.146683:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671140096 00000100:00100000:0.0:1785774772.146689:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671140096 00000100:00100000:0.0:1785774772.146730:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1785774772.146738:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8469:x1872519671140096:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774772.146751:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774772.146765:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09dad9 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dad2 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.146783:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09dad9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dad2 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.146799:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09dad9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dad2 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.146807:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xff310312 (ffff9b7602508800) 00010000:00010000:0.0:1785774772.146810:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774772.146813:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744600, rc 0) 00000100:00100000:0.0:1785774772.146848:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8469:x1872519671140096:12345-0@lo:101:mdt00_003.0 Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.146855:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1785774772.147243:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671140224 00000100:00100000:0.0:1785774772.147247:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671140224 00000100:00100000:0.0:1785774772.147277:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:0.0:1785774772.147283:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8469:x1872519671140224:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774772.147337:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8469:x1872519671140224:12345-0@lo:1000:mdt00_003.0 Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.147344:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:0.0:1785774772.150947:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671140480 00000100:00100000:0.0:1785774772.150952:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671140480 00000100:00100000:0.0:1785774772.150982:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312 00000100:00100000:0.0:1785774772.150988:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8469:x1872519671140480:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774772.151009:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774772.151025:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09dae7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dae0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.151046:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09dae7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dae0 expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.151076:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d09dae7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dae0 expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.151084:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff9b7602508e00) 00010000:00010000:0.0:1785774772.151087:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774772.151090:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745600, rc 0) 00000100:00100000:0.0:1785774772.151117:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8469:x1872519671140480:12345-0@lo:101:mdt00_003.0 Request processed in 129us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.151123:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312 00000100:00100000:0.0:1785774772.162147:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774772.162583:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648422528 00000100:00100000:3.0:1785774772.162591:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648422528 00010000:00010000:3.0:1785774772.162624:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d09daaf lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba6f expref: 18 pid: 6531 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.162670:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1575 00000100:00100000:3.0:1785774772.162679:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648422528:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774772.162695:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774772.162702:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d09daaf lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba6f expref: 18 pid: 6531 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.162715:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d09daaf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba6f expref: 18 pid: 6531 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.162737:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d09daaf lrc: 0/0,0 mode: --/PR res: [0x200000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba6f expref: 18 pid: 6531 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.162751:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xce:0x0].0x0 (ffff9b7602508300) 00010000:00010000:3.0:1785774772.162757:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d09daf5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.162769:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d09daf5 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.162777:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d09daf5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.162845:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774772.162891:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648422528:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 212us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.162899:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1575 00000100:00100000:0.0:1785774772.163802:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671140736 00000100:00100000:0.0:1785774772.163807:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671140736 00000100:00100000:0.0:1785774772.163848:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313 00000100:00100000:0.0:1785774772.163855:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8469:x1872519671140736:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774772.163871:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774772.163885:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09db03 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dafc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.163907:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dabd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba76 expref: 6 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.163916:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09db03 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dafc expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.163937:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dabd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba76 expref: 6 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.163955:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dabd lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba76 expref: 6 pid: 8627 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774772.163966:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671140864:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774772.164018:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.214217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774772.223705:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648422656 00000100:00100000:3.0:1785774772.223720:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648422656 00010000:00010000:3.0:1785774772.223765:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dabd lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba76 expref: 7 pid: 8627 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.223802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1576 00000100:00100000:3.0:1785774772.223811:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648422656:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774772.223825:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774772.223832:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dabd lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba76 expref: 7 pid: 8627 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.223845:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dabd lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba76 expref: 7 pid: 8627 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.223867:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xce:0x0].0x0 (ffff9b7602508500) 00010000:00010000:3.0:1785774772.223875:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09db03 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dafc expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.223892:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09db03 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09dafc expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.223902:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09db03 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09dafc expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.223933:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09db03 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dafc expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.223946:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6514:1872519671140992:0@lo:105: 00000100:00100000:3.0:1785774772.224003:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.224047:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.229135:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671140736:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774772.229152:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0800/0x7b7109e1d09dafc lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09db03 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774772.229829:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671141120:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1785774772.229884:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.229914:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1b40 going to sleep for 11 seconds 00000004:00080000:0.0:1785774772.241098:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 713 rpc_version 713 00000020:00100000:0.0:1785774772.241144:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774772.241155:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b77012a8700 x1872519671141376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774772.241205:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671141376:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774772.241275:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.241306:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.242050:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671141376:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1785774772.243856:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774772.245454:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774772.349534:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648422784 00000100:00100000:3.0:1785774772.349545:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648422784 00000100:00100000:3.0:1785774772.349610:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23588 00000100:00100000:3.0:1785774772.349621:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17693:x1872519648422784:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774772.349645:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774772.349666:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db0a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba7d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349728:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349743:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349754:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349769:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349777:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349784:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349828:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349835:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349841:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349848:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349854:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.349858:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349865:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349877:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572b400) 00010000:00010000:3.0:1785774772.349880:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.349884:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349891:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db11 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349901:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349907:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349913:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349917:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.349920:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349926:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349932:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xbefb5018 (ffff9b7605fd8300) 00010000:00010000:3.0:1785774772.349935:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.349937:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349942:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db18 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349972:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db0a lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba7d expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.349987:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572b400) 00010000:00010000:3.0:1785774772.349989:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.349993:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db0a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba7d expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.350002:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774772.350063:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17693:x1872519648422784:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 445us (1569us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774772.350070:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23588 00000100:00100000:3.0:1785774772.360047:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648422912 00000100:00100000:3.0:1785774772.360057:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648422912 00000100:00100000:3.0:1785774772.360122:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23589 00000100:00100000:3.0:1785774772.360132:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:17693:x1872519648422912:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774772.360177:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774772.360201:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db1f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba84 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.360257:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09db26 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.360270:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09db26 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.360281:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09db26 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774772.360335:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1785774772.360340:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774772.360371:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db1f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba84 expref: 8 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.360389:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09db26 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba84 expref: 7 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.360397:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:3.0:1785774772.360400:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774772.360403:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1200, rc 0) 00000100:00100000:3.0:1785774772.360451:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17693:x1872519648422912:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 321us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.360469:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23589 00000100:00100000:3.0:1785774772.387453:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671141888:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774772.387523:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671142016:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774772.387558:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.387593:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.387609:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671142016 00000100:00100000:0.0:1785774772.387615:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671142016 00000100:00100000:0.0:1785774772.387643:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317 00000100:00100000:0.0:1785774772.387649:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8469:x1872519671142016:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774772.387726:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8469:x1872519671142016:12345-0@lo:1000:mdt00_003.0 Request processed in 77us (167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774772.387732:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317 00000100:00100000:3.0:1785774772.390545:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671142016:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785774772.390605:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.390614:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.390624:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.390636:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671142272:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774772.390668:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.390692:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774772.397284:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671142272:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774772.397303:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.397314:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.409880:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671142528 00000100:00100000:3.0:1785774772.409885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671142528 00000100:00100000:3.0:1785774772.409926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1785774772.409934:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671142528:12345-0@lo:105: 00010000:00010000:3.0:1785774772.409946:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.409957:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.409965:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.409973:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.409981:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.409994:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.410016:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec0400) 00000100:00100000:3.0:1785774772.410059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671142528:12345-0@lo:105: Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.410065:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00010000:00010000:0.0:1785774772.410210:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.410222:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774772.410245:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774772.410277:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09db3b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.410285:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09db3b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.410294:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09db3b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774772.410308:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671142656:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774772.410346:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.410361:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774772.410433:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671142656 00000100:00100000:3.0:1785774772.410438:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671142656 00000100:00100000:3.0:1785774772.410485:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:3.0:1785774772.410494:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:8469:x1872519671142656:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774772.410508:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774772.410525:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db42 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09db3b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.410544:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db42 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09db3b expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.410562:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db42 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09db3b expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.410574:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xbefb5018 (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774772.410578:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.410581:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774772.410615:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671142656:12345-0@lo:101:mdt00_003.0 Request processed in 122us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.410624:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00100000:3.0:1785774772.410651:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671142656:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774772.410665:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09db3b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09db42 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.410675:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09db3b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09db42 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774772.410689:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1785774772.410716:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671142784:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774772.410739:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.410762:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.410944:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671142784 00000100:00100000:0.0:1785774772.410948:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671142784 00000100:00100000:0.0:1785774772.410973:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321 00000100:00100000:0.0:1785774772.410980:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671142784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774772.411043:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671142784:12345-0@lo:1000:mdt00_003.0 Request processed in 64us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.411051:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321 00000100:00100000:0.0:1785774772.411298:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671142912 00000100:00100000:0.0:1785774772.411302:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671142912 00000100:00100000:0.0:1785774772.411329:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3322 00000100:00100000:0.0:1785774772.411335:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671142912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774772.411401:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671142912:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (202us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774772.411408:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3322 00000100:00100000:3.0:1785774772.411915:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671143040 00000100:00100000:3.0:1785774772.411920:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671143040 00000100:00100000:3.0:1785774772.411938:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323 00000100:00100000:3.0:1785774772.411943:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671143040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774772.412002:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671143040:12345-0@lo:1000:mdt00_003.0 Request processed in 58us (307us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774772.412007:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323 00000100:00100000:3.0:1785774772.420211:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671143168 00000100:00100000:3.0:1785774772.420219:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671143168 00000100:00100000:3.0:1785774772.420273:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324 00000100:00100000:3.0:1785774772.420283:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671143168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774772.420388:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671143168:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.420395:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324 00000100:00100000:3.0:1785774772.426908:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671143424 00000100:00100000:3.0:1785774772.426912:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671143424 00000100:00100000:3.0:1785774772.426960:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:3.0:1785774772.426967:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671143424:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774772.427027:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:8469:x1872519671143424:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.427034:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000004:00080000:0.0:1785774772.438762:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 740 rpc_version 740 00000020:00100000:0.0:1785774772.438820:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774772.438830:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb4b100 x1872519671143680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774772.438856:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671143680:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774772.438929:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.438975:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.449840:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671143680:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1785774772.454498:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774772.454506:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.454516:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774772.454522:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774772.454531:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.454569:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.454576:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774772.454599:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.454606:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09db2d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09db34 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.454623:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774772.454625:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774772.454626:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774772.454633:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774772.454644:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671143936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774772.454688:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.455206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671143936 00000100:00100000:3.0:1785774772.455212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671143936 00000100:00100000:3.0:1785774772.455252:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1785774772.455260:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671143936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774772.455274:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774772.455292:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09db34 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09db2d expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.455303:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b760572b400) 00010000:00010000:3.0:1785774772.455310:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774772.455340:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3654:x1872519671143936:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.455346:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1785774772.455391:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671143936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774772.526848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774772.566914:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648423680 00000100:00100000:3.0:1785774772.566928:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648423680 00000100:00100000:3.0:1785774772.566987:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23592 00000100:00100000:3.0:1785774772.566997:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17695:x1872519648423680:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774772.567017:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774772.567041:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db65 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba8b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.567111:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.567125:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.567136:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.567148:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.567157:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db42 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09db3b expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.567182:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.567217:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09db42 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09db3b expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.567233:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6531:1872519671144064:0@lo:104: 00000100:00100000:3.0:1785774772.576544:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.577103:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774772.611896:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671144320:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1785774772.611961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1785774772.612015:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 386 committed batchid 385 00000020:00080000:3.0:1785774772.612071:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 385 00010000:00010000:3.0:1785774772.612522:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.612531:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.612632:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6531:1872519671144448:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785774772.612662:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.612677:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.612751:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671144448 00000100:00100000:0.0:1785774772.612756:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671144448 00000100:00100000:0.0:1785774772.612795:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:0.0:1785774772.612813:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6531:x1872519671144448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785774772.612895:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6531:x1872519671144448:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.612902:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:3.0:1785774772.613136:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6531:1872519671144448:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1785774772.613203:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db7a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x187:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613215:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db7a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613224:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db7a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774772.613245:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db7a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613258:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613264:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613269:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613276:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613282:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.613285:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613293:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613301:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:3.0:1785774772.613303:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.613307:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613314:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09db6c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613323:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613329:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613335:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613340:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.613343:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613349:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613362:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xbefb5018 (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774772.613365:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.613368:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613375:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09db73 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613407:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09db65 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba8b expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613439:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db7a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba8b expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.613448:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774772.613450:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774772.613460:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774772.613503:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17695:x1872519648423680:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 46508us (50409us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.613511:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23592 00000100:00100000:3.0:1785774772.616701:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671144320:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1785774772.628232:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648423808 00000100:00100000:3.0:1785774772.628247:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648423808 00000100:00100000:3.0:1785774772.628316:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23593 00000100:00100000:3.0:1785774772.628327:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:17695:x1872519648423808:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774772.628353:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774772.628375:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09db81 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x187:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ba92 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.628462:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09db88 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.628476:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09db88 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x187:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.628488:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09db88 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x187:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774772.628766:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x187:0x0]: returning size 4096 00000004:00200000:3.0:1785774772.628781:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774772.628816:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09db81 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba92 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.628834:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09db88 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x187:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba92 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.628843:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774772.628846:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774772.628849:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774772.628912:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17695:x1872519648423808:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 587us (8873us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.628920:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23593 00000100:00100000:3.0:1785774772.634752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774772.643359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774772.643536:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648424064 00000100:00100000:0.0:1785774772.643545:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648424064 00000100:00100000:0.0:1785774772.643609:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23595 00000100:00100000:0.0:1785774772.643621:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17695:x1872519648424064:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:0.0:1785774772.643641:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774772.643675:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09db9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259baa0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.643734:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744400/0x7b7109e1d09dba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.643749:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09db5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09db57 expref: 5 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.643756:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744400/0x7b7109e1d09dba4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.643789:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09db5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09db57 expref: 5 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774772.643819:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f710e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6531:1872519671144576:0@lo:104: 00000100:00100000:0.0:1785774772.643872:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.643911:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774772.651464:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f710e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6531:1872519671144576:0@lo:104: 00010000:00010000:3.0:1785774772.651492:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744400/0x7b7109e1d09dba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1785774772.656806:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 386 batchid updated 00000100:00100000:3.0:1785774772.700122:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648424448 00000100:00100000:3.0:1785774772.700132:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648424448 00000100:00100000:3.0:1785774772.700203:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23596 00000100:00100000:3.0:1785774772.700213:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17695:x1872519648424448:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774772.700271:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774772.700297:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09db88 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x187:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba92 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.700444:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774772.700451:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774772.700677:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.700687:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.700697:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.700717:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671145088:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774772.700763:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.700833:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774772.700849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648424192 00000100:00100000:3.0:1785774772.700853:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648424192 00000100:00100000:3.0:1785774772.700879:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1349 00000100:00100000:3.0:1785774772.700885:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2419:x1872519648424192:12345-192.168.202.31@tcp:103:rmdir.0 00010000:00010000:3.0:1785774772.700895:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774772.700907:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09db7a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba8b expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.700918:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774772.700926:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774772.700962:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2419:x1872519648424192:12345-192.168.202.31@tcp:103:rmdir.0 Request processed in 77us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.700969:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1349 00000100:00100000:3.0:1785774772.768279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774772.778941:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671145728:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774772.778971:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774772.794000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774772.794561:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744400/0x7b7109e1d09dba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259baa0 expref: 14 pid: 6531 timeout: 1114 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.794581:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671145984:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774772.794608:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09dbea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dbe3 expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.794619:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcc:0x0].0x0 (ffff9b7605fcc200) 00010000:00010000:3.0:1785774772.794622:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774772.794625:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35aa00, rc 0) 00000100:00100000:3.0:1785774772.794671:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8469:x1872519671145856:12345-0@lo:101:mdt00_003.0 Request processed in 15099us (15170us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.794678:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:3.0:1785774772.794791:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671145856:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774772.794807:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.797089:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671146240:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1785774772.797145:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774772.797181:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774772.798504:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671146240 00000100:00100000:0.0:1785774772.798512:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671146240 00000100:00100000:0.0:1785774772.798547:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1785774772.798555:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8469:x1872519671146240:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1785774772.800149:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8469:x1872519671146240:12345-0@lo:403:mdt00_003.0 Request processed in 1592us (3003us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.800174:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3337 00000100:00100000:3.0:1785774772.800986:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671146240:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1785774772.801807:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].389, 664 off592656 00000040:00080000:3.0:1785774772.801961:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].388, 744 off638152 00000004:00080000:3.0:1785774772.801968:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8000 with version 741 00000004:00080000:0.0:1785774772.807806:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 741 rpc_version 741 00000020:00100000:0.0:1785774772.807861:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774772.807872:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b774183c000 x1872519671146496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774772.807897:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671146496:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774772.807960:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.807985:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774772.811667:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671146496 00000100:00100000:3.0:1785774772.811680:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671146496 00000100:00100000:3.0:1785774772.811733:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338 00000100:00100000:3.0:1785774772.811741:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7474:x1872519671146496:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774772.812136:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7474:x1872519671146496:12345-0@lo:1000:osp_up0-1.0 Request processed in 396us (4174us total) trans 4294983463 rc 0/0 00000100:00100000:3.0:1785774772.812144:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338 00000100:00100000:3.0:1785774772.812224:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671146496:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1785774772.812251:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x187:0x0]: returning size 4096 00010000:00010000:3.0:1785774772.812271:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812281:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812290:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812296:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.812301:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812310:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812323:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcc:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:3.0:1785774772.812326:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774772.812330:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 2/0,0 mode: --/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812336:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09dbdc lrc: 0/0,0 mode: --/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812348:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812357:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812364:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812379:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774772.812386:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xcc:0x0] 00010000:00010000:3.0:1785774772.812392:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b400/0x7b7109e1d09dbd5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812399:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b400/0x7b7109e1d09dbd5 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812404:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b400/0x7b7109e1d09dbd5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812410:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.812414:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b400/0x7b7109e1d09dbd5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812419:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b400/0x7b7109e1d09dbd5 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812427:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774772.812429:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.812432:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b400/0x7b7109e1d09dbd5 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812438:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b400/0x7b7109e1d09dbd5 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.812446:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.813265:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774772.813274:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.813283:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774772.813288:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774772.813296:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.813326:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.813333:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774772.813365:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.813378:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b800/0x7b7109e1d09dbe3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbea expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.813393:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774772.813395:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774772.813397:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774772.814338:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671146624 00000100:00100000:0.0:1785774772.814344:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671146624 00000100:00100000:0.0:1785774772.814380:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1785774772.814387:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3653:x1872519671146624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774772.814399:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774772.814416:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09dbea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09dbe3 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.814428:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcc:0x0].0x0 (ffff9b7605fcc200) 00010000:00010000:0.0:1785774772.814435:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774772.814481:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3653:x1872519671146624:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.814488:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00010000:00010000:3.0:1785774772.815952:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.815962:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.815987:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774772.816003:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774772.816009:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.816022:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.816029:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.816048:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1785774772.816052:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774772.816058:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09dbb9 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dbc0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.816065:0:8469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09dbb9 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dbc0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.816132:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17695:x1872519648424448:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 115919us (116903us total) trans 4294968408 rc 0/0 00000100:00100000:3.0:1785774772.816140:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23596 00010000:00010000:0.0:1785774772.816302:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774772.816308:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816316:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774772.816321:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774772.816334:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816357:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816364:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774772.816384:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816391:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dbc7 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbce expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816405:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774772.816409:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816415:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774772.816419:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774772.816426:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816440:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816446:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774772.816471:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816478:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0200/0x7b7109e1d09dbab lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dbb2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816489:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774772.816490:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774772.816492:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774772.816498:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774772.816506:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671146880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774772.816538:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.816564:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671146880 00000100:00100000:0.0:1785774772.816569:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671146880 00000100:00100000:0.0:1785774772.816596:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1785774772.816602:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3656:x1872519671146880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774772.816611:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774772.816624:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dbb2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09dbab expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816636:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7731f88d00) 00010000:00010000:0.0:1785774772.816643:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774772.816665:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3656:x1872519671146880:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.816672:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1785774772.816693:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671146880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774772.816829:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774772.816837:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671146752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774772.816860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774772.816911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671146752 00000100:00100000:0.0:1785774772.816915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671146752 00000100:00100000:0.0:1785774772.816946:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1785774772.816951:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3653:x1872519671146752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774772.816959:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774772.816969:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a200/0x7b7109e1d09dbce lrc: 0/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09dbc7 expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774772.816980:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:0.0:1785774772.816985:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774772.817015:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671146752:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774772.817021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1785774772.817091:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671146752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774772.890207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774772.891415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774772.891447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774772.893640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774772.911638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774772.929330:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774772.929437:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648425472 00000100:00100000:3.0:1785774772.929447:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648425472 00000100:00100000:3.0:1785774772.929515:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23599 00000100:00100000:3.0:1785774772.929525:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17696:x1872519648425472:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774772.929554:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774772.929578:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc1b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bab5 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.929631:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc22 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.929644:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc22 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.929656:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc22 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774772.929700:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1785774772.929705:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774772.929736:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc1b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bab5 expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.929752:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc22 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bab5 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.929761:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774772.929764:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774772.929767:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1c00, rc 0) 00000100:00100000:3.0:1785774772.929826:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17696:x1872519648425472:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 303us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774772.929833:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23599 00000100:00100000:3.0:1785774772.974422:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648425728 00000100:00100000:3.0:1785774772.974431:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648425728 00000100:00100000:3.0:1785774772.975031:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23600 00000100:00100000:3.0:1785774772.975043:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17696:x1872519648425728:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1785774772.975096:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774772.975130:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc22 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bab5 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975145:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774772.975156:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774772.975234:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975247:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975257:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975268:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975275:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975282:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:02000000:3.0:1785774772.975518:0:6529:0:(osd_handler.c:2218:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:3.0:1785774772.975724:0:6529:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605fc8c00 with version 0 00000020:00080000:3.0:1785774772.975731:0:6529:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605fc8cc0 refcount 3 committed 0 result -5 batchid 388 00000020:00080000:3.0:1785774772.975735:0:6529:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544f300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -5 sub_th ffff9b7605fc8c00 00000020:00080000:3.0:1785774772.975738:0:6529:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544f400 obd lustre-MDT0000-osd committed 1 started 0 stopped 1 result 0 sub_th ffff9b7603e3b000 00010000:00010000:3.0:1785774772.975761:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975769:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975776:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975783:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975788:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.975793:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975800:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975809:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774772.975812:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.975815:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975821:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc29 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975833:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975839:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975846:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975852:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774772.975855:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975860:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975866:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x99bb250f (ffff9b7605fd8500) 00010000:00010000:3.0:1785774772.975868:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774772.975871:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774772.975877:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc30 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774772.975942:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17696:x1872519648425728:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 901us (1665us total) trans 0 rc -5/-5 00000100:00100000:3.0:1785774772.975950:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23600 00000100:00100000:0.0:1785774773.030404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.030482:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648425984 00000100:00100000:3.0:1785774773.030491:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648425984 00000100:00100000:3.0:1785774773.030556:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23601 00000100:00100000:3.0:1785774773.030565:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17702:x1872519648425984:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:3.0:1785774773.030672:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.030690:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.030703:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.030716:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc3e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.030723:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc3e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.030729:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc3e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031129:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031138:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031145:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774773.031181:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091d99949 reply state 00000000fae111a0 transno 4294983464 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031193:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dc45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031200:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774773.031204:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774773.031207:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785774773.031211:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152e:0x0]: returning size 4096 00010000:00010000:3.0:1785774773.031220:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031227:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031233:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031241:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031247:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.031251:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031259:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031268:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774773.031270:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.031273:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031280:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc37 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774773.031293:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091d99949 reply state 00000000fae111a0 transno 4294983464 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc3e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031302:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dc3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.031312:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x99bb250f (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774773.031314:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774773.031316:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1785774773.031381:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17702:x1872519648425984:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 816us (985us total) trans 4294983464 rc 0/0 00000100:00100000:3.0:1785774773.031388:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23601 00000100:00080000:0.0:1785774773.031672:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774773.090259:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.103906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.103936:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648426368 00000100:00100000:3.0:1785774773.103945:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648426368 00000100:00100000:3.0:1785774773.103990:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23603 00000100:00100000:3.0:1785774773.103999:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17703:x1872519648426368:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774773.104047:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774773.104072:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1800/0x7b7109e1d09dc61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259babc expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104089:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774773.104094:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774773.104128:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104141:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104150:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104177:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc6f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104200:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc6f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104206:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc6f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104278:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104287:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104294:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774773.104656:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152e:0x0]: returning size 4096 00010000:00010000:3.0:1785774773.104672:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104680:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104687:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104692:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.104697:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104704:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104717:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774773.104720:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774773.104723:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104729:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc76 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104743:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104749:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104755:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104761:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104766:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.104769:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104775:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104781:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774773.104783:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.104785:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104795:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc68 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774773.104806:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000412245a2 reply state 00000000428218c6 transno 4294983465 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc6f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104815:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dc6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.104821:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x99bb250f (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774773.104823:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774773.104826:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774773.104884:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17703:x1872519648426368:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 885us (984us total) trans 4294983465 rc 0/0 00000100:00100000:3.0:1785774773.104892:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23603 00000100:00100000:0.0:1785774773.159506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.160129:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648426496 00000100:00100000:3.0:1785774773.160138:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648426496 00000100:00100000:3.0:1785774773.160218:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23604 00000100:00100000:3.0:1785774773.160228:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17708:x1872519648426496:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774773.160250:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.160274:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09dc7d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bac3 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160575:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160589:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160607:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160656:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160663:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160670:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160724:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160732:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160738:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160745:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160752:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.160756:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160764:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160775:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774773.160779:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.160783:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160789:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dc84 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160801:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160807:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160813:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160818:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.160821:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160826:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160832:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9b7605fd8100) 00010000:00010000:3.0:1785774773.160834:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.160836:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160843:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dc8b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160869:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09dc7d lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bac3 expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160884:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774773.160887:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.160890:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09dc7d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bac3 expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.160900:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0a00, rc 0) 00000100:00100000:3.0:1785774773.160952:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17708:x1872519648426496:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 727us (1455us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774773.160959:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23604 00000100:00100000:3.0:1785774773.212269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774773.227148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00080000:0.0:1785774773.229493:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774773.247426:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671147392:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774773.247470:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09dcbc lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dcb5 expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.247491:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7731f88700) 00010000:00010000:0.0:1785774773.247494:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774773.247499:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09dcbc lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dcb5 expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.247510:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:0.0:1785774773.247567:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:8627:x1872519671147264:12345-0@lo:101:mdt00_004.0 Request processed in 19509us (19555us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.247575:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:0.0:1785774773.247844:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648427136 00000100:00100000:0.0:1785774773.247851:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648427136 00010000:00010000:0.0:1785774773.247878:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09dcae lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bad1 expref: 18 pid: 6530 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.247909:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1582 00000100:00100000:0.0:1785774773.247918:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648427136:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.247931:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.247938:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09dcae lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bad1 expref: 18 pid: 6530 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.247949:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09dcae lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bad1 expref: 18 pid: 6530 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.247968:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09dcae lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bad1 expref: 18 pid: 6530 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.247979:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7731f88700) 00010000:00010000:0.0:1785774773.247984:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09dcbc lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dcb5 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.247999:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09dcbc lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dcb5 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.248008:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09dcbc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dcb5 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.248034:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09dcbc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dcb5 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.248047:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671147520:0@lo:105: 00000100:00100000:0.0:1785774773.248076:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.248252:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1d80 going to sleep for 11 seconds 00010000:00010000:0.0:1785774773.248536:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09dcb5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dcbc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.248545:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09dcb5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dcbc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774773.248564:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774773.248594:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.248600:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.248609:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.248622:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671147648:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1785774773.248645:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.248660:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.251292:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671147520:0@lo:105: 00010000:00010000:3.0:1785774773.251310:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774773.251367:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648427136:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 3448us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.251376:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1582 00000100:00100000:0.0:1785774773.260399:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671148288 00000100:00100000:0.0:1785774773.260409:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671148288 00000100:00100000:0.0:1785774773.260466:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347 00000100:00100000:0.0:1785774773.260483:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8627:x1872519671148288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.260596:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8627:x1872519671148288:12345-0@lo:1000:mdt00_004.0 Request processed in 122us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.260604:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347 00000100:00100000:3.0:1785774773.260709:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671148288:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.260768:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671148416:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.260799:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.260824:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.260859:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671148416 00000100:00100000:0.0:1785774773.260863:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671148416 00000100:00100000:0.0:1785774773.260884:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:0.0:1785774773.260889:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8627:x1872519671148416:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.260992:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8627:x1872519671148416:12345-0@lo:1000:mdt00_004.0 Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.260999:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00000100:00100000:3.0:1785774773.264215:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671148416:0@lo:1000:mdt00_004.0 00000040:00080000:3.0:1785774773.265011:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].390, 2168 off594824 00000040:00080000:3.0:1785774773.265081:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].389, 2368 off640520 00000004:00080000:3.0:1785774773.265087:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc8540 with version 742 00010000:00010000:3.0:1785774773.268095:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09dcd1 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268119:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09dcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268133:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09dcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268151:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dcd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268183:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dcd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268192:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09dcd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268215:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09dcdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268222:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09dcdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.268232:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09dcdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.268244:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671148800:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774773.268270:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.268290:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.277392:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671148928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774773.284363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774773.284510:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648427392 00000100:00100000:0.0:1785774773.284520:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648427392 00000100:00100000:0.0:1785774773.284568:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23608 00000100:00100000:0.0:1785774773.284577:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17709:x1872519648427392:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:0.0:1785774773.284715:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17709:x1872519648427392:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 139us (361us total) trans 0 rc -17/-17 00000100:00100000:0.0:1785774773.284722:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23608 00000100:00100000:3.0:1785774773.298667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774773.298801:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648427520 00000100:00100000:0.0:1785774773.298811:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648427520 00000100:00100000:0.0:1785774773.298869:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23609 00000100:00100000:0.0:1785774773.298880:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17710:x1872519648427520:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:0.0:1785774773.298900:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774773.298925:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09dced lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bad8 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.298984:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.298997:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.299008:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.299020:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.299030:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09dcca lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dcc3 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.299039:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.299080:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09dcca lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09dcc3 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.299095:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671149056:0@lo:104: 00000100:00100000:0.0:1785774773.299147:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.299195:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.299255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671149056 00000100:00100000:3.0:1785774773.299259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671149056 00000100:00100000:3.0:1785774773.299298:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1785774773.299307:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671149056:12345-0@lo:104: 00010000:00010000:3.0:1785774773.299326:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dcca expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.299384:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774773.299391:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671149056:12345-0@lo:104: Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.299400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00010000:00010000:3.0:1785774773.299424:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774773.299430:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dcca expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.299439:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774773.299445:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09dcca expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774773.299464:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09dcca expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.299490:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dcca expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.299496:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774773.299514:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dcca expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.299527:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745e00/0x7b7109e1d09dcc3 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dcca expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.299556:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774773.299559:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774773.299561:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774773.299571:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671149184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774773.299603:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.299920:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671149056:0@lo:104: 00010000:00010000:0.0:1785774773.299939:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774773.307294:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983466 is committed 00000001:00080000:3.0:1785774773.307325:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983465 is committed 00010000:00010000:3.0:1785774773.308202:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09dcca lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09dcc3 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.308218:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9b7731f88300) 00010000:00010000:3.0:1785774773.308224:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.308235:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.308243:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.308267:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774773.308484:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671149184:12345-0@lo:103:ldlm_bl.0 Request processed in 8056us (8878us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.308497:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00010000:00010000:0.0:1785774773.309618:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.309628:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.309733:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671149312:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774773.309772:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.309795:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.310887:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671149312:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785774773.310937:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09dd02 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.310949:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09dd02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.310959:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09dd02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774773.310980:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09dd02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.310992:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311007:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311015:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311021:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311027:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.311031:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311039:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311049:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7602508900) 00010000:00010000:3.0:1785774773.311052:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.311056:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311063:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09dcf4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311074:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311080:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311086:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311092:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.311094:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311203:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311213:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9b7731f88300) 00010000:00010000:3.0:1785774773.311215:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.311218:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311224:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09dcfb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311258:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09dced lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bad8 expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311279:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09dd02 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bad8 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.311287:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff9b7709388700) 00010000:00010000:3.0:1785774773.311290:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774773.311292:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774773.311440:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17710:x1872519648427520:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 12561us (12780us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.311458:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23609 00000100:00100000:3.0:1785774773.317818:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648427648 00000100:00100000:3.0:1785774773.317836:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648427648 00000100:00100000:3.0:1785774773.317895:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23610 00000100:00100000:3.0:1785774773.317905:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:17710:x1872519648427648:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774773.317928:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.317948:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dd09 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259badf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.318000:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd10 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.318014:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd10 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.318025:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd10 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774773.318698:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x188:0x0]: returning size 4096 00000004:00200000:3.0:1785774773.318704:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774773.318741:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dd09 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259badf expref: 14 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.318757:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd10 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259badf expref: 13 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.318766:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774773.318769:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774773.318772:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774773.318882:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17710:x1872519648427648:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 977us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.318890:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23610 00000100:00100000:3.0:1785774773.330396:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648427904 00000100:00100000:3.0:1785774773.330404:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648427904 00000100:00100000:3.0:1785774773.330467:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23612 00000100:00100000:3.0:1785774773.330531:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17710:x1872519648427904:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774773.330552:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.330571:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dd25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259baed expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.330621:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.330634:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dce6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dcdf expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.330643:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.330676:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dce6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09dcdf expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.330691:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671149440:0@lo:104: 00000100:00100000:3.0:1785774773.330733:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.330771:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.331203:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671149440:0@lo:104: 00010000:00010000:0.0:1785774773.331221:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.331459:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671149568 00000100:00100000:3.0:1785774773.331463:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671149568 00010000:00010000:3.0:1785774773.331688:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dce6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09dcdf expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.331716:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1785774773.331723:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671149568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774773.331732:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774773.332559:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dce6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09dcdf expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.332572:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcd:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:3.0:1785774773.332577:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.332586:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.332593:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.332618:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774773.332654:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1872519671149568:12345-0@lo:103:ldlm_bl.0 Request processed in 932us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.332661:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00010000:00010000:0.0:1785774773.332707:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.332715:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774773.332760:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xcd:0x0]: returning size 4096 00000004:00200000:0.0:1785774773.332765:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1785774773.332801:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dd25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.332825:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.332833:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcd:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774773.332836:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774773.332839:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:0.0:1785774773.332883:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17710:x1872519648427904:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 2407us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.332889:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23612 00000100:00100000:3.0:1785774773.346291:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648428288 00000100:00100000:3.0:1785774773.346300:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648428288 00000100:00100000:3.0:1785774773.346361:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23613 00000100:00100000:3.0:1785774773.346370:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17710:x1872519648428288:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774773.346431:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774773.346466:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd10 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259badf expref: 14 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.346484:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774773.346488:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774773.346544:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.346553:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.346563:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.346585:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671149696:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774773.346634:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.346673:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.347196:0:8627:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983466 gen 2 00000004:00080000:3.0:1785774773.347202:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983463 committed transno 4294983466 00000004:00080000:3.0:1785774773.347220:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983466 committed transno 4294983466 00000100:00100000:3.0:1785774773.347235:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671149696:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774773.347250:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.347260:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774773.347273:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774773.347292:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09dd41 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.347300:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09dd41 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.347316:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09dd41 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.347328:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671149824:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774773.347349:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.347361:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.348016:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671149824 00000100:00100000:0.0:1785774773.348022:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671149824 00000100:00100000:0.0:1785774773.348063:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353 00000100:00100000:0.0:1785774773.348071:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8627:x1872519671149824:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774773.348082:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774773.348095:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09dd48 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dd41 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.348111:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09dd48 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dd41 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.348121:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09dd48 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dd41 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.348129:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9b7602508b00) 00010000:00010000:0.0:1785774773.348131:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774773.348134:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:0.0:1785774773.348188:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8627:x1872519671149824:12345-0@lo:101:mdt00_004.0 Request processed in 117us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.348194:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353 00000100:00100000:0.0:1785774773.348222:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671149824:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774773.348232:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09dd41 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dd48 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.348241:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09dd41 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dd48 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774773.348254:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1785774773.348286:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671149952:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.348325:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.348340:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.348352:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671149952 00000100:00100000:0.0:1785774773.348355:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671149952 00000100:00100000:3.0:1785774773.348522:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354 00000100:00100000:3.0:1785774773.348588:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8627:x1872519671149952:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.348702:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8627:x1872519671149952:12345-0@lo:1000:mdt00_004.0 Request processed in 173us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.348709:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354 00000100:00100000:3.0:1785774773.349197:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671150080 00000100:00100000:3.0:1785774773.349202:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671150080 00000100:00100000:3.0:1785774773.349219:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355 00000100:00100000:3.0:1785774773.349224:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8627:x1872519671150080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.349303:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8627:x1872519671150080:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (389us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774773.349543:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355 00000100:00100000:3.0:1785774773.354775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.356347:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671150464 00000100:00100000:3.0:1785774773.356353:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671150464 00000100:00100000:3.0:1785774773.356377:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357 00000100:00100000:3.0:1785774773.356384:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8627:x1872519671150464:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774773.356398:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.356410:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dd72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dd6b expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.356432:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.356442:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dd72 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dd6b expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.356483:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.356495:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 13 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.356506:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671150592:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774773.356547:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.365252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774773.365404:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648428544 00000100:00100000:0.0:1785774773.365414:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648428544 00010000:00010000:0.0:1785774773.365461:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 14 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.365508:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1586 00000100:00100000:0.0:1785774773.365520:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648428544:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.365544:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.365551:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 14 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.365573:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 14 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.365594:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09dd2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259baed expref: 14 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.365614:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcd:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774773.365620:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dd72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dd6b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.365630:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dd72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dd6b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.365639:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dd72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dd6b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.365678:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09dd72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dd6b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.365691:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671150720:0@lo:105: 00000100:00100000:0.0:1785774773.365722:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.365757:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.365799:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671150464:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774773.365817:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.365828:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.366478:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671150720:0@lo:105: 00010000:00010000:0.0:1785774773.366489:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.366528:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648428544:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1010us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.366535:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1586 00000100:00100000:0.0:1785774773.367883:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671150848 00000100:00100000:0.0:1785774773.367889:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671150848 00000100:00100000:0.0:1785774773.367923:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:0.0:1785774773.367931:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:8627:x1872519671150848:12345-0@lo:403:mdt00_004.0 00000100:00100000:0.0:1785774773.371027:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:8627:x1872519671150848:12345-0@lo:403:mdt00_004.0 Request processed in 3090us (3940us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.371039:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000040:00080000:3.0:1785774773.372619:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].391, 664 off595488 00000040:00080000:3.0:1785774773.372778:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].390, 744 off641264 00000004:00080000:3.0:1785774773.372783:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605fc89c0 with version 743 00000100:00100000:3.0:1785774773.373437:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671151104 00000100:00100000:3.0:1785774773.373444:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671151104 00000100:00100000:3.0:1785774773.373507:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:3.0:1785774773.373524:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7474:x1872519671151104:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774773.373880:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7474:x1872519671151104:12345-0@lo:1000:osp_up0-1.0 Request processed in 365us (811us total) trans 4294983467 rc 0/0 00000100:00100000:3.0:1785774773.373902:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00000004:00200000:3.0:1785774773.375679:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x188:0x0]: returning size 4096 00010000:00010000:3.0:1785774773.375700:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dd64 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375709:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dd64 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375717:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dd64 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375723:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35bc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.375728:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dd64 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375741:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dd64 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375755:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcd:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:3.0:1785774773.375758:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774773.375763:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dd64 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375769:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35bc00/0x7b7109e1d09dd64 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375782:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375791:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375798:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375821:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774773.375879:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xcd:0x0] 00010000:00010000:3.0:1785774773.375887:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a200/0x7b7109e1d09dd5d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375894:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a200/0x7b7109e1d09dd5d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375900:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a200/0x7b7109e1d09dd5d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375909:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.375912:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a200/0x7b7109e1d09dd5d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375919:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a200/0x7b7109e1d09dd5d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375927:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774773.375930:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.375933:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a200/0x7b7109e1d09dd5d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375939:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a200/0x7b7109e1d09dd5d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375949:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375955:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.375963:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.376032:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1785774773.376042:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774773.376046:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.376060:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.376067:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376474:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785774773.376482:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376490:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774773.376495:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774773.376503:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376539:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376545:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774773.376563:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 1/0,0 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376570:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dd6b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376585:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774773.376588:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376594:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774773.376598:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774773.376605:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376619:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376625:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774773.376630:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 1/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376637:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b400/0x7b7109e1d09dd4f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd56 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376647:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774773.376650:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376656:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774773.376660:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774773.376667:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376678:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376684:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774773.376699:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376706:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774773.376708:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774773.376710:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774773.376717:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774773.376729:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671151488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774773.376766:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.376798:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671151488 00000100:00100000:0.0:1785774773.376804:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671151488 00000100:00100000:0.0:1785774773.376849:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1785774773.376857:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3654:x1872519671151488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.376869:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.376884:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09dd3a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09dd33 expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.376895:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7702c6ad00) 00010000:00010000:0.0:1785774773.376902:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.376927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3654:x1872519671151488:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.376933:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1785774773.376956:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671151488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774773.377839:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785774773.377845:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dd33 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09dd3a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774773.377861:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774773.377866:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09dd41 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dd48 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.377874:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09dd41 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dd48 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.377966:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17710:x1872519648428288:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 31596us (31783us total) trans 4294968410 rc 0/0 00000100:00100000:3.0:1785774773.377974:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23613 00010000:00010000:0.0:1785774773.380032:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774773.414661:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671151744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774773.414727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.414782:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671151744 00000100:00100000:0.0:1785774773.414789:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671151744 00000100:00100000:0.0:1785774773.414845:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1785774773.414854:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671151744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774773.414882:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1785774773.414923:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671151744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.414930:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00080000:0.0:1785774773.414950:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774773.414987:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671151744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774773.418404:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671151616 00000100:00100000:0.0:1785774773.418413:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671151616 00000100:00100000:0.0:1785774773.418482:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1785774773.418491:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671151616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774773.418508:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1785774773.418571:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671151616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (3327us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.418579:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1785774773.418635:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671151616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774773.420476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.420567:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648428672 00000100:00100000:3.0:1785774773.420574:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648428672 00000100:00100000:3.0:1785774773.420617:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23614 00000100:00100000:3.0:1785774773.420625:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17711:x1872519648428672:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774773.420642:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.420662:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd79 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259baf4 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420722:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420736:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420748:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420760:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420767:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420774:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420814:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420822:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420829:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420836:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420843:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.420848:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420856:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420868:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:3.0:1785774773.420871:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.420874:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420881:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09dd80 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420891:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420897:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420903:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420908:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.420911:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420917:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420923:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6bb7d880 (ffff9b7709388a00) 00010000:00010000:3.0:1785774773.420925:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.420928:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420934:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dd87 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420961:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd79 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259baf4 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420971:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:3.0:1785774773.420974:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.420977:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dd79 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259baf4 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.420987:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774773.421037:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17711:x1872519648428672:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 412us (564us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774773.421044:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23614 00000100:00100000:3.0:1785774773.460642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.495714:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648429056 00000100:00100000:3.0:1785774773.495723:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648429056 00000100:00100000:3.0:1785774773.495777:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23616 00000100:00100000:3.0:1785774773.495786:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17711:x1872519648429056:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:3.0:1785774773.495890:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671151872:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.495939:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.495981:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fc8540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.496051:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671151872 00000100:00100000:0.0:1785774773.496055:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671151872 00000100:00100000:0.0:1785774773.496086:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:0.0:1785774773.496093:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8627:x1872519671151872:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.496182:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8627:x1872519671151872:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.496190:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:0.0:1785774773.496845:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671152000 00000100:00100000:0.0:1785774773.496851:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671152000 00000100:00100000:0.0:1785774773.496883:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:0.0:1785774773.496889:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8627:x1872519671152000:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.496961:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8627:x1872519671152000:12345-0@lo:1000:mdt00_004.0 Request processed in 72us (450us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774773.496968:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:3.0:1785774773.497033:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671152000:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1785774773.497080:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.497091:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.497100:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.497110:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671152128:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774773.497132:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.497154:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7701359600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.497223:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671152128 00000100:00100000:0.0:1785774773.497227:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671152128 00000100:00100000:0.0:1785774773.497260:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362 00000100:00100000:0.0:1785774773.497265:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8627:x1872519671152128:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774773.497274:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774773.497289:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09dda3 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dd9c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.497311:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09db26 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba84 expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.497321:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09dda3 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dd9c expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.497343:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09db26 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba84 expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.497356:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1200/0x7b7109e1d09db26 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ba84 expref: 12 pid: 8627 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.497368:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671152256:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774773.497423:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.506321:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671152256:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774773.506354:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09dda3 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dd9c expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.506368:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:0.0:1785774773.506371:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774773.506375:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09dda3 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dd9c expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.506385:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744000, rc 0) 00000100:00100000:0.0:1785774773.506438:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8627:x1872519671152128:12345-0@lo:101:mdt00_004.0 Request processed in 9172us (9304us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.506457:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362 00000100:00100000:0.0:1785774773.507113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671152384 00000100:00100000:0.0:1785774773.507117:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671152384 00000100:00100000:0.0:1785774773.507150:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1785774773.507186:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671152384:12345-0@lo:105: 00010000:00010000:0.0:1785774773.507197:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dda3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.507205:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dda3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.507213:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dda3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.507219:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09dda3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.507226:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09dda3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.507334:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09dd9c lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09dda3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.507357:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec1e00) 00000100:00100000:0.0:1785774773.507385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671152384:12345-0@lo:105: Request processed in 229us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.507391:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1785774773.508741:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671152512 00000100:00100000:3.0:1785774773.508747:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671152512 00000100:00100000:3.0:1785774773.508784:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363 00000100:00100000:3.0:1785774773.508791:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8627:x1872519671152512:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774773.508805:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.508819:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ddb1 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ddaa expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.508836:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ddb1 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ddaa expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.508847:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ddb1 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ddaa expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.508854:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6bb7d880 (ffff9b7709388f00) 00010000:00010000:3.0:1785774773.508857:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.508860:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774773.508896:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671152512:12345-0@lo:101:mdt00_004.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.508906:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363 00000100:00100000:0.0:1785774773.509142:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671152512:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774773.509155:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.509181:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774773.509194:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1785774773.509224:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671152640:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.509926:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.509948:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.510567:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671152640 00000100:00100000:3.0:1785774773.510573:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671152640 00000100:00100000:3.0:1785774773.510604:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1785774773.510612:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671152640:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.510681:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671152640:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.510688:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1785774773.511574:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671152768 00000100:00100000:3.0:1785774773.511578:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671152768 00000100:00100000:3.0:1785774773.511602:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365 00000100:00100000:3.0:1785774773.511608:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671152768:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.511679:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671152768:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774773.511686:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365 00000100:00100000:0.0:1785774773.511931:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671152896 00000100:00100000:0.0:1785774773.511935:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671152896 00000100:00100000:0.0:1785774773.511957:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:0.0:1785774773.511963:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671152896:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.512009:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671152896:12345-0@lo:1000:mdt00_004.0 Request processed in 46us (160us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774773.512016:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:3.0:1785774773.512393:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671153024 00000100:00100000:3.0:1785774773.512398:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671153024 00000100:00100000:3.0:1785774773.512425:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367 00000100:00100000:3.0:1785774773.512431:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671153024:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774773.513212:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671153024:12345-0@lo:1000:mdt00_004.0 Request processed in 780us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.513219:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367 00000100:00100000:0.0:1785774773.514538:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671153152 00000100:00100000:0.0:1785774773.514543:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671153152 00000100:00100000:0.0:1785774773.514568:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:0.0:1785774773.514574:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671153152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.514637:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671153152:12345-0@lo:1000:mdt00_004.0 Request processed in 64us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.514644:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:0.0:1785774773.514666:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671153152:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.514704:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671153280:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.514728:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.514744:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671153280 00000100:00100000:0.0:1785774773.514746:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671153280 00000100:00100000:0.0:1785774773.514760:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:0.0:1785774773.514765:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671153280:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774773.514797:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671153280:12345-0@lo:1000:mdt00_004.0 Request processed in 32us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.514803:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:0.0:1785774773.514815:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.514825:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671153280:0@lo:1000:mdt00_004.0 00000040:00080000:0.0:1785774773.520851:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].376, 2168 off577368 00000040:00080000:0.0:1785774773.520941:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].376, 2368 off630728 00000004:00080000:0.0:1785774773.520947:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b76060a1300 with version 715 00000100:00100000:0.0:1785774773.523204:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671153536 00000100:00100000:0.0:1785774773.523212:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671153536 00000100:00100000:0.0:1785774773.523267:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:0.0:1785774773.523277:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671153536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774773.526046:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671153536:12345-0@lo:1000:osp_up1-0.0 Request processed in 2767us (4691us total) trans 4294968411 rc 0/0 00000100:00100000:0.0:1785774773.526057:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:3.0:1785774773.539435:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d78700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671153536:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774773.579883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774773.662019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.665661:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648429568 00000100:00100000:3.0:1785774773.665673:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648429568 00000100:00100000:3.0:1785774773.665731:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23618 00000100:00100000:3.0:1785774773.665741:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:17713:x1872519648429568:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774773.665760:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.665794:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ddd4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb02 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.665856:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.665870:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.665881:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.665891:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.665901:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ddb1 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ddaa expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.665909:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.669654:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ddb1 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ddaa expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.669677:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671153920:0@lo:104: 00000100:00100000:3.0:1785774773.669738:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.674544:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7701359600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.687202:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671153920:0@lo:104: 00010000:00010000:3.0:1785774773.687224:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.687435:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774773.687451:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.687460:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774773.687466:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774773.687475:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.687518:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.687525:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774773.687552:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.687560:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef1000/0x7b7109e1d09ddaa lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ddb1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.687577:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774773.687580:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774773.687582:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774773.687660:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774773.687673:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671154048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774773.687711:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.687869:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671154048 00000100:00100000:0.0:1785774773.687875:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671154048 00010000:00010000:0.0:1785774773.687897:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ddb1 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09ddaa expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.687933:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:0.0:1785774773.687941:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671154048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.687952:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1785774773.731480:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671154176:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1785774773.731511:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1785774773.734710:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 744 rpc_version 744 00000020:00100000:3.0:1785774773.734742:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774773.734751:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c95180 x1872519671154560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774773.734772:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671154560:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774773.734819:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.734860:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7701359600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.737527:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1785774773.737543:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3655:x1872519671154304:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1785774773.737559:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.737586:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09dbc0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09dbb9 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.737604:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xbefb5018 (ffff9b7731f88c00) 00010000:00010000:0.0:1785774773.737614:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.737669:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3655:x1872519671154304:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 131us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.737676:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1785774773.737695:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1785774773.737702:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3654:x1872519671154176:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1785774773.737711:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.737723:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09dd48 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09dd41 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.737734:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9b7602508b00) 00010000:00010000:0.0:1785774773.737741:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.737771:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3654:x1872519671154176:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 69us (6260us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.737777:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1785774773.737816:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671154176:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1785774773.739388:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.739397:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.739515:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671154688:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785774773.739557:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.739594:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.739912:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671154048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774773.741313:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671154688:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1785774773.741367:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09dde9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741381:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09dde9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741397:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09dde9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774773.741418:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09dde9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741432:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741438:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741453:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741459:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741465:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.741469:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741475:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741484:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388000) 00010000:00010000:3.0:1785774773.741486:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.741490:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741495:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09dddb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741510:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741516:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741522:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741527:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774773.741530:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741535:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741543:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6bb7d880 (ffff9b7709388f00) 00010000:00010000:3.0:1785774773.741545:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.741548:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741553:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09dde2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741586:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ddd4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb02 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741602:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09dde9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb02 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.741613:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff9b7709388e00) 00010000:00010000:3.0:1785774773.741616:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774773.741618:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:3.0:1785774773.741755:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17713:x1872519648429568:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 76013us (79743us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.741762:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23618 00000100:00100000:3.0:1785774773.746515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774773.815145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.815657:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648429952 00000100:00100000:3.0:1785774773.815667:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648429952 00000100:00100000:3.0:1785774773.815724:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23621 00000100:00100000:3.0:1785774773.815736:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17713:x1872519648429952:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1785774773.815758:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.815778:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de0c lrc: 2/0,0 mode: --/CR res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb17 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.815833:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.815847:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ddcd lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ddc6 expref: 5 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.815855:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.815887:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ddcd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ddc6 expref: 5 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.815908:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671154816:0@lo:104: 00000100:00100000:3.0:1785774773.815963:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.816011:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.817596:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671154816 00000100:00100000:0.0:1785774773.817605:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671154816 00000100:00100000:0.0:1785774773.817652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1785774773.817661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6531:x1872519671154816:12345-0@lo:104: 00010000:00010000:0.0:1785774773.817676:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ef0400/0x7b7109e1d09ddc6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ddcd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.817750:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785774773.817756:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6531:x1872519671154816:12345-0@lo:104: Request processed in 98us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.817763:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1785774773.820815:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671154816:0@lo:104: 00010000:00010000:3.0:1785774773.820841:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.823641:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ddcd lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09ddc6 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.823660:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd0:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:3.0:1785774773.823665:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.823674:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.823682:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.823710:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774773.823783:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671154944:12345-0@lo:103:ldlm_bl.0 Request processed in 5573us (5719us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.823793:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000020:00080000:0.0:1785774773.824627:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 388 00000004:00080000:0.0:1785774773.824676:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605f8be40 with version 745 00000020:00080000:0.0:1785774773.824690:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 386 cancel update log [0x200000401:0x3:0x0].387: rc = 0 00000020:00080000:0.0:1785774773.824762:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 386 cancel update log [0x240000400:0x3:0x0].388: rc = 0 00000004:00080000:0.0:1785774773.824780:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605f8bc00 with version 746 00000020:00080000:0.0:1785774773.824783:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 387 cancel update log [0x200000401:0x3:0x0].388: rc = 0 00000020:00080000:0.0:1785774773.824799:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 387 cancel update log [0x240000400:0x3:0x0].389: rc = 0 00000004:00080000:0.0:1785774773.824814:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605f8b900 with version 747 00000020:00080000:0.0:1785774773.824817:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 388 cancel update log [0x200000401:0x3:0x0].389: rc = 0 00000020:00080000:0.0:1785774773.824830:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 388 cancel update log [0x240000400:0x3:0x0].390: rc = 0 00000020:00080000:0.0:1785774773.824835:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 388 00000100:00100000:3.0:1785774773.826183:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671155200:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1785774773.826194:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 746 rpc_version 746 00000020:00100000:3.0:1785774773.826208:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774773.826214:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c94700 x1872519671155456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774773.826228:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671155456:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774773.826255:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.826287:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.826719:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671155456:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1785774773.826725:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 747 rpc_version 747 00000020:00100000:3.0:1785774773.826736:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774773.826751:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c96d80 x1872519671155712/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774773.826763:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671155712:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774773.826785:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.826802:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.826887:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671155712 00000100:00100000:0.0:1785774773.826891:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671155712 00000100:00100000:0.0:1785774773.826920:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:0.0:1785774773.826926:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7474:x1872519671155712:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774773.827002:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7474:x1872519671155712:12345-0@lo:1000:osp_up0-1.0 Request processed in 76us (215us total) trans 4294983472 rc 0/0 00000100:00100000:0.0:1785774773.827009:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:3.0:1785774773.827135:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671155712:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774773.838100:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648430336 00000100:00100000:0.0:1785774773.838110:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648430336 00000100:00100000:0.0:1785774773.838188:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23622 00000100:00100000:0.0:1785774773.838196:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17713:x1872519648430336:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:0.0:1785774773.838250:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.838285:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ddf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb09 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.838308:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff9b7702c6a800) 00010000:00010000:0.0:1785774773.838319:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774773.838360:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744a00/0x7b7109e1d09de1a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.838368:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744a00/0x7b7109e1d09de1a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.838382:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744a00/0x7b7109e1d09de1a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.838402:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671155840:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774773.838455:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.838479:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.839321:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671155840 00000100:00100000:3.0:1785774773.839325:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671155840 00000100:00100000:3.0:1785774773.839352:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377 00000100:00100000:3.0:1785774773.839359:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8469:x1872519671155840:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774773.839369:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774773.839382:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09de21 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09de1a expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.839401:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09de21 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09de1a expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.839412:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09de21 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de1a expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.839420:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388000) 00010000:00010000:3.0:1785774773.839423:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774773.839425:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1c00, rc 0) 00000100:00100000:3.0:1785774773.839469:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8469:x1872519671155840:12345-0@lo:101:mdt00_003.0 Request processed in 110us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.839476:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377 00000100:00100000:0.0:1785774773.840581:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968411 gen 2 00000004:00080000:0.0:1785774773.840588:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968405 committed transno 4294968411 00000020:00080000:0.0:1785774773.840593:0:8469:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605cf8000 refcount 2 committed 0 result 0 batchid 387 00000020:00080000:0.0:1785774773.840597:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cf8e40 00000020:00080000:0.0:1785774773.840601:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].375 00000020:00080000:0.0:1785774773.840604:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76036e6200 00000020:00080000:0.0:1785774773.840606:0:8469:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].375 00000004:00080000:0.0:1785774773.840633:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968407 committed transno 4294968411 00000004:00080000:0.0:1785774773.840643:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968411 committed transno 4294968411 00000100:00100000:0.0:1785774773.840664:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671155840:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774773.840679:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744a00/0x7b7109e1d09de1a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09de21 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.840690:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744a00/0x7b7109e1d09de1a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de21 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774773.840706:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774773.840728:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745400/0x7b7109e1d09de28 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.840735:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745400/0x7b7109e1d09de28 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.840934:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745400/0x7b7109e1d09de28 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.840947:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671155968:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774773.840976:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.840998:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.845838:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671156480:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774773.845857:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09de4b lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.847984:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648430464 00000100:00100000:0.0:1785774773.847991:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648430464 00010000:00010000:0.0:1785774773.848026:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09de05 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb10 expref: 18 pid: 6529 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.848072:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1590 00000100:00100000:0.0:1785774773.848081:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648430464:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.848094:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.848100:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09de05 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb10 expref: 18 pid: 6529 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848112:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09de05 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb10 expref: 18 pid: 6529 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848132:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09de05 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb10 expref: 18 pid: 6529 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848152:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd0:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:0.0:1785774773.848157:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09de4b lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848188:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09de4b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848196:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09de4b lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848217:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.848257:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648430464:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 178us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.848265:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1590 00010000:00010000:3.0:1785774773.848545:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09de4b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.848555:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09de4b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.848598:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09de52 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.848605:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09de52 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.848614:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09de52 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.848630:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671156608:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774773.848667:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.848698:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.848820:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671156608 00000100:00100000:0.0:1785774773.848824:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671156608 00000100:00100000:0.0:1785774773.848856:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3382 00000100:00100000:0.0:1785774773.848862:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:8469:x1872519671156608:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774773.848875:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774773.848887:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09de52 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848906:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb17 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848915:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848935:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb17 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.848948:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb17 expref: 6 pid: 6531 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.848959:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671156736:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774773.849012:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.854316:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671156736:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774773.854349:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.854362:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd0:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:0.0:1785774773.854365:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774773.854369:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.854380:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.854388:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:0.0:1785774773.854433:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:8469:x1872519671156608:12345-0@lo:101:mdt00_003.0 Request processed in 5571us (5765us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.854451:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3382 00000100:00100000:3.0:1785774773.854655:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671156608:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774773.854672:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09de52 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09de59 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.854683:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09de52 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de59 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774773.854883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774773.854934:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648430592 00000100:00100000:3.0:1785774773.854941:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648430592 00010000:00010000:3.0:1785774773.854965:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb17 expref: 7 pid: 6531 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.855004:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1591 00000100:00100000:3.0:1785774773.855012:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734583c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648430592:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774773.855025:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774773.855030:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb17 expref: 7 pid: 6531 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.855042:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb17 expref: 7 pid: 6531 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.855062:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09de13 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb17 expref: 7 pid: 6531 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.855081:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd0:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:3.0:1785774773.855087:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.855101:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.855110:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.855136:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.855148:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9541:1872519671156864:0@lo:105: 00000100:00100000:3.0:1785774773.855199:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.855232:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774773.855690:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9541:1872519671156864:0@lo:105: 00010000:00010000:3.0:1785774773.855700:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774773.855744:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734583c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648430592:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 726us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774773.855751:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1591 00010000:00010000:3.0:1785774773.855788:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09de52 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de59 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774773.855797:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09de52 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de59 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774773.857730:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671156992:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1785774773.858899:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774773.858924:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774773.860299:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671156992 00000100:00100000:0.0:1785774773.860315:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671156992 00000100:00100000:0.0:1785774773.860360:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3383 00000100:00100000:0.0:1785774773.860368:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8469:x1872519671156992:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1785774773.861901:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8469:x1872519671156992:12345-0@lo:403:mdt00_003.0 Request processed in 1531us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.861914:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3383 00000100:00100000:3.0:1785774773.863042:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671156992:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1785774773.864049:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].377, 664 off578032 00000040:00080000:3.0:1785774773.864277:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].377, 744 off631472 00000004:00080000:3.0:1785774773.864283:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf8900 with version 716 00000100:00100000:3.0:1785774773.867601:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671157248 00000100:00100000:3.0:1785774773.867608:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671157248 00000100:00100000:3.0:1785774773.867654:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384 00000100:00100000:3.0:1785774773.867663:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671157248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774773.869793:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671157248:12345-0@lo:1000:osp_up1-0.0 Request processed in 2127us (2490us total) trans 4294968412 rc 0/0 00000100:00100000:3.0:1785774773.869803:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384 00000100:00100000:0.0:1785774773.873481:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671157248:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1785774773.874426:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774773.874432:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774773.874454:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671157504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774773.874504:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.874547:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774773.874552:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671157376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774773.874570:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.874590:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774773.874596:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671157632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774773.874613:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774773.874634:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671157504 00000100:00100000:0.0:1785774773.874640:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671157504 00000100:00100000:0.0:1785774773.874670:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671157376 00000100:00100000:0.0:1785774773.874672:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671157376 00000100:00100000:0.0:1785774773.874687:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671157632 00000100:00100000:0.0:1785774773.874689:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671157632 00000100:00100000:0.0:1785774773.874702:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1785774773.874709:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+12:3654:x1872519671157504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.874721:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.874746:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0c00/0x7b7109e1d09de3d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09de36 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.874759:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:0.0:1785774773.874766:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.874790:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3654:x1872519671157504:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.874797:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1785774773.874808:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1785774773.874814:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671157376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.874821:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.874830:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09de59 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09de52 expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.874840:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd0:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:0.0:1785774773.874845:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.874861:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3654:x1872519671157376:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.874867:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1785774773.874877:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1785774773.874882:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671157632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774773.874888:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774773.874897:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09de21 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09de1a expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774773.874905:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7709388000) 00010000:00010000:0.0:1785774773.874910:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774773.874929:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3656:x1872519671157632:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774773.874935:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1785774773.874961:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671157632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774773.874980:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671157376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774773.874989:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671157504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774773.972459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774774.043151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774774.098715:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648431104 00000100:00100000:3.0:1785774774.098725:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648431104 00000100:00100000:3.0:1785774774.098907:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23625 00000100:00100000:3.0:1785774774.098918:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17714:x1872519648431104:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:3.0:1785774774.099024:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671157760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.099477:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.099521:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774774.102757:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671157760 00000100:00100000:0.0:1785774774.102767:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671157760 00000100:00100000:0.0:1785774774.102815:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385 00000100:00100000:0.0:1785774774.102822:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:8469:x1872519671157760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774774.102916:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:8469:x1872519671157760:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (3440us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774774.102924:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00000100:00100000:3.0:1785774774.103793:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671157760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.103856:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671157888:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.103890:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.103916:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.103927:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671157888 00000100:00100000:3.0:1785774774.103931:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671157888 00000100:00100000:3.0:1785774774.103957:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386 00000100:00100000:3.0:1785774774.103963:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:8469:x1872519671157888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.104025:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:8469:x1872519671157888:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (134us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774774.104032:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386 00000100:00100000:3.0:1785774774.104053:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671157888:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785774774.104884:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.104896:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.104907:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774774.104922:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158016:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774774.104947:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.104968:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.104981:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671158016 00000100:00100000:3.0:1785774774.104985:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671158016 00000100:00100000:3.0:1785774774.105020:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387 00000100:00100000:3.0:1785774774.105026:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:8469:x1872519671158016:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774774.105036:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774774.105051:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de8a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09de83 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.105616:0:7692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09dd95 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bafb expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.105626:0:7692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de8a lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09de83 expref: 11 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.105653:0:7692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09dd95 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bafb expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.105666:0:7692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09dd95 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bafb expref: 16 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774774.105677:0:7692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671158144:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774774.105728:0:7692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.111863:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158016:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774774.111882:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.111892:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774774.118927:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648431232 00000100:00100000:0.0:1785774774.118936:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648431232 00010000:00010000:0.0:1785774774.118972:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09dd95 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bafb expref: 17 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774774.119019:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1592 00000100:00100000:0.0:1785774774.119027:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648431232:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774774.119041:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774774.119047:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09dd95 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bafb expref: 17 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119060:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09dd95 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bafb expref: 17 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119081:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09dd95 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bafb expref: 17 pid: 8469 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119111:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7702c6a000) 00010000:00010000:0.0:1785774774.119117:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de8a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de83 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119128:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de8a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09de83 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119138:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de8a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09de83 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119204:0:19895:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de8a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09de83 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774774.119218:0:19895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19895:1872519671158272:0@lo:105: 00000100:00100000:0.0:1785774774.119261:0:19895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774774.119295:0:19895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774774.119309:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671158272 00000100:00100000:0.0:1785774774.119313:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671158272 00000100:00100000:0.0:1785774774.119338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1785774774.119343:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671158272:12345-0@lo:105: 00010000:00010000:0.0:1785774774.119353:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119362:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119375:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119383:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119391:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119398:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.119413:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec0400) 00000100:00100000:0.0:1785774774.119456:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671158272:12345-0@lo:105: Request processed in 111us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774774.119464:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1785774774.119500:0:19895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19895:1872519671158272:0@lo:105: 00010000:00010000:0.0:1785774774.119514:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774774.119544:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648431232:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 518us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774774.119550:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1592 00010000:00010000:3.0:1785774774.119780:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.119791:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774774.119812:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774774.119843:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.119850:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.119859:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774774.119872:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158400:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774774.119897:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.119920:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774774.120677:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158400:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774774.120689:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09de98 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.120698:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de98 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774774.120710:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1785774774.120738:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158528:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774774.120764:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774774.120785:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.120824:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671158528 00000100:00100000:3.0:1785774774.120827:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671158528 00000100:00100000:3.0:1785774774.120855:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389 00000100:00100000:3.0:1785774774.120861:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.120920:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158528:12345-0@lo:1000:mdt00_003.0 Request processed in 58us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.120926:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389 00000100:00100000:0.0:1785774774.120992:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158528:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774774.121035:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158656:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774774.121055:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774774.121074:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.121225:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671158656 00000100:00100000:3.0:1785774774.121229:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671158656 00000100:00100000:3.0:1785774774.121253:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390 00000100:00100000:3.0:1785774774.121259:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.121335:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158656:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (280us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774774.121342:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390 00000100:00100000:3.0:1785774774.121622:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671158784 00000100:00100000:3.0:1785774774.121626:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671158784 00000100:00100000:3.0:1785774774.121652:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3391 00000100:00100000:3.0:1785774774.121658:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.121704:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158784:12345-0@lo:1000:mdt00_003.0 Request processed in 46us (214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774774.121712:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3391 00000100:00100000:3.0:1785774774.121733:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158784:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.121773:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158912:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.121795:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.121807:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.121816:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671158912 00000100:00100000:3.0:1785774774.121819:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671158912 00000100:00100000:3.0:1785774774.121833:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3392 00000100:00100000:3.0:1785774774.121837:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.121876:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671158912:12345-0@lo:1000:mdt00_003.0 Request processed in 38us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.121882:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3392 00000100:00100000:3.0:1785774774.121901:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671158912:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.121932:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671159040:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.121950:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.121961:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.121969:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671159040 00000100:00100000:3.0:1785774774.121972:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671159040 00000100:00100000:3.0:1785774774.121986:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3393 00000100:00100000:3.0:1785774774.121990:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671159040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.122051:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671159040:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.122057:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3393 00000100:00100000:3.0:1785774774.122076:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671159040:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.122120:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671159168:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.122141:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.122152:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774774.122184:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671159168 00000100:00100000:3.0:1785774774.122187:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671159168 00000100:00100000:3.0:1785774774.122201:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394 00000100:00100000:3.0:1785774774.122207:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671159168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774774.122243:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:8469:x1872519671159168:12345-0@lo:1000:mdt00_003.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.122248:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394 00000100:00100000:3.0:1785774774.122267:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671159168:0@lo:1000:mdt00_003.0 00080000:02000000:3.0:1785774774.122630:0:8469:0:(osd_handler.c:2218:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:3.0:1785774774.122644:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605cf8e40 with version 0 00000020:00080000:3.0:1785774774.122649:0:8469:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605cf8d80 refcount 3 committed 0 result -5 batchid 390 00000020:00080000:3.0:1785774774.122653:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544f800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -5 sub_th ffff9b7605cf8e40 00000020:00080000:3.0:1785774774.122657:0:8469:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544fc00 obd lustre-MDT0001-osd committed 1 started 0 stopped 1 result 0 sub_th ffff9b7605ecf200 00000004:00080000:3.0:1785774774.122674:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774774.122681:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.122690:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.122698:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0400/0x7b7109e1d09de83 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09de8a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.122717:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774774.122720:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774774.122724:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09de98 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.122731:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09de98 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.122738:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09de91 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09de98 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.122748:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1785774774.122792:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17714:x1872519648431104:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 23876us (24645us total) trans 0 rc -5/-5 00000100:00100000:3.0:1785774774.122799:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23625 00000020:00080000:3.0:1785774774.122815:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 388 00010000:00010000:0.0:1785774774.123599:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774774.123610:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671159424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774774.123635:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774774.123670:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671159296 00000100:00100000:0.0:1785774774.123674:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671159296 00000100:00100000:0.0:1785774774.123697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671159424 00000100:00100000:0.0:1785774774.123699:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671159424 00000100:00100000:0.0:1785774774.123714:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1785774774.123719:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671159296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774774.123730:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774774.123743:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09de8a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09de83 expref: 13 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.123754:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7702c6a000) 00010000:00010000:0.0:1785774774.123761:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774774.123785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3655:x1872519671159296:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774774.123793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1785774774.123805:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1785774774.123810:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3653:x1872519671159424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774774.123817:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774774.123825:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09de98 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09de91 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774774.123840:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9b760572b200) 00010000:00010000:0.0:1785774774.123846:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774774.123865:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3653:x1872519671159424:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774774.123871:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1785774774.123895:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671159296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774774.123912:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671159424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774774.203459:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648431488 00000100:00100000:3.0:1785774774.203473:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648431488 00000100:00100000:3.0:1785774774.203583:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23626 00000100:00100000:3.0:1785774774.203602:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17715:x1872519648431488:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:3.0:1785774774.203715:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.203732:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.203745:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.203760:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.203767:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.203772:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205576:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205591:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205600:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774774.205615:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf4bd935 reply state 0000000022ce7d4a transno 4294983474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205625:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205631:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9b7709388500) 00010000:00010000:3.0:1785774774.205635:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774774.205736:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785774774.205741:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1531:0x0]: returning size 4096 00010000:00010000:3.0:1785774774.205750:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205757:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205764:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205771:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205777:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774774.205781:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205789:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205799:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7709388d00) 00010000:00010000:3.0:1785774774.205801:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774774.205805:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205914:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09de9f lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774774.205976:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf4bd935 reply state 0000000022ce7d4a transno 4294983474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205986:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774774.205991:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9b7709388b00) 00010000:00010000:3.0:1785774774.205994:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774774.205995:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1785774774.206232:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17715:x1872519648431488:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 2637us (7408us total) trans 4294983474 rc 0/0 00000100:00100000:3.0:1785774774.206242:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23626 00000100:00100000:0.0:1785774774.437322:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671159680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774774.437356:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785774774.438525:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774774.440331:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671160064:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440365:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.440389:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671160576:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440410:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.440422:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671161088:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440450:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.440472:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1785774774.440477:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671159936:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.440512:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671160448:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440541:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.440561:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671160960:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774774.440744:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671159936 00000100:00100000:3.0:1785774774.440748:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671159936 00000100:00100000:3.0:1785774774.440774:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671160448 00000100:00100000:3.0:1785774774.440777:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671160448 00000100:00100000:3.0:1785774774.440794:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671160960 00000100:00100000:3.0:1785774774.440797:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671160960 00000100:00100000:3.0:1785774774.440809:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1785774774.440814:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671159936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440848:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671159936:12345-0@lo:400:kworker.0 Request processed in 34us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.440854:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1785774774.440878:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1785774774.440884:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671160448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440908:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671160448:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.440913:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1785774774.440922:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1785774774.440927:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671160960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440947:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671160960:12345-0@lo:400:kworker.0 Request processed in 20us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.440953:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1785774774.440981:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671159936:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440989:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671160448:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.440997:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671160960:0@lo:400:kworker.0 00000100:00080000:3.0:1785774774.441295:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774774.441933:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671160192 00000100:00100000:3.0:1785774774.441937:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671160192 00000100:00100000:3.0:1785774774.441962:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671160320 00000100:00100000:3.0:1785774774.441965:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671160320 00000100:00100000:3.0:1785774774.441982:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671160832 00000100:00100000:3.0:1785774774.441984:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671160832 00000100:00100000:3.0:1785774774.441994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1785774774.442045:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671160192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.442080:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671160192:12345-0@lo:400:kworker.0 Request processed in 80us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.442086:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1785774774.442097:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1785774774.442103:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671160320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.442125:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671160320:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.442130:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1785774774.442139:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1785774774.442144:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671160832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.442185:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671160832:12345-0@lo:400:kworker.0 Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774774.442191:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00080000:3.0:1785774774.442206:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774774.442221:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671160320:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.442229:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671160832:0@lo:400:kworker.0 00000100:00100000:3.0:1785774774.442237:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671160192:0@lo:400:kworker.0 00000100:00100000:0.0:1785774774.443453:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671160064 00000100:00100000:0.0:1785774774.443459:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671160064 00000100:00100000:0.0:1785774774.443494:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:0.0:1785774774.443500:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:3654:x1872519671160064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774774.443546:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:3654:x1872519671160064:12345-0@lo:400:kworker.0 Request processed in 46us (3180us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774774.443561:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:3.0:1785774774.950071:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671161216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774774.950143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774774.951666:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671161216 00000100:00100000:0.0:1785774774.951677:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671161216 00000100:00100000:0.0:1785774774.951727:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1785774774.951738:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671161216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774774.951762:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774774.951824:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671161216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774774.951831:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1785774774.952365:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671161216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774775.076276:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774776.743003:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648431744 00000100:00100000:3.0:1785774776.743013:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648431744 00000100:00100000:3.0:1785774776.743254:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23627 00000100:00100000:3.0:1785774776.743266:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17734:x1872519648431744:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:3.0:1785774776.743395:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.743411:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.743435:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.743446:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.743451:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.743457:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1785774776.743968:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785774776.744388:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744398:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744406:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774776.744431:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031223242 reply state 0000000090626b6d transno 4294983475 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744443:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744450:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff9b7709388c00) 00010000:00010000:3.0:1785774776.744453:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774776.744457:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785774776.744462:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1532:0x0]: returning size 4096 00010000:00010000:3.0:1785774776.744470:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744477:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744484:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744491:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744497:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774776.744501:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744508:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744518:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7709388300) 00010000:00010000:3.0:1785774776.744521:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774776.744524:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744531:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09deb4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774776.744546:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031223242 reply state 0000000090626b6d transno 4294983475 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744554:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.744565:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9b7709388600) 00010000:00010000:3.0:1785774776.744567:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774776.744569:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1785774776.744870:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17734:x1872519648431744:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 1605us (2248us total) trans 4294983475 rc 0/0 00000100:00100000:3.0:1785774776.744878:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23627 00000100:00100000:3.0:1785774776.789986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774776.790220:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648431872 00000100:00100000:0.0:1785774776.790231:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648431872 00000100:00100000:0.0:1785774776.790305:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23628 00000100:00100000:0.0:1785774776.790316:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17735:x1872519648431872:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:0.0:1785774776.790341:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774776.790366:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09dec9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb2c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790447:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790461:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790471:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790482:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790489:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790496:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790572:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09dede lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790581:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09dede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790588:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09dede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774776.790632:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1532:0x0]: returning size 4096 00000004:00200000:0.0:1785774776.790635:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774776.790653:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09dede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790668:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790673:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790678:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790684:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790690:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774776.790694:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790701:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790711:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7602508c00) 00010000:00010000:0.0:1785774776.790714:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774776.790718:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790724:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09ded0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790737:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790742:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790748:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790753:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774776.790755:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790761:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790768:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9b7709388600) 00010000:00010000:0.0:1785774776.790771:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774776.790773:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790783:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09ded7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790819:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09dec9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb2c expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790836:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09dede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb2c expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774776.790843:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff9b7709388c00) 00010000:00010000:0.0:1785774776.790846:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774776.790848:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:0.0:1785774776.795626:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:17735:x1872519648431872:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 5301us (5636us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774776.795638:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23628 00000100:00100000:3.0:1785774776.807482:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648432128 00000100:00100000:3.0:1785774776.807493:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648432128 00000100:00100000:3.0:1785774776.807550:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23629 00000100:00100000:3.0:1785774776.807560:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:17735:x1872519648432128:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:3.0:1785774776.807617:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774776.807645:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09dede lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb2c expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.807662:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff9b7709388c00) 00010000:00010000:3.0:1785774776.807667:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774776.807693:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.807706:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.807715:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.807725:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.807737:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.807744:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.807991:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808000:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808008:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774776.808624:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1532:0x0]: returning size 4096 00010000:00010000:3.0:1785774776.808642:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808649:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808655:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808661:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774776.808665:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808672:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808686:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff9b7709388c00) 00010000:00010000:3.0:1785774776.808689:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774776.808692:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808699:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09def3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808715:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808721:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808726:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808732:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808737:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774776.808739:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808744:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808894:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7709388300) 00010000:00010000:3.0:1785774776.808898:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774776.808901:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808911:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dee5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774776.808924:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac45f73c reply state 00000000bf86e7cd transno 4294983476 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808933:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774776.808939:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9b7709388600) 00010000:00010000:3.0:1785774776.808942:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774776.808944:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774776.809017:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:17735:x1872519648432128:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 1458us (1920us total) trans 4294983476 rc 0/0 00000100:00100000:3.0:1785774776.809025:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23629 00000100:00100000:3.0:1785774777.509080:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671161344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774777.509208:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774777.509397:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671161344 00000100:00100000:0.0:1785774777.509421:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671161344 00000100:00100000:0.0:1785774777.509496:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397 00000100:00100000:0.0:1785774777.509508:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3656:x1872519671161344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785774777.509555:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443979264 avail 1297739776 00000100:00100000:0.0:1785774777.509606:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3656:x1872519671161344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774777.509614:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397 00000100:00100000:3.0:1785774777.511294:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671161344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774777.997311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774777.997354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774777.997386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774777.997432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774777.997468:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648432384 00000100:00100000:3.0:1785774777.997480:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648432384 00000100:00100000:3.0:1785774777.997547:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648432512 00000100:00100000:3.0:1785774777.997550:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648432512 00000100:00100000:3.0:1785774777.997597:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 963 00000100:00100000:3.0:1785774777.997609:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2418:x1872519648432384:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774777.997730:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2418:x1872519648432384:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 111us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774777.997742:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 963 00000100:00100000:3.0:1785774777.997763:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 964 00000100:00100000:3.0:1785774777.997769:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648432512:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774777.997796:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648432512:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774777.997802:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 964 00000100:00100000:3.0:1785774777.997825:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648432640 00000100:00100000:3.0:1785774777.997828:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648432640 00000100:00100000:3.0:1785774777.998236:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 575 00000100:00100000:3.0:1785774777.998243:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648432640:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774777.998274:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648432640:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774777.998280:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 575 00000100:00080000:3.0:1785774777.998305:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785774777.998310:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774778.014998:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648432768 00000100:00100000:0.0:1785774778.015011:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648432768 00000100:00100000:0.0:1785774778.015110:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 576 00000100:00100000:0.0:1785774778.015122:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648432768:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774778.015246:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648432768:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 127us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.015255:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 576 00000100:00080000:3.0:1785774778.015636:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1785774778.148551:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774778.532360:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671161472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774778.532467:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.532592:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671161472 00000100:00100000:0.0:1785774778.532603:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671161472 00000100:00100000:0.0:1785774778.532678:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1785774778.532690:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671161472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774778.533030:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1785774778.533088:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671161472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 400us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.533096:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00080000:0.0:1785774778.533122:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774778.533197:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671161472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774778.534649:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671161600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774778.534702:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774778.535438:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671161600 00000100:00100000:3.0:1785774778.535449:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671161600 00000100:00100000:3.0:1785774778.535559:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1785774778.535570:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671161600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774778.535595:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1785774778.535650:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671161600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.535661:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1785774778.535705:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671161600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774778.647331:0:20641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b774205ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.647808:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671162240:0@lo:101:lfsck.0 00010000:00010000:0.0:1785774778.647824:0:20643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09defa lrc: 4/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df01 expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.647836:0:20643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09defa lrc: 4/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09df01 expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774778.647857:0:20643:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000002:0x3:0x0] 00010000:00010000:0.0:1785774778.647882:0:20643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09df08 lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.647889:0:20643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09df08 lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20643 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.647897:0:20643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09df08 lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20643 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774778.647909:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671162368:0@lo:101:lfsck.0 00000100:00100000:0.0:1785774778.647937:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.647971:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e59c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.650676:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671162368:0@lo:101:lfsck.0 00010000:00010000:0.0:1785774778.650705:0:20643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09df08 lrc: 4/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df0f expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.650728:0:20643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09df08 lrc: 4/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09df0f expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774778.650752:0:20643:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000002:0x3:0x0] 00000100:00100000:0.0:1785774778.650805:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671162496:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.650851:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.650893:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e59540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.652929:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671162496:0@lo:1000:lfsck.0 00000004:00080000:0.0:1785774778.656110:0:20643:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605e50b40 with version 0 00000020:00100000:0.0:1785774778.657777:0:20643:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774778.657798:0:20643:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76037f4380 x1872519671162752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 400/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774778.658173:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671162752:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.658261:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.658323:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e50780 going to sleep for 11 seconds 00010000:00010000:3.0:1785774778.673451:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09ddb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1530:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673463:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09ddb8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1530:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673473:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09ddb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1530:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673480:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774778.673486:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09ddb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1530:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673503:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09ddb8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1530:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673519:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff9b7702c6a800) 00010000:00010000:3.0:1785774778.673523:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774778.673529:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09ddb8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1530:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673536:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09ddb8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1530:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673556:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09ddbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673563:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09ddbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673571:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09ddbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673577:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774778.673580:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09ddbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673586:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09ddbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673592:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd0:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:3.0:1785774778.673595:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774778.673598:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09ddbf lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673603:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09ddbf lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673618:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673624:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673631:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673636:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774778.673639:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673650:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673658:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9b7709388b00) 00010000:00010000:3.0:1785774778.673660:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774778.673663:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673669:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09dea6 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673681:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673687:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673694:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.673699:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774778.673702:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675566:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675583:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9b7709388500) 00010000:00010000:3.0:1785774778.675586:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774778.675591:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675599:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dead lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675619:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675626:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675632:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675637:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774778.675641:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675649:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675656:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9b7709388600) 00010000:00010000:3.0:1785774778.675658:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774778.675661:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675666:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09debb lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675674:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675679:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675685:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675690:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774778.675693:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675699:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.675705:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff9b7709388c00) 00010000:00010000:3.0:1785774778.677319:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774778.677330:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677341:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1200/0x7b7109e1d09dec2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1532:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677366:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677373:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677379:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677386:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774778.677390:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677411:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677423:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9b7709388600) 00010000:00010000:3.0:1785774778.677426:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774778.677429:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774778.677435:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1400/0x7b7109e1d09deec lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774778.681888:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671163136 00000100:00100000:0.0:1785774778.681908:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671163136 00000100:00100000:3.0:1785774778.684940:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671162752:12345-0@lo:1000:lfsck.0 Request processed in 26335us (26678us total) trans 4294983477 rc 0/0 00000100:00100000:3.0:1785774778.684949:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3404 00000004:00080000:0.0:1785774778.685035:0:20643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983477 committed transno 4294983477 00000100:00100000:0.0:1785774778.685041:0:20643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983477 gen 2 00000004:00080000:0.0:1785774778.685045:0:20643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983467 committed transno 4294983477 00000020:00080000:0.0:1785774778.685051:0:20643:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605fc8000 refcount 2 committed 0 result 0 batchid 389 00000020:00080000:0.0:1785774778.685056:0:20643:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544fb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605fc89c0 00000020:00080000:0.0:1785774778.685060:0:20643:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].390 00000020:00080000:0.0:1785774778.685063:0:20643:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544ff00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ecf000 00000020:00080000:0.0:1785774778.685066:0:20643:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].391 00000004:00080000:0.0:1785774778.685097:0:20643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983469 committed transno 4294983477 00000004:00080000:0.0:1785774778.685108:0:20643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983470 committed transno 4294983477 00000004:00080000:0.0:1785774778.685120:0:20643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983471 committed transno 4294983477 00000004:00080000:0.0:1785774778.685128:0:20643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983472 committed transno 4294983477 00000100:00100000:0.0:1785774778.685144:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671162752:0@lo:1000:lfsck.0 00010000:00010000:0.0:1785774778.685197:0:20643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09df08 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df0f expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.685211:0:20643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744400/0x7b7109e1d09df08 lrc: 2/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df0f expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.685221:0:20643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09defa lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df01 expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.685229:0:20643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0200/0x7b7109e1d09defa lrc: 2/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df01 expref: -99 pid: 20643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:0.0:1785774778.685264:0:20643:0:(lfsck_lib.c:2526:lfsck_start_assistant()) lustre-MDT0001-osd: start lfsck_namespace assistant thread 00000020:00080000:3.0:1785774778.685621:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 390 committed batchid 388 00000020:00080000:3.0:1785774778.685661:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 388 00100000:10000000:0.0:1785774778.694111:0:20643:0:(lfsck_namespace.c:4580:lfsck_namespace_prep()) lustre-MDT0001-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00100000:10000000:3.0:1785774778.695443:0:20646:0:(lfsck_engine.c:1551:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread start 00000100:00100000:0.0:1785774778.704927:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20641:x1872519671161728:12345-0@lo:1101:lctl.0 Request processed in 68965us (69230us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.704946:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:0.0:1785774778.706038:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671163264:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.706117:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.706232:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e509c0 going to sleep for 11 seconds 00100000:10000000:3.0:1785774778.714649:0:20644:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0001: OI scrub post with result = 1 00100000:10000000:3.0:1785774778.714705:0:20644:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1785774778.714708:0:20644:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0001: OI scrub: stop, pos = 1024001: rc = 1 00000100:00100000:3.0:1785774778.728451:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671163904:0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.728571:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671164032:0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.728654:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774778.728720:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076d80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.728878:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671164032 00000100:00100000:0.0:1785774778.728891:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671164032 00000100:00100000:0.0:1785774778.728972:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412 00000100:00100000:0.0:1785774778.728983:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164032:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.729131:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164032:12345-0@lo:1000:lfsck.0 Request processed in 149us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.729139:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412 00000100:00100000:3.0:1785774778.729643:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671164032:0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.729917:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671164160:0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.729961:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774778.729999:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671164160 00000100:00100000:3.0:1785774778.730005:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671164160 00000100:00100000:3.0:1785774778.730040:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3413 00000100:00100000:3.0:1785774778.730047:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164160:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.730106:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164160:12345-0@lo:1000:lfsck.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.730113:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3413 00000100:00100000:3.0:1785774778.730155:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774778.730191:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671164160:0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.730234:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671164288:0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.730258:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774778.730280:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671164288 00000100:00100000:3.0:1785774778.730284:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671164288 00000100:00100000:3.0:1785774778.730307:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3414 00000100:00100000:3.0:1785774778.730314:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164288:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.730364:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164288:12345-0@lo:1000:lfsck.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.730371:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3414 00000100:00100000:3.0:1785774778.730392:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77346ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774778.730416:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671164288:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.732789:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c3800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671164416:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.732872:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.732929:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e50240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.737897:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c3800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671164416:0@lo:1000:lfsck_namespace.0 00100000:10000000:0.0:1785774778.740995:0:20647:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-MDT0000: OI scrub start, flags = 0x0, pos = 12 00000100:00100000:3.0:1785774778.741914:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671164544 00000100:00100000:3.0:1785774778.741925:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671164544 00000100:00100000:3.0:1785774778.741992:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3416 00000100:00100000:3.0:1785774778.742003:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164544:12345-0@lo:1000:lfsck.0 00100000:10000000:0.0:1785774778.752816:0:20642:0:(lfsck_namespace.c:4478:lfsck_namespace_checkpoint()) lustre-MDT0000-osd: namespace LFSCK checkpoint at the pos [13, [0x0:0x0:0x0], 0x0], status = 1: rc = 0 00100000:10000000:0.0:1785774778.752835:0:20642:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-MDT0000-osd entry: oit_flags = 0x40000, dir_flags = 0x8006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 20642 00100000:10000000:0.0:1785774778.754069:0:20647:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0000: OI scrub post with result = 1 00100000:10000000:0.0:1785774778.754105:0:20647:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1785774778.754109:0:20647:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0000: OI scrub: stop, pos = 1024001: rc = 1 00000100:00100000:0.0:1785774778.757200:0:20642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c3800 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20642:1872519671165184:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.757295:0:20642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.757345:0:20642:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606317240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.764252:0:20648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.764329:0:20648:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.764604:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1c00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671165440:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.764682:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.764724:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671165312 00000100:00100000:0.0:1785774778.764733:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671165312 00000100:00100000:0.0:1785774778.764779:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671165440 00000100:00100000:0.0:1785774778.764782:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671165440 00000100:00100000:0.0:1785774778.764801:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3422 00000100:00100000:0.0:1785774778.764810:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20648:x1872519671165312:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.764956:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20648:x1872519671165312:12345-0@lo:1000:lfsck_namespace.0 Request processed in 93us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.764966:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3422 00000100:00100000:0.0:1785774778.764986:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3423 00000100:00100000:0.0:1785774778.764992:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671165440:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.765047:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671165440:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.765053:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3423 00000100:00100000:0.0:1785774778.765094:0:20648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa82300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671165312:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.765245:0:20648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671165568:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.765273:0:20648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.765293:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671165568 00000100:00100000:0.0:1785774778.765296:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671165568 00000100:00100000:0.0:1785774778.765311:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3424 00000100:00100000:0.0:1785774778.765315:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20648:x1872519671165568:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.770799:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20648:x1872519671165568:12345-0@lo:1000:lfsck_namespace.0 Request processed in 3379us (3421us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.770823:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3424 00000100:00100000:0.0:1785774778.770903:0:20648:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606317a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.770947:0:20648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671165568:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.771107:0:20648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671165696:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.771194:0:20648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.771234:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671165696 00000100:00100000:0.0:1785774778.771241:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671165696 00000100:00100000:0.0:1785774778.771276:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3425 00000100:00100000:0.0:1785774778.771285:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20648:x1872519671165696:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.771376:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:20648:x1872519671165696:12345-0@lo:1000:lfsck_namespace.0 Request processed in 91us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.771383:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3425 00000100:00100000:0.0:1785774778.771409:0:20648:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606317a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.771421:0:20648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671165696:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.777585:0:20648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671165824:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.777684:0:20648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.777822:0:20648:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606317a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.786244:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671165824 00000100:00100000:0.0:1785774778.786265:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671165824 00000100:00100000:0.0:1785774778.786480:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3428 00000100:00100000:0.0:1785774778.786491:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671165824:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.786677:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671165824:12345-0@lo:1000:lfsck_namespace.0 Request processed in 188us (8994us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.786685:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3428 00000100:00100000:0.0:1785774778.786753:0:20648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671165824:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.786885:0:20648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671166336:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.786927:0:20648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.786951:0:20648:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606317a80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774778.796094:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671164544:12345-0@lo:1000:lfsck.0 Request processed in 54077us (55387us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774778.796119:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3416 00000100:00100000:0.0:1785774778.839533:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671166464 00000100:00100000:0.0:1785774778.839555:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671166464 00000100:00100000:0.0:1785774778.840728:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3430 00000100:00100000:0.0:1785774778.840746:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a994850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671166464:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.840909:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a994850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:20643:x1872519671166464:12345-0@lo:1000:lfsck.0 Request processed in 171us (36270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.840917:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3430 00000100:00100000:0.0:1785774778.841372:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648432896 00000100:00100000:0.0:1785774778.841380:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648432896 00010000:00010000:0.0:1785774778.841426:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09de7c lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb25 expref: 7 pid: 6531 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774778.841460:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1593 00000100:00100000:0.0:1785774778.841468:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648432896:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774778.841485:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774778.841494:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09de7c lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb25 expref: 7 pid: 6531 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774778.849308:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671166592 00000100:00100000:3.0:1785774778.849319:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671166592 00000100:00100000:3.0:1785774778.850777:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431 00000100:00100000:3.0:1785774778.850789:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671166592:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774778.850928:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671166592:12345-0@lo:1000:lfsck_namespace.0 Request processed in 141us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.850936:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431 00010000:00010000:0.0:1785774778.865940:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09de7c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb25 expref: 7 pid: 6531 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.869446:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09de7c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb25 expref: 7 pid: 6531 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.869477:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b760572b900) 00010000:00010000:0.0:1785774778.869481:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1e00/0x7b7109e1d09df24 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.869492:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1e00/0x7b7109e1d09df24 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.869501:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1e00/0x7b7109e1d09df24 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774778.869551:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774778.873560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648432896:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 32075us (32635us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774778.873577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1593 00000020:00080000:0.0:1785774778.876308:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 390 batchid updated 00000001:00080000:0.0:1785774778.877120:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968413 is committed 00000020:00080000:0.0:1785774778.877155:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 390 00000004:00080000:0.0:1785774778.877375:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7606317b40 with version 748 00000020:00080000:0.0:1785774778.877390:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 389 cancel update log [0x200000401:0x3:0x0].390: rc = 0 00000020:00080000:0.0:1785774778.877512:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 389 cancel update log [0x240000400:0x3:0x0].391: rc = 0 00000020:00080000:0.0:1785774778.877523:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 390 00000004:00080000:0.0:1785774778.877535:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 748 rpc_version 748 00000020:00100000:0.0:1785774778.877581:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774778.877596:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c0a80 x1872519671167360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774778.877627:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671167360:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774778.880258:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.880291:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606317cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.895373:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671167360:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774778.942364:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671167872:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.942478:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.942519:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76063179c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.950531:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671167744:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774778.950618:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671167872:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.951923:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671168128:0@lo:1000:lfsck.0 00000100:00100000:0.0:1785774778.951964:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.951990:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606317240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774778.956611:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671168000:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.956743:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671168384:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.956779:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.956794:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774778.957373:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671168384 00000100:00100000:3.0:1785774778.957380:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671168384 00000100:00100000:3.0:1785774778.957419:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443 00000100:00100000:3.0:1785774778.957436:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671168384:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774778.957523:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671168384:12345-0@lo:1000:lfsck_namespace.0 Request processed in 98us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.957531:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443 00000100:00100000:0.0:1785774778.961791:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671168384:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.961972:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671168512:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.962046:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.962092:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774778.963749:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671168512 00000100:00100000:3.0:1785774778.963758:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671168512 00000100:00100000:3.0:1785774778.963812:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671168640 00000100:00100000:3.0:1785774778.963816:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671168640 00000100:00100000:3.0:1785774778.963834:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00100000:3.0:1785774778.963845:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:20646:x1872519671168512:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774778.963969:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:20646:x1872519671168512:12345-0@lo:1000:lfsck_namespace.0 Request processed in 126us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.963978:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:3.0:1785774778.963996:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:3.0:1785774778.964002:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671168640:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774778.964057:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671168640:12345-0@lo:1000:lfsck.0 Request processed in 55us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.964064:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:0.0:1785774778.966749:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671168512:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.966944:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671168768:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.967016:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.967063:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774778.970693:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671168768 00000100:00100000:3.0:1785774778.970711:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671168768 00000100:00100000:3.0:1785774778.970826:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3446 00000100:00100000:3.0:1785774778.970839:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671168768:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774778.971020:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671168768:12345-0@lo:1000:lfsck_namespace.0 Request processed in 182us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774778.971029:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3446 00000100:00100000:0.0:1785774778.976689:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671168768:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.976949:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671169024:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774778.977034:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774778.977095:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.006481:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671170048 00000100:00100000:3.0:1785774779.006502:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671170048 00000100:00100000:3.0:1785774779.006577:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3456 00000100:00100000:3.0:1785774779.006590:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671170048:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.006853:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671170048:12345-0@lo:1000:lfsck_namespace.0 Request processed in 266us (13013us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774779.006863:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3456 00010000:00010000:1.0:1785774779.007842:0:20646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774779.007847:0:20646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09df5c lrc: 2/0,0 mode: --/PW res: [0x240000402:0x14e:0x0].0xc6712b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007854:0:20646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1c00/0x7b7109e1d09df5c lrc: 0/0,0 mode: --/PW res: [0x240000402:0x14e:0x0].0xc6712b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007872:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df55 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007878:0:20646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df55 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007885:0:20646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df55 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007890:0:20646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774779.007893:0:20646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df55 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007899:0:20646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df55 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007907:0:20646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:1.0:1785774779.007910:0:20646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774779.007913:0:20646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df55 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.007919:0:20646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df55 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00100000:10000000:1.0:1785774779.007932:0:20646:0:(lfsck_namespace.c:5575:lfsck_namespace_repair_dangling()) lustre-MDT0001-osd: namespace LFSCK assistant found dangling reference for: parent [0x240000402:0x14e:0x0], child [0x200000401:0xab:0x0], type 16877, name [0x200000401:0xab:0x0]:1. Create the lost MDT-object as required: rc = 2 00100000:10000000:1.0:1785774779.007940:0:20646:0:(lfsck_striped_dir.c:2252:lfsck_namespace_striped_dir_rescan()) lustre-MDT0001-osd: namespace LFSCK repair the shard 1 [0x200000401:0xab:0x0] of the striped directory [0x240000402:0x14e:0x0] with dangling yes/yes, rename no/no, llinkea no/no, repair_lmvea no/no: rc = 2 00000100:00100000:1.0:1785774779.007988:0:20648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671169920:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.010542:0:20648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671170176:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.010637:0:20648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.010697:0:20648:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b780 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.010946:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671170304:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.010982:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.011026:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671170176 00000100:00100000:1.0:1785774779.011034:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671170176 00000100:00100000:1.0:1785774779.011097:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671170304 00000100:00100000:1.0:1785774779.011101:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671170304 00000100:00100000:1.0:1785774779.011126:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3457 00000100:00100000:1.0:1785774779.011137:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20648:x1872519671170176:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.013318:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458 00000100:00100000:3.0:1785774779.013337:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671170304:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774779.013599:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671170304:12345-0@lo:1000:lfsck.0 Request processed in 269us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.013608:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458 00000100:00100000:1.0:1785774779.014577:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:20648:x1872519671170176:12345-0@lo:1000:lfsck_namespace.0 Request processed in 3441us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.014585:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3457 00000100:00100000:1.0:1785774779.014950:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671170432 00000100:00100000:1.0:1785774779.014957:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671170432 00000100:00100000:1.0:1785774779.014999:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459 00000100:00100000:1.0:1785774779.015006:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:20648:x1872519671170432:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.015067:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:20648:x1872519671170432:12345-0@lo:1000:lfsck_namespace.0 Request processed in 60us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.015099:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459 00000100:00100000:1.0:1785774779.015120:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.015149:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671170304:0@lo:1000:lfsck.0 00100000:10000000:0.0:1785774779.016574:0:20642:0:(lfsck_lib.c:2604:lfsck_post_generic()) lustre-MDT0000-osd: the assistant has done lfsck_namespace post, rc = 1 00100000:10000000:0.0:1785774779.016648:0:20642:0:(lfsck_namespace.c:4808:lfsck_namespace_post()) lustre-MDT0000-osd: namespace LFSCK post done: rc = 0 00100000:10000000:0.0:1785774779.016673:0:20642:0:(lfsck_lib.c:2621:lfsck_double_scan_generic()) lustre-MDT0000-osd: waiting for assistant to do lfsck_namespace double_scan, status 2 00000100:00100000:1.0:1785774779.033486:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171200:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.033583:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.033650:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.033783:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671171200 00000100:00100000:3.0:1785774779.033792:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671171200 00000100:00100000:3.0:1785774779.033857:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465 00000100:00100000:3.0:1785774779.033867:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171200:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1785774779.033990:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171200:12345-0@lo:1000:lfsck.0 Request processed in 124us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.034019:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465 00000100:00100000:1.0:1785774779.038361:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171200:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.038826:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171328:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.038908:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.038956:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b600 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.038979:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671171328 00000100:00100000:1.0:1785774779.038986:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671171328 00000100:00100000:1.0:1785774779.039037:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466 00000100:00100000:1.0:1785774779.039046:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171328:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.039157:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171328:12345-0@lo:1000:lfsck.0 Request processed in 112us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.039215:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466 00000100:00100000:1.0:1785774779.039244:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171328:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.039374:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171456:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.039411:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.039437:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671171456 00000100:00100000:1.0:1785774779.039440:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671171456 00000100:00100000:1.0:1785774779.039462:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467 00000100:00100000:1.0:1785774779.039467:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171456:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.039509:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171456:12345-0@lo:1000:lfsck.0 Request processed in 41us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.039518:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467 00000100:00100000:1.0:1785774779.039536:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.039546:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171456:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.039578:0:20643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171584:0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.039598:0:20643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.039609:0:20643:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.039617:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671171584 00000100:00100000:1.0:1785774779.039619:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671171584 00000100:00100000:1.0:1785774779.039636:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3468 00000100:00100000:1.0:1785774779.039640:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171584:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1785774779.039686:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20643:x1872519671171584:12345-0@lo:1000:lfsck.0 Request processed in 45us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.039712:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3468 00000100:00100000:1.0:1785774779.039732:0:20643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20643:1872519671171584:0@lo:1000:lfsck.0 00100000:10000000:1.0:1785774779.039817:0:20643:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-MDT0001-osd ffff9b76056f8000 exit: oit_flags = 0x40003, dir_flags = 0x8006, oit_cookie = 512132, dir_cookie = 0x52f8fd926e3b88d5, parent = [0x240000403:0x1:0x0], pid = 20643: rc = 1 00100000:10000000:1.0:1785774779.039828:0:20643:0:(lfsck_lib.c:2594:lfsck_post_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace post, rc = 1 00100000:10000000:3.0:1785774779.040236:0:20646:0:(lfsck_engine.c:1612:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread post 00000100:00100000:3.0:1785774779.040263:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671171712:0@lo:1101:lfsck_namespace.0 00000100:00100000:3.0:1785774779.040306:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.040325:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77346ff480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.040342:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671171712 00000100:00100000:3.0:1785774779.040346:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671171712 00000100:00100000:3.0:1785774779.040370:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3469 00000100:00100000:3.0:1785774779.040376:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671171712:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:3.0:1785774779.040404:0:6534:0:(lfsck_namespace.c:5114:lfsck_namespace_in_notify()) lustre-MDT0000-osd: namespace LFSCK handles notify 3 from MDT 1, status 1, flags 2 00000100:00100000:3.0:1785774779.040585:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671171712:12345-0@lo:1101:lfsck_namespace.0 Request processed in 209us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.040593:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3469 00000100:00100000:3.0:1785774779.040617:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671171712:0@lo:1101:lfsck_namespace.0 00100000:10000000:3.0:1785774779.040629:0:20646:0:(lfsck_engine.c:1626:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant notified others for lfsck_namespace post: rc = 0 00100000:10000000:1.0:1785774779.040785:0:20643:0:(lfsck_lib.c:2604:lfsck_post_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace post, rc = 1 00100000:10000000:1.0:1785774779.040842:0:20643:0:(lfsck_namespace.c:4808:lfsck_namespace_post()) lustre-MDT0001-osd: namespace LFSCK post done: rc = 0 00100000:10000000:1.0:1785774779.040896:0:20643:0:(lfsck_lib.c:2621:lfsck_double_scan_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace double_scan, status 2 00100000:10000000:3.0:1785774779.040916:0:20646:0:(lfsck_engine.c:1644:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant sync before the second-stage scaning 00000004:00080000:3.0:1785774779.040938:0:20646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1020891773165ns, next at 0ns, rc = 0 00080000:00080000:3.0:1785774779.040946:0:20646:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1785774779.040968:0:20646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1020891807138ns, next at 0ns, rc = 0 00080000:00080000:3.0:1785774779.040972:0:20646:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00100000:10000000:1.0:1785774779.041003:0:20643:0:(lfsck_lib.c:2630:lfsck_double_scan_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace double_scan, status 0 00100000:10000000:1.0:1785774779.044340:0:20642:0:(lfsck_lib.c:2630:lfsck_double_scan_generic()) lustre-MDT0000-osd: the assistant has done lfsck_namespace double_scan, status 0 00000100:00100000:3.0:1785774779.069089:0:20648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20648:1872519671173120:0@lo:1000:lfsck_namespace.0 00000004:00080000:1.0:1785774779.069514:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:1.0:1785774779.069536:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:1.0:1785774779.069585:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671173248 00000100:00100000:1.0:1785774779.069589:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671173248 00000100:00100000:1.0:1785774779.069616:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3479 00000100:00100000:1.0:1785774779.069622:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671173248:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.069717:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671173248:12345-0@lo:1000:lfsck_namespace.0 Request processed in 94us (295us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.069735:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3479 00100000:10000000:3.0:1785774779.073407:0:20646:0:(lfsck_engine.c:1651:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant phase2 scan start, synced: rc = 0 00100000:10000000:3.0:1785774779.073444:0:20646:0:(lfsck_namespace.c:6700:lfsck_namespace_assistant_handler_p2()) lustre-MDT0001-osd: namespace LFSCK phase2 scan start 00100000:10000000:3.0:1785774779.073558:0:20646:0:(lfsck_namespace.c:6325:lfsck_namespace_scan_local_lpf()) lustre-MDT0001-osd: start to scan backend /lost+found 00100000:10000000:3.0:1785774779.073593:0:20646:0:(lfsck_namespace.c:6428:lfsck_namespace_scan_local_lpf()) lustre-MDT0001-osd: stop to scan backend /lost+found: rc = 1 00000100:00100000:3.0:1785774779.073735:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671173504:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.073815:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.073868:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.073903:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671173376 00000100:00100000:3.0:1785774779.073911:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671173376 00000100:00100000:3.0:1785774779.073956:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671173504 00000100:00100000:3.0:1785774779.073958:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671173504 00000100:00100000:3.0:1785774779.073972:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3480 00000100:00100000:3.0:1785774779.073979:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671173376:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.074095:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671173376:12345-0@lo:1000:lfsck_namespace.0 Request processed in 115us (4263us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774779.074125:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3480 00000100:00100000:3.0:1785774779.074154:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481 00000100:00100000:3.0:1785774779.075260:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671173504:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.075380:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671173504:12345-0@lo:1000:lfsck_namespace.0 Request processed in 1220us (1564us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774779.075402:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481 00000100:00100000:3.0:1785774779.075542:0:20646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983479 gen 2 00000004:00080000:3.0:1785774779.075549:0:20646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983478 committed transno 4294983479 00000004:00080000:3.0:1785774779.075571:0:20646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983479 committed transno 4294983479 00000020:00080000:3.0:1785774779.075577:0:20646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7603f396c0 refcount 2 committed 0 result 0 batchid 391 00000020:00080000:3.0:1785774779.075581:0:20646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603f39a80 00000020:00080000:3.0:1785774779.075584:0:20646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].391 00000020:00080000:3.0:1785774779.075587:0:20646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604ca2a00 00000020:00080000:3.0:1785774779.075590:0:20646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].392 00000100:00100000:3.0:1785774779.075619:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671173504:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.075738:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671173632:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.075773:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.075798:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.075817:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671173632 00000100:00100000:3.0:1785774779.075823:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671173632 00000100:00100000:3.0:1785774779.075849:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671173760 00000100:00100000:3.0:1785774779.075852:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671173760 00000100:00100000:3.0:1785774779.075870:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1785774779.075877:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671173632:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.075934:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671173632:12345-0@lo:1000:lfsck_namespace.0 Request processed in 58us (161us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774779.075940:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1785774779.075961:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671173632:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.076011:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671173888:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.076033:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.076042:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.076054:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671173888 00000100:00100000:3.0:1785774779.076057:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671173888 00000100:00100000:3.0:1785774779.076072:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1785774779.076077:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671173760:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:3.0:1785774779.076094:0:6534:0:(lfsck_namespace.c:5114:lfsck_namespace_in_notify()) lustre-MDT0001-osd: namespace LFSCK handles notify 4 from MDT 0, status 1, flags 0 00000100:00100000:3.0:1785774779.076136:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20648:x1872519671173760:12345-0@lo:1101:lfsck_namespace.0 Request processed in 58us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.076152:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483 00000100:00100000:1.0:1785774779.076310:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484 00000100:00100000:1.0:1785774779.076322:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671173888:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076418:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671173888:12345-0@lo:1000:lfsck_namespace.0 Request processed in 101us (385us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.076434:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484 00000100:00100000:1.0:1785774779.076474:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671173888:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076529:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174016:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076564:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.076581:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174016 00000100:00100000:1.0:1785774779.076584:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174016 00000100:00100000:1.0:1785774779.076602:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3485 00000100:00100000:1.0:1785774779.076606:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174016:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076655:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174016:12345-0@lo:1000:lfsck_namespace.0 Request processed in 48us (90us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.076663:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3485 00000100:00100000:1.0:1785774779.076687:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.076700:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174016:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076791:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174144:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076816:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.076835:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174144 00000100:00100000:1.0:1785774779.076839:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174144 00000100:00100000:1.0:1785774779.076855:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3486 00000100:00100000:1.0:1785774779.076860:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174144:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076907:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174144:12345-0@lo:1000:lfsck_namespace.0 Request processed in 47us (89us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.076913:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3486 00000100:00100000:1.0:1785774779.076927:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.076936:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174144:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.076984:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174272:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077007:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.077026:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174272 00000100:00100000:1.0:1785774779.077029:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174272 00000100:00100000:1.0:1785774779.077047:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3487 00000100:00100000:1.0:1785774779.077055:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174272:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077102:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174272:12345-0@lo:1000:lfsck_namespace.0 Request processed in 49us (94us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.077130:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3487 00000100:00100000:1.0:1785774779.077144:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.077154:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174272:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077255:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174400:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077279:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.077295:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174400 00000100:00100000:1.0:1785774779.077298:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174400 00000100:00100000:1.0:1785774779.077315:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3488 00000100:00100000:1.0:1785774779.077320:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174400:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077376:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174400:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (96us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.077382:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3488 00000100:00100000:1.0:1785774779.077415:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.077426:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174400:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077538:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174528:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077563:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.077581:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174528 00000100:00100000:1.0:1785774779.077584:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174528 00000100:00100000:1.0:1785774779.077597:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3489 00000100:00100000:1.0:1785774779.077601:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174528:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077672:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174528:12345-0@lo:1000:lfsck_namespace.0 Request processed in 71us (109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774779.077683:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3489 00000100:00100000:1.0:1785774779.077697:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.077708:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174528:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1785774779.077749:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.077770:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.077784:0:20646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.077819:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174656:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077840:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.077858:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174656 00000100:00100000:1.0:1785774779.077861:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174656 00000100:00100000:1.0:1785774779.077876:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490 00000100:00100000:1.0:1785774779.077883:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174656:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.077941:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174656:12345-0@lo:1000:lfsck_namespace.0 Request processed in 59us (100us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774779.077950:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490 00000100:00100000:1.0:1785774779.077964:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.077975:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174656:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1785774779.077995:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078002:0:20646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078009:0:20646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078014:0:20646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774779.078019:0:20646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078027:0:20646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078042:0:20646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x58:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:1.0:1785774779.078045:0:20646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1785774779.078050:0:20646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078057:0:20646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09df63 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x58:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.078101:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174784:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078124:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.078144:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174784 00000100:00100000:1.0:1785774779.078147:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174784 00000100:00100000:1.0:1785774779.078186:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3491 00000100:00100000:1.0:1785774779.078192:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174784:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078242:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174784:12345-0@lo:1000:lfsck_namespace.0 Request processed in 50us (118us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.078248:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3491 00000100:00100000:1.0:1785774779.078265:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.078277:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174784:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078315:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174912:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078339:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.078357:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671174912 00000100:00100000:1.0:1785774779.078360:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671174912 00000100:00100000:1.0:1785774779.078376:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3492 00000100:00100000:1.0:1785774779.078381:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174912:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078448:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671174912:12345-0@lo:1000:lfsck_namespace.0 Request processed in 67us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.078454:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3492 00000100:00100000:1.0:1785774779.078473:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.078483:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671174912:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078518:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175040:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078544:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.078559:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671175040 00000100:00100000:1.0:1785774779.078561:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671175040 00000100:00100000:1.0:1785774779.078575:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493 00000100:00100000:1.0:1785774779.078581:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671175040:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078626:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671175040:12345-0@lo:1000:lfsck_namespace.0 Request processed in 46us (81us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774779.078642:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493 00000100:00100000:1.0:1785774779.078654:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.078663:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175040:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1785774779.078699:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1c00/0x7b7109e1d09df6a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078706:0:20646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1c00/0x7b7109e1d09df6a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078717:0:20646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1c00/0x7b7109e1d09df6a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.078727:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175168:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078747:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.078761:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671175168 00000100:00100000:1.0:1785774779.078764:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671175168 00000100:00100000:1.0:1785774779.078777:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3494 00000100:00100000:1.0:1785774779.078781:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20646:x1872519671175168:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1785774779.078789:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774779.078805:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1200/0x7b7109e1d09df71 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09df6a expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078824:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1200/0x7b7109e1d09df71 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09df6a expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078839:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1200/0x7b7109e1d09df71 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09df6a expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078847:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9b7702c6af00) 00010000:00010000:1.0:1785774779.078850:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774779.078853:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1200, rc 0) 00000100:00100000:1.0:1785774779.078873:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20646:x1872519671175168:12345-0@lo:101:lfsck_namespace.0 Request processed in 92us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.078878:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3494 00000100:00100000:1.0:1785774779.078891:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.078901:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175168:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1785774779.078913:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1c00/0x7b7109e1d09df6a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df71 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078923:0:20646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1c00/0x7b7109e1d09df6a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09df71 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774779.078936:0:20646:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00010000:00010000:1.0:1785774779.078952:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1800/0x7b7109e1d09df78 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078958:0:20646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1800/0x7b7109e1d09df78 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.078964:0:20646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1800/0x7b7109e1d09df78 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.078972:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175296:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1785774779.078995:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.079011:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671175296 00000100:00100000:1.0:1785774779.079013:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671175296 00000100:00100000:1.0:1785774779.079029:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495 00000100:00100000:1.0:1785774779.079036:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20646:x1872519671175296:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1785774779.079043:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774779.079058:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1e00/0x7b7109e1d09df7f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09df78 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.079073:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1e00/0x7b7109e1d09df7f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09df78 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.079083:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1e00/0x7b7109e1d09df7f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09df78 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.079091:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x6be685ef (ffff9b7702c6a100) 00010000:00010000:1.0:1785774779.079094:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774779.079096:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1e00, rc 0) 00000100:00100000:1.0:1785774779.079116:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671175296:12345-0@lo:101:lfsck_namespace.0 Request processed in 82us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.079121:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495 00000100:00100000:1.0:1785774779.079135:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.079144:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175296:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1785774779.079152:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1800/0x7b7109e1d09df78 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df7f expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.079180:0:20646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1800/0x7b7109e1d09df78 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09df7f expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774779.079191:0:20646:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00000100:00100000:1.0:1785774779.079208:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175424:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.079235:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.079249:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671175424 00000100:00100000:1.0:1785774779.079252:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671175424 00000100:00100000:1.0:1785774779.079266:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3496 00000100:00100000:1.0:1785774779.079272:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671175424:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.079317:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671175424:12345-0@lo:1000:lfsck_namespace.0 Request processed in 46us (83us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774779.079325:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3496 00000100:00100000:1.0:1785774779.079342:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.079352:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175424:0@lo:1000:lfsck_namespace.0 00000020:00080000:0.0:1785774779.080585:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 391 committed batchid 390 00000020:00080000:0.0:1785774779.080672:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 390 00000004:00080000:3.0:1785774779.089083:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000004:00080000:3.0:1785774779.089114:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00000004:00080000:1.0:1785774779.101865:0:20646:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605f8bb40 with version 0 00000020:00100000:1.0:1785774779.101920:0:20646:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774779.101934:0:20646:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7604e00380 x1872519671175680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774779.101961:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175680:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.108972:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.109039:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671175680 00000100:00100000:1.0:1785774779.109047:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671175680 00000100:00100000:1.0:1785774779.109095:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3497 00000100:00100000:1.0:1785774779.109103:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671175680:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.109632:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b780 going to sleep for 11 seconds 00000001:00080000:3.0:1785774779.129125:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983480 is committed 00000100:00100000:0.0:1785774779.129729:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671175680:12345-0@lo:1000:lfsck_namespace.0 Request processed in 20619us (20758us total) trans 4294983480 rc 0/0 00000100:00100000:0.0:1785774779.129754:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3497 00000004:00080000:3.0:1785774779.130441:0:20646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983480 committed transno 4294983480 00000100:00100000:3.0:1785774779.130448:0:20646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983480 gen 2 00000100:00100000:3.0:1785774779.130472:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00380 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175680:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1785774779.130514:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1800/0x7b7109e1d09df78 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df7f expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.130527:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1800/0x7b7109e1d09df78 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x6be685ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df7f expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.130535:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1c00/0x7b7109e1d09df6a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df71 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.130541:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef1c00/0x7b7109e1d09df6a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df71 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1785774779.130547:0:20646:0:(lfsck_namespace.c:1662:lfsck_namespace_create_orphan_dir()) lustre-MDT0001-osd: namespace LFSCK create orphan dir for the object [0x200000402:0x1437:0x0], name = [0x200000402:0x1437:0x0]-P-0: rc = 1 00010000:00010000:3.0:1785774779.130616:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09df86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.130624:0:20646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09df86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.130635:0:20646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09df86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.130659:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175808:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1785774779.130705:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.130750:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774779.131708:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671175808 00000100:00100000:0.0:1785774779.131719:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671175808 00000100:00100000:0.0:1785774779.131776:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498 00000100:00100000:0.0:1785774779.131786:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:20646:x1872519671175808:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1785774779.131811:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774779.131832:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744e00/0x7b7109e1d09df8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09df86 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.131868:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744e00/0x7b7109e1d09df8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09df86 expref: 11 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.131882:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744e00/0x7b7109e1d09df8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09df86 expref: 11 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.131891:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1437:0x0].0x0 (ffff9b7605dfd500) 00010000:00010000:0.0:1785774779.131894:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774779.131897:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744e00, rc 0) 00000100:00100000:0.0:1785774779.131937:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:20646:x1872519671175808:12345-0@lo:101:lfsck_namespace.0 Request processed in 153us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774779.131984:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498 00000100:00100000:3.0:1785774779.133784:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175808:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1785774779.133812:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09df86 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df8d expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.133826:0:20646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09df86 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09df8d expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774779.133850:0:20646:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1437:0x0] 00010000:00010000:3.0:1785774779.133893:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1200/0x7b7109e1d09df94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.133901:0:20646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1200/0x7b7109e1d09df94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.133910:0:20646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1200/0x7b7109e1d09df94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.133927:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175936:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1785774779.133976:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.134019:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.134050:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671175936 00000100:00100000:3.0:1785774779.134056:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671175936 00000100:00100000:3.0:1785774779.134110:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3499 00000100:00100000:3.0:1785774779.134117:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:20646:x1872519671175936:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1785774779.134135:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774779.134400:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09df9b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09df94 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.134478:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09df9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09df94 expref: 12 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.134492:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0a00/0x7b7109e1d09df9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09df94 expref: 12 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.134500:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1437:0x0].0x4205a542 (ffff9b7605fd8000) 00010000:00010000:3.0:1785774779.134503:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:3.0:1785774779.134506:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0a00, rc 0) 00000100:00100000:3.0:1785774779.134540:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20646:x1872519671175936:12345-0@lo:101:lfsck_namespace.0 Request processed in 423us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.134549:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3499 00000100:00100000:3.0:1785774779.134578:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671175936:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1785774779.134588:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1200/0x7b7109e1d09df94 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df9b expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.134596:0:20646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1200/0x7b7109e1d09df94 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09df9b expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774779.134606:0:20646:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1437:0x0] 00000100:00100000:3.0:1785774779.134686:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671176064:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.134712:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.134728:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.134743:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671176064 00000100:00100000:3.0:1785774779.134746:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671176064 00000100:00100000:3.0:1785774779.134766:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3500 00000100:00100000:3.0:1785774779.134771:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20646:x1872519671176064:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.134840:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20646:x1872519671176064:12345-0@lo:1000:lfsck_namespace.0 Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.134847:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3500 00000100:00100000:3.0:1785774779.134866:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671176064:0@lo:1000:lfsck_namespace.0 00000004:00080000:3.0:1785774779.135022:0:20646:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7711076300 with version 0 00000020:00100000:3.0:1785774779.135035:0:20646:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774779.138763:0:20646:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760605d500 x1872519671176320/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774779.138801:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671176320:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.139038:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.139094:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.139121:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671176320 00000100:00100000:3.0:1785774779.139130:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671176320 00000100:00100000:3.0:1785774779.139879:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3501 00000100:00100000:3.0:1785774779.139891:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:20646:x1872519671176320:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.140120:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:20646:x1872519671176320:12345-0@lo:1000:lfsck_namespace.0 Request processed in 231us (1081us total) trans 4294983481 rc 0/0 00000100:00100000:3.0:1785774779.140129:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3501 00000100:00100000:1.0:1785774779.148108:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671176448 00000100:00100000:1.0:1785774779.148123:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671176448 00000100:00100000:1.0:1785774779.148215:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502 00000100:00100000:1.0:1785774779.148228:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20646:x1872519671176448:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.148416:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20646:x1872519671176448:12345-0@lo:1000:lfsck_namespace.0 Request processed in 190us (3188us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.148425:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502 00000004:00080000:0.0:1785774779.164334:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 750 rpc_version 750 00000020:00100000:0.0:1785774779.164407:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774779.164428:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c1500 x1872519671176704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774779.164458:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671176704:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774779.164544:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774779.164606:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.170494:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671176704 00000100:00100000:3.0:1785774779.170512:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671176704 00000100:00100000:3.0:1785774779.170589:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503 00000100:00100000:3.0:1785774779.170600:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7474:x1872519671176704:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1785774779.174181:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774779.175724:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671176704:12345-0@lo:1000:osp_up0-1.0 Request processed in 5115us (11168us total) trans 4294983482 rc 0/0 00000100:00100000:3.0:1785774779.175741:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503 00000100:00100000:1.0:1785774779.179404:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671176704:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1785774779.180731:0:20646:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b77110769c0 with version 0 00000020:00100000:3.0:1785774779.180769:0:20646:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774779.180780:0:20646:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760605ce00 x1872519671176960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 408/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774779.180809:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671176960:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.180896:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.180982:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.181029:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671176960 00000100:00100000:1.0:1785774779.181038:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671176960 00000100:00100000:1.0:1785774779.181114:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504 00000100:00100000:1.0:1785774779.181123:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:20646:x1872519671176960:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.181364:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671176960:12345-0@lo:1000:lfsck_namespace.0 Request processed in 240us (467us total) trans 4294983483 rc 0/0 00000100:00100000:1.0:1785774779.181373:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504 00000100:00100000:3.0:1785774779.185058:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671176960:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1785774779.185100:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1200/0x7b7109e1d09df94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df9b expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.185113:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1200/0x7b7109e1d09df94 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1437:0x0].0x4205a542 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df9b expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.185121:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09df86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df8d expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.185126:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1400/0x7b7109e1d09df86 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1437:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09df8d expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1785774779.185134:0:20646:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000401:0x58:0x0] with the name [0x240000401:0x58:0x0]:1 and type 40000 to the parent [0x200000402:0x1437:0x0]: rc = 1 00000100:00100000:3.0:1785774779.186206:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa82300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671177088:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.188188:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.188243:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.192798:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671177216 00000100:00100000:3.0:1785774779.192805:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671177216 00000100:00100000:3.0:1785774779.192843:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3506 00000100:00100000:3.0:1785774779.192850:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671177216:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.192924:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671177216:12345-0@lo:1000:lfsck_namespace.0 Request processed in 74us (705us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774779.192931:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3506 00000100:00100000:3.0:1785774779.202861:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671177344 00000100:00100000:3.0:1785774779.202878:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671177344 00000100:00100000:3.0:1785774779.202958:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3507 00000100:00100000:3.0:1785774779.202968:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671177344:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.203153:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671177344:12345-0@lo:1000:lfsck_namespace.0 Request processed in 186us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.203179:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507 00000100:00100000:3.0:1785774779.208065:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671177472 00000100:00100000:3.0:1785774779.208075:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671177472 00000100:00100000:3.0:1785774779.208136:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508 00000100:00100000:3.0:1785774779.208153:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671177472:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1785774779.208196:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774779.208219:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dfb0 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dfa9 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.208250:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dfa9 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.208283:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfa9 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.208291:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:3.0:1785774779.208294:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774779.208298:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774779.208353:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671177472:12345-0@lo:101:lfsck_namespace.0 Request processed in 202us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.208361:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508 00010000:00010000:3.0:1785774779.234665:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.234681:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.234689:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.234694:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1785774779.234702:0:20646:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000402:0xd8:0x0] with the name subdir221 and type 40000 to the parent [0x200000400:0x5:0x0]: rc = 1 00000100:00100000:3.0:1785774779.234933:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671177984:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.235018:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.237231:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.244657:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671177984:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.244873:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178112:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.244938:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.244982:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad240 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.258778:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.272048:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178240:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.273574:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178368:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.273655:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.273722:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.285523:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178368:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1785774779.285597:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.285618:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.285638:0:20646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.285731:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178496:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.285783:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.286153:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774779.291366:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671178496 00000100:00100000:0.0:1785774779.291383:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671178496 00000100:00100000:0.0:1785774779.291464:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3515 00000100:00100000:0.0:1785774779.291474:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20646:x1872519671178496:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1785774779.291661:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20646:x1872519671178496:12345-0@lo:1000:lfsck_namespace.0 Request processed in 189us (5878us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774779.291673:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3515 00000100:00100000:1.0:1785774779.293728:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178496:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1785774779.293773:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.293784:0:20646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.293793:0:20646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.293799:0:20646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774779.293803:0:20646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.296490:0:20646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.297348:0:20646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2d:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:1.0:1785774779.297354:0:20646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1785774779.297363:0:20646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.297373:0:20646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfc5 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.301638:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178624:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.301738:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.301793:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.311488:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178624:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1785774779.315732:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.315758:0:20646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.315773:0:20646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.315805:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178752:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1785774779.315903:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.323337:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671178752 00000100:00100000:1.0:1785774779.323357:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671178752 00000100:00100000:1.0:1785774779.323443:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517 00000100:00100000:1.0:1785774779.323456:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:20646:x1872519671178752:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1785774779.323484:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774779.323512:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dfcc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.323552:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09df40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09df39 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.323565:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.323614:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09df40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09df39 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.323632:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671178880:0@lo:104: 00000100:00100000:1.0:1785774779.323715:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.323777:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.323793:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.334491:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671178880 00000100:00100000:3.0:1785774779.334511:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671178880 00000100:00100000:3.0:1785774779.334585:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1785774779.334596:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6535:x1872519671178880:12345-0@lo:104: 00010000:00010000:3.0:1785774779.334622:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09df39 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09df40 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.334752:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774779.334758:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6535:x1872519671178880:12345-0@lo:104: Request processed in 165us (11043us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.334768:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00010000:00010000:3.0:1785774779.334813:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774779.334820:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09df39 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09df40 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.334830:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774779.334835:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09df39 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7b7109e1d09df40 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.334846:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09df39 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09df40 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.334884:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09df39 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09df40 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.334897:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774779.334920:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09df39 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09df40 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.334928:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ac00/0x7b7109e1d09df39 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09df40 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.334938:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774779.334940:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774779.334941:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774779.334957:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671179008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774779.334995:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.335177:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671178880:0@lo:104: 00010000:00010000:1.0:1785774779.335211:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.335224:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:1.0:1785774779.335227:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774779.335232:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.335244:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0000, rc 0) 00000100:00100000:1.0:1785774779.335296:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:20646:x1872519671178752:12345-0@lo:101:lfsck_namespace.0 Request processed in 11844us (19396us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.335303:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517 00000100:00100000:1.0:1785774779.335341:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671178752:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1785774779.335358:0:20646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.335370:0:20646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.335519:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671179008 00000100:00100000:3.0:1785774779.335524:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671179008 00010000:00010000:3.0:1785774779.335546:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09df40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09df39 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.335572:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:3.0:1785774779.335578:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+19:3656:x1872519671179008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774779.335589:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1785774779.357905:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983484 is committed 00010000:00010000:3.0:1785774779.358019:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09df40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x23/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09df39 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358046:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:3.0:1785774779.358053:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358073:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358084:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358142:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.358186:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671179136:0@lo:105: 00000100:00100000:3.0:1785774779.358271:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.358323:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.358347:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671179136 00000100:00100000:3.0:1785774779.358355:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671179136 00000100:00100000:3.0:1785774779.358422:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1785774779.358433:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671179136:12345-0@lo:105: 00010000:00010000:3.0:1785774779.358446:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 5/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358458:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 5/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358467:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 5/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358476:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358485:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358493:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.358517:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ef0c00) 00000100:00100000:3.0:1785774779.358559:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671179136:12345-0@lo:105: Request processed in 128us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.358568:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1785774779.358611:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671179136:0@lo:105: 00010000:00010000:3.0:1785774779.358630:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774779.358661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3656:x1872519671179008:12345-0@lo:103:ldlm_bl.0 Request processed in 23083us (23666us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.358670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:3.0:1785774779.358706:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671179008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774779.366306:0:20646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.366330:0:20646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774779.366366:0:20646:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x13e5:0x0] 00010000:00010000:1.0:1785774779.366443:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09dfda lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x656258bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.366451:0:20646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09dfda lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x656258bb bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.366464:0:20646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09dfda lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x656258bb bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.366492:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179264:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1785774779.366566:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.366618:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.373012:0:20646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983484 gen 2 00000004:00080000:1.0:1785774779.373030:0:20646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983481 committed transno 4294983484 00000004:00080000:1.0:1785774779.373059:0:20646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983482 committed transno 4294983484 00000004:00080000:1.0:1785774779.373092:0:20646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983483 committed transno 4294983484 00000004:00080000:1.0:1785774779.373107:0:20646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983484 committed transno 4294983484 00000100:00100000:1.0:1785774779.373134:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179264:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1785774779.373525:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09dfda lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x656258bb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfe1 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.373548:0:20646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09dfda lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x656258bb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dfe1 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774779.373569:0:20646:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x13e5:0x0] 00000100:00100000:1.0:1785774779.373679:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179392:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.373761:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.373806:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.381822:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671179392 00000100:00100000:3.0:1785774779.381841:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671179392 00000100:00100000:3.0:1785774779.381945:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519 00000100:00100000:3.0:1785774779.381956:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671179392:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.382136:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671179392:12345-0@lo:1000:lfsck_namespace.0 Request processed in 181us (8374us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.382176:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519 00000100:00100000:1.0:1785774779.384889:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179392:0@lo:1000:lfsck_namespace.0 00000040:00080000:1.0:1785774779.385242:0:20646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].395, 576 off597624 00000040:00080000:1.0:1785774779.385287:0:20646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].394, 576 off643400 00000004:00080000:1.0:1785774779.385293:0:20646:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605f8b300 with version 752 00000004:00080000:3.0:1785774779.386225:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 752 rpc_version 752 00000020:00100000:3.0:1785774779.386267:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774779.386288:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605f03b80 x1872519671179648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774779.386318:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671179648:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774779.386405:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.386437:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.393509:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671179648:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1785774779.396339:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09dfda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x656258bb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfe1 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.396360:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0a00/0x7b7109e1d09dfda lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x656258bb bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfe1 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.396368:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.396374:0:20646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:1.0:1785774779.396381:0:20646:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000401:0x2d:0x0] with the name [0x240000401:0x2d:0x0]:1 and type 40000 to the parent [0x200000402:0x13e5:0x0]: rc = 1 00000100:00100000:1.0:1785774779.396558:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179776:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.396635:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.396671:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.401475:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671179776 00000100:00100000:3.0:1785774779.401492:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671179776 00000100:00100000:3.0:1785774779.401562:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3521 00000100:00100000:3.0:1785774779.401572:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671179776:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.401748:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671179776:12345-0@lo:1000:lfsck_namespace.0 Request processed in 178us (5113us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774779.401755:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3521 00000100:00100000:1.0:1785774779.406936:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179776:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.407134:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179904:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.408784:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.408824:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.413881:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671179904:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.414077:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180032:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.414247:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.414381:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.428924:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180032 00000100:00100000:3.0:1785774779.428948:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180032 00000100:00100000:3.0:1785774779.429048:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523 00000100:00100000:3.0:1785774779.429062:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180032:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.429315:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180032:12345-0@lo:1000:lfsck_namespace.0 Request processed in 255us (15067us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774779.429323:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523 00000100:00100000:1.0:1785774779.432934:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180032:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.433156:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180160:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.433259:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.433378:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.433418:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180160 00000100:00100000:1.0:1785774779.433426:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180160 00000100:00100000:1.0:1785774779.433480:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3524 00000100:00100000:1.0:1785774779.433492:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180160:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.433617:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180160:12345-0@lo:1000:lfsck_namespace.0 Request processed in 126us (357us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774779.433627:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3524 00000100:00100000:1.0:1785774779.433664:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180160:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1785774779.433712:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.433740:0:20646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.433755:0:20646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.433793:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180288:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.433821:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774779.433834:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8b900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.436109:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180288 00000100:00100000:3.0:1785774779.436122:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180288 00000100:00100000:3.0:1785774779.436214:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525 00000100:00100000:3.0:1785774779.436224:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180288:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.436439:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180288:12345-0@lo:1000:lfsck_namespace.0 Request processed in 216us (2616us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774779.436451:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525 00000100:00100000:3.0:1785774779.436499:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180288:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1785774779.436530:0:20646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436541:0:20646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436549:0:20646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436557:0:20646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774779.436561:0:20646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436570:0:20646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436587:0:20646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:3.0:1785774779.436590:0:20646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1785774779.436595:0:20646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436602:0:20646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09dfe8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.436666:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180416:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.436703:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.436722:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.436735:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180416 00000100:00100000:3.0:1785774779.436739:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180416 00000100:00100000:3.0:1785774779.436758:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526 00000100:00100000:3.0:1785774779.436763:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180416:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1785774779.436819:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180416:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.436826:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526 00000100:00100000:3.0:1785774779.436851:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180416:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1785774779.436906:0:20646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 20646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436915:0:20646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.436927:0:20646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 20646 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.436938:0:20646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180544:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1785774779.436961:0:20646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.436974:0:20646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.436984:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180544 00000100:00100000:3.0:1785774779.436987:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180544 00000100:00100000:3.0:1785774779.437006:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3527 00000100:00100000:3.0:1785774779.437011:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671180544:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1785774779.437021:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774779.437036:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dfef expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.437060:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dfb0 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfa9 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.437071:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 4/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.437092:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09dfa9 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.437103:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671180672:0@lo:104: 00000100:00100000:3.0:1785774779.437128:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.437153:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.437188:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180672 00000100:00100000:3.0:1785774779.437191:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180672 00000100:00100000:3.0:1785774779.437214:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1785774779.437219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6535:x1872519671180672:12345-0@lo:104: 00010000:00010000:3.0:1785774779.437230:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.437267:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774779.443634:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6535:x1872519671180672:12345-0@lo:104: Request processed in 6405us (6495us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.443653:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1785774779.443754:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671180672:0@lo:104: 00010000:00010000:3.0:1785774779.443789:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 3/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.443802:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:3.0:1785774779.443805:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774779.443810:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 3/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.443821:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774779.443914:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:20646:x1872519671180544:12345-0@lo:101:lfsck_namespace.0 Request processed in 6902us (6952us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.443921:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3527 00010000:00010000:3.0:1785774779.443943:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774779.443950:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.443959:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774779.443963:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.443973:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.444011:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.444017:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774779.444041:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.444049:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09dfa9 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfb0 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.444060:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774779.444063:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774779.444065:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774779.444085:0:20646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20646:1872519671180544:0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1785774779.444100:0:20646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 4/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774779.444110:0:20646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 4/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774779.444129:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774779.445246:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671180800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774779.445403:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774779.455038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180800 00000100:00100000:0.0:1785774779.455061:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180800 00010000:00010000:0.0:1785774779.455114:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dfb0 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09dfa9 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774779.455195:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1785774779.455203:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3654:x1872519671180800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774779.455223:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774779.477430:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09dfb0 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09dfa9 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.477458:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:0.0:1785774779.477464:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.477476:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.477485:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774779.477670:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774779.477692:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6516:1872519671180928:0@lo:105: 00000100:00100000:0.0:1785774779.483004:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1785774779.483041:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671180928 00000100:00100000:0.0:1785774779.483052:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671180928 00000100:00100000:0.0:1785774779.483121:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1785774779.483135:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602392c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6516:x1872519671180928:12345-0@lo:105: 00010000:00010000:0.0:1785774779.483181:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 5/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.483195:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 5/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.483206:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 5/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.483216:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 5/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.483224:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 6/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.483233:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 6/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.483263:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec0000) 00000100:00100000:0.0:1785774779.483382:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602392c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6516:x1872519671180928:12345-0@lo:105: Request processed in 253us (5543us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774779.483398:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1785774779.487347:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671180800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774779.487673:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671181056 00000100:00100000:0.0:1785774779.487680:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671181056 00000100:00100000:0.0:1785774779.487745:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3528 00000100:00100000:0.0:1785774779.487843:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:20646:x1872519671181056:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1785774779.487863:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774779.487880:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e004 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09dffd expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.487905:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e004 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09dffd expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.487920:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e004 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dffd expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774779.487938:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x51102365 (ffff9b7605dfd900) 00010000:00010000:0.0:1785774779.487941:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:0.0:1785774779.487945:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744a00, rc 0) 00000100:00100000:0.0:1785774779.487988:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:20646:x1872519671181056:12345-0@lo:101:lfsck_namespace.0 Request processed in 149us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774779.487995:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3528 00000004:00080000:0.0:1785774779.493355:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 753 rpc_version 753 00000020:00100000:0.0:1785774779.493422:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774779.493434:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c3480 x1872519671181312/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1472/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774779.493461:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671181312:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774779.493534:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774779.493570:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774779.493599:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671181312 00000100:00100000:3.0:1785774779.493614:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671181312 00000100:00100000:3.0:1785774779.493695:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3529 00000100:00100000:3.0:1785774779.493706:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:7474:x1872519671181312:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774779.494418:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:7474:x1872519671181312:12345-0@lo:1000:osp_up0-1.0 Request processed in 713us (882us total) trans 4294983486 rc 0/0 00000100:00100000:3.0:1785774779.494442:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3529 00000100:00100000:1.0:1785774779.494586:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671181312:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774779.494961:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671181440 00000100:00100000:1.0:1785774779.494969:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671181440 00000100:00100000:1.0:1785774779.495007:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3530 00000100:00100000:1.0:1785774779.495013:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:20646:x1872519671181440:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1785774779.495116:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:20646:x1872519671181440:12345-0@lo:1000:lfsck_namespace.0 Request processed in 103us (202us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774779.495137:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3530 00000004:00080000:1.0:1785774779.497645:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:1.0:1785774779.497664:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000020:00080000:1.0:1785774779.497686:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605f8b3c0 refcount 2 committed 0 result 0 batchid 396 00000020:00080000:1.0:1785774779.497691:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605f8b300 00000020:00080000:1.0:1785774779.497695:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].394 00000020:00080000:1.0:1785774779.497698:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7719898e00 00000020:00080000:1.0:1785774779.497700:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].395 00000020:00080000:1.0:1785774779.497709:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605ce4e40 refcount 2 committed 0 result 0 batchid 395 00000020:00080000:1.0:1785774779.497712:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fcc00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ce4480 00000020:00080000:1.0:1785774779.497714:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].393 00000020:00080000:1.0:1785774779.497716:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fc000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603619e00 00000020:00080000:1.0:1785774779.497718:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].394 00000020:00080000:1.0:1785774779.497723:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7711076600 refcount 2 committed 0 result 0 batchid 394 00000020:00080000:1.0:1785774779.497725:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347ce00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77110769c0 00000020:00080000:1.0:1785774779.497727:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347cb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ecfc00 00000020:00080000:1.0:1785774779.497731:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605ce4300 refcount 2 committed 0 result 0 batchid 393 00000020:00080000:1.0:1785774779.497733:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fcb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ce4000 00000020:00080000:1.0:1785774779.497735:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].392 00000020:00080000:1.0:1785774779.497737:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fc200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603619c00 00000020:00080000:1.0:1785774779.497739:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].393 00000020:00080000:1.0:1785774779.497743:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7711076d80 refcount 2 committed 0 result 0 batchid 392 00000020:00080000:1.0:1785774779.497745:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347cd00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7711076300 00000020:00080000:1.0:1785774779.497747:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347cf00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ecf000 00000020:00080000:1.0:1785774779.497751:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 391 batchid updated 00000001:00080000:1.0:1785774779.497761:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968415 is committed 00000020:00080000:0.0:1785774779.497997:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 396 committed batchid 391 00000004:00080000:0.0:1785774779.498130:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7603f39180 with version 754 00000020:00080000:0.0:1785774779.498535:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 391 cancel update log [0x200000401:0x3:0x0].391: rc = 0 00000020:00080000:0.0:1785774779.498585:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 391 cancel update log [0x240000400:0x3:0x0].392: rc = 0 00000020:00080000:0.0:1785774779.498592:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 391 00000004:00080000:3.0:1785774779.498634:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 754 rpc_version 754 00000020:00100000:3.0:1785774779.498669:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774779.498678:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605f01c00 x1872519671181696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774779.498701:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671181696:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774779.498762:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.498797:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774779.500178:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671181696 00000100:00100000:1.0:1785774779.500189:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671181696 00000100:00100000:1.0:1785774779.500256:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531 00000100:00100000:1.0:1785774779.500265:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:7474:x1872519671181696:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774779.500571:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:7474:x1872519671181696:12345-0@lo:1000:osp_up0-1.0 Request processed in 307us (1808us total) trans 4294983487 rc 0/0 00000100:00100000:1.0:1785774779.500579:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531 00000100:00100000:3.0:1785774779.500679:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671181696:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774779.556436:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671181824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774779.556527:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.556778:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671182080:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.556812:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.556829:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671182592:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.556849:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.556861:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671183104:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.556877:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.556890:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1785774779.556895:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671181952:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.556918:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.556934:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671182464:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.556949:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.556962:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671182976:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.556978:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.557002:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182080 00000100:00100000:3.0:1785774779.557010:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182080 00000100:00100000:3.0:1785774779.557070:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182464 00000100:00100000:3.0:1785774779.557073:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182464 00000100:00100000:3.0:1785774779.557097:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182976 00000100:00100000:3.0:1785774779.557099:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182976 00000100:00100000:3.0:1785774779.557114:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1785774779.557121:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671182080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557190:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671182080:12345-0@lo:400:kworker.0 Request processed in 68us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.557201:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1785774779.557217:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1785774779.557222:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671182464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557244:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671182464:12345-0@lo:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.557250:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1785774779.557257:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1785774779.557262:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671182976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557439:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671182976:12345-0@lo:400:kworker.0 Request processed in 175us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.557446:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1785774779.557474:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671182336:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557497:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.557518:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671182848:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557536:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.557549:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1785774779.557554:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671182208:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557569:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.557580:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671182720:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557596:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.557608:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671183232:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774779.557641:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182336 00000100:00100000:3.0:1785774779.557644:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182336 00000100:00100000:3.0:1785774779.557667:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182848 00000100:00100000:3.0:1785774779.557669:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182848 00000100:00100000:3.0:1785774779.557678:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182208 00000100:00100000:3.0:1785774779.557680:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182208 00000100:00100000:3.0:1785774779.557690:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1785774779.557695:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671182336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557724:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671182336:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.557729:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1785774779.557738:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1785774779.557743:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671182848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557762:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671182848:12345-0@lo:400:kworker.0 Request processed in 20us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.557768:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1785774779.557776:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1785774779.557780:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671182208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557799:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671182208:12345-0@lo:400:kworker.0 Request processed in 19us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774779.557803:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1785774779.557837:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671182464:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557846:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671182976:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557854:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671182080:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557879:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671182208:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557886:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671182336:0@lo:400:kworker.0 00000100:00100000:3.0:1785774779.557894:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671182848:0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.557992:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182592 00000100:00100000:1.0:1785774779.557996:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182592 00000100:00100000:1.0:1785774779.558031:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671183104 00000100:00100000:1.0:1785774779.558034:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671183104 00000100:00100000:1.0:1785774779.558067:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671182720 00000100:00100000:1.0:1785774779.558070:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671182720 00000100:00100000:1.0:1785774779.558093:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671183232 00000100:00100000:1.0:1785774779.558095:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671183232 00000100:00100000:1.0:1785774779.558117:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1785774779.558125:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671182592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558185:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671182592:12345-0@lo:400:kworker.0 Request processed in 62us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.558192:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1785774779.558203:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1785774779.558208:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671183104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558230:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671183104:12345-0@lo:400:kworker.0 Request processed in 23us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.558235:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1785774779.558243:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1785774779.558247:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671182720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558283:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671182720:12345-0@lo:400:kworker.0 Request processed in 35us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.558289:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1785774779.558300:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1785774779.558307:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671183232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558333:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671183232:12345-0@lo:400:kworker.0 Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.558339:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1785774779.558362:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671181952 00000100:00100000:1.0:1785774779.558365:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671181952 00000100:00100000:1.0:1785774779.558397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1785774779.558403:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671181952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558430:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671181952:12345-0@lo:400:kworker.0 Request processed in 28us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.558435:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:1.0:1785774779.558461:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774779.558466:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774779.558468:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774779.558503:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671181824 00000100:00100000:1.0:1785774779.558506:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671181824 00000100:00100000:1.0:1785774779.558529:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532 00000100:00100000:1.0:1785774779.558535:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671181824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774779.558566:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445007360 avail 1298767872 00000100:00100000:1.0:1785774779.558602:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671181824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774779.558608:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532 00000100:00100000:1.0:1785774779.558634:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671181952:0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558646:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671182592:0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558653:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671183104:0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558674:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671182720:0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558682:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671183232:0@lo:400:kworker.0 00000100:00100000:1.0:1785774779.558691:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968415 gen 2 00000004:00080000:1.0:1785774779.558696:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968414 committed transno 4294968415 00000004:00080000:1.0:1785774779.558709:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968415 committed transno 4294968415 00000100:00100000:1.0:1785774779.558721:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671181824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774779.560153:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671183360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774779.560234:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774779.560400:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671183360 00000100:00100000:0.0:1785774779.560409:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671183360 00000100:00100000:0.0:1785774779.560458:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1785774779.560468:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671183360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1785774779.560504:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774779.560553:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671183360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774779.560562:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1785774779.562228:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671183360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774780.074374:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671183488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774780.074478:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774780.087493:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671183488 00000100:00100000:3.0:1785774780.087512:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671183488 00000100:00100000:3.0:1785774780.087598:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1785774780.087611:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671183488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774780.087647:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774780.087747:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671183488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (13269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774780.087755:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1785774780.087814:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671183488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774780.198506:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774781.221106:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774782.247061:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774782.629670:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774782.629703:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671183616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774782.629811:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774782.630094:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671183616 00000100:00100000:1.0:1785774782.630105:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671183616 00000100:00100000:1.0:1785774782.630195:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3533 00000100:00100000:1.0:1785774782.630205:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:3655:x1872519671183616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774782.630349:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443942400 avail 1297702912 00000100:00100000:1.0:1785774782.630422:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:3655:x1872519671183616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 218us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774782.630430:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3533 00000100:00100000:1.0:1785774782.630482:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671183616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774782.666436:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774782.666707:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648433024 00000100:00100000:0.0:1785774782.666719:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648433024 00000100:00100000:0.0:1785774782.666807:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23630 00000100:00100000:0.0:1785774782.666817:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:17767:x1872519648433024:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774782.666843:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774782.666867:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e00b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.666936:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09e012 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.666952:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.666961:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09e012 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.667003:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774782.667020:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671183744:0@lo:104: 00000100:00100000:0.0:1785774782.667074:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774782.667121:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774782.667756:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671183744 00000100:00100000:3.0:1785774782.667762:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671183744 00000100:00100000:3.0:1785774782.667810:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1785774782.667817:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6530:x1872519671183744:12345-0@lo:104: 00010000:00010000:3.0:1785774782.667832:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.667888:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774782.667894:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6530:x1872519671183744:12345-0@lo:104: Request processed in 78us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774782.667901:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1785774782.667940:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671183744:0@lo:104: 00010000:00010000:3.0:1785774782.667960:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09e012 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.667980:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774782.667985:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.667993:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774782.667997:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.668005:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.668043:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.668049:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774782.668071:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.668077:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0000/0x7b7109e1d09dfef lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dff6 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774782.668092:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774782.668094:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774782.668095:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774782.668106:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671183872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774782.668135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774782.668197:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671183872 00000100:00100000:3.0:1785774782.668202:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671183872 00010000:00010000:3.0:1785774782.668221:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09dff6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09dfef expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785774782.668287:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774782.668453:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:3.0:1785774782.668461:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+18:3653:x1872519671183872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774782.668473:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1785774782.692253:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983487 is committed 00000100:00100000:1.0:1785774782.692971:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671183872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774782.693102:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09e012 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.693113:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09e012 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774782.693217:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1785774782.693232:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785774782.693397:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e00b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb33 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.693433:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09e012 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb33 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.693443:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774782.693446:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774782.693449:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:1.0:1785774782.693522:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17767:x1872519648433024:12345-192.168.202.31@tcp:101:ls.0 Request processed in 26707us (27097us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774782.693530:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23630 00000100:00100000:0.0:1785774782.706716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774782.706774:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648433152 00000100:00100000:0.0:1785774782.706787:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648433152 00000100:00100000:0.0:1785774782.706874:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23631 00000100:00100000:0.0:1785774782.706886:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:17767:x1872519648433152:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774782.707018:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774782.707048:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09e019 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb3a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.707122:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09e020 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.707137:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09e020 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.707153:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09e020 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774782.707294:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1785774782.707300:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1785774782.707380:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09e019 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb3a expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.707400:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09e020 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb3a expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.707409:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:0.0:1785774782.707412:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774782.707416:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745e00, rc 0) 00000100:00100000:0.0:1785774782.707490:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17767:x1872519648433152:12345-192.168.202.31@tcp:101:ls.0 Request processed in 607us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774782.707499:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23631 00000100:00080000:0.0:1785774782.708812:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774782.743188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774782.748859:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648433280 00000100:00100000:3.0:1785774782.748874:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648433280 00000100:00100000:3.0:1785774782.748951:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5013 00000100:00100000:3.0:1785774782.748962:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17767:x1872519648433280:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:3.0:1785774782.760186:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17767:x1872519648433280:12345-192.168.202.31@tcp:37:ls.0 Request processed in 11184us (16995us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774782.760471:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5013 00000100:00100000:3.0:1785774782.772129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774782.780451:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731e1c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:17767:x1872519648433408:12345-192.168.202.31@tcp:37:ls.0 Request processed in 7788us (8321us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774782.780469:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5014 00000100:00100000:1.0:1785774782.804451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774782.804498:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648433664 00000100:00100000:1.0:1785774782.804510:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648433664 00000100:00100000:1.0:1785774782.804586:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23632 00000100:00100000:1.0:1785774782.804596:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17767:x1872519648433664:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774782.804623:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774782.804648:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e027 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb41 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.804874:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.804892:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.804905:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.804927:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.804934:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.804941:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774782.805092:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1441:0x0]: returning size 4096 00010000:00010000:1.0:1785774782.806453:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.806467:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.806473:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.806481:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.806487:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774782.806491:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.806500:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.806516:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774782.806520:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774782.809874:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809896:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e02e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809918:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809925:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809933:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809939:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774782.809943:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809952:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809970:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x4fa399f7 (ffff9b7712d15c00) 00010000:00010000:1.0:1785774782.809974:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774782.809978:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.809985:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e035 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.810059:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e027 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb41 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.810076:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774782.810079:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774782.810083:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e027 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb41 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774782.810092:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1000, rc 0) 00000100:00100000:1.0:1785774782.810212:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17767:x1872519648433664:12345-192.168.202.31@tcp:101:ls.0 Request processed in 5615us (5773us total) trans 4294983488 rc 301/301 00000100:00100000:1.0:1785774782.810223:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23632 00000100:00100000:3.0:1785774782.827038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774782.832512:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648433792 00000100:00100000:0.0:1785774782.832541:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648433792 00000100:00100000:0.0:1785774782.832625:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23633 00000100:00100000:0.0:1785774782.832636:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17767:x1872519648433792:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774782.832666:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774782.832701:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e043 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1441:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb48 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.833047:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09e04a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.833067:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09e04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.833081:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09e04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774782.833215:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1441:0x0]: returning size 4096 00000004:00200000:0.0:1785774782.833221:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1785774782.833249:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09e04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.833276:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e043 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1441:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb48 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.833293:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09e04a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb48 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.833303:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1441:0x0].0x0 (ffff9b7605dfd600) 00010000:00010000:0.0:1785774782.833306:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774782.833310:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745c00, rc 0) 00000100:00100000:0.0:1785774782.833395:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17767:x1872519648433792:12345-192.168.202.31@tcp:101:ls.0 Request processed in 760us (6369us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774782.833402:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23633 00000100:00100000:0.0:1785774782.852485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774782.852544:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648433920 00000100:00100000:0.0:1785774782.852557:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648433920 00000100:00100000:0.0:1785774782.852627:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23634 00000100:00100000:0.0:1785774782.852637:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17767:x1872519648433920:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774782.852664:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774782.852706:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e051 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb4f expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.852790:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.852806:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.852818:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774782.852874:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5c:0x0]: returning size 4096 00000004:00200000:0.0:1785774782.852879:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1785774782.852916:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e051 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.852933:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774782.852940:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5c:0x0].0x0 (ffff9b7605dfde00) 00010000:00010000:0.0:1785774782.852943:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774782.852946:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745a00, rc 0) 00000100:00100000:0.0:1785774782.853007:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17767:x1872519648433920:12345-192.168.202.31@tcp:101:ls.0 Request processed in 372us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774782.853018:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23634 00000100:00100000:0.0:1785774782.864226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774782.865491:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648434048 00000100:00100000:3.0:1785774782.865504:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648434048 00000100:00100000:3.0:1785774782.910450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774782.910952:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648434176 00000100:00100000:0.0:1785774782.910965:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648434176 00000100:00100000:0.0:1785774782.911024:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5015 00000100:00100000:0.0:1785774782.911034:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17767:x1872519648434176:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:0.0:1785774782.921558:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17767:x1872519648434176:12345-192.168.202.31@tcp:37:ls.0 Request processed in 10513us (11109us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774782.921575:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5015 00000100:00100000:3.0:1785774782.943925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774782.944334:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648434304 00000100:00100000:1.0:1785774782.944346:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648434304 00000100:00100000:1.0:1785774782.944425:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5016 00000100:00100000:1.0:1785774782.944437:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:17767:x1872519648434304:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:1.0:1785774782.969998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774782.970551:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648434560 00000100:00100000:3.0:1785774782.970564:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648434560 00000100:00100000:3.0:1785774782.970639:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5017 00000100:00100000:3.0:1785774782.970652:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17767:x1872519648434560:12345-192.168.202.31@tcp:35:ls.0 00000040:00080000:3.0:1785774782.971426:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].378, 344 off578376 00000040:00080000:3.0:1785774782.971490:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].378, 424 off631896 00000004:00080000:3.0:1785774782.971496:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b77093adc00 with version 720 00000100:00100000:1.0:1785774782.989551:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671184128 00000100:00100000:1.0:1785774782.989572:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671184128 00000100:00100000:1.0:1785774782.989670:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534 00000100:00100000:1.0:1785774782.989683:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7689:x1872519671184128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774782.990020:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671184128:12345-0@lo:1000:osp_up1-0.0 Request processed in 339us (5280us total) trans 4294968416 rc 0/0 00000100:00100000:1.0:1785774782.990029:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534 00000100:00100000:3.0:1785774782.997325:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735944380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671184128:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774782.998636:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17767:x1872519648434560:12345-192.168.202.31@tcp:35:ls.0 Request processed in 27981us (28647us total) trans 4294983489 rc 0/0 00000100:00100000:1.0:1785774782.998649:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5017 00000100:00100000:0.0:1785774783.012459:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774783.012540:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648434816 00000100:00100000:1.0:1785774783.012553:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648434816 00000100:00100000:1.0:1785774783.012620:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23636 00000100:00100000:1.0:1785774783.012631:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17767:x1872519648434816:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.012663:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.012696:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e06d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012793:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012809:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012823:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012837:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012844:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012850:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012913:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012921:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012928:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012945:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012951:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012957:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012963:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012968:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.012973:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012979:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.012991:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774783.012994:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.012998:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013005:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0600/0x7b7109e1d09e074 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013017:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013023:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013029:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013034:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.013036:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013041:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013047:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x43f6259d (ffff9b7712d15c00) 00010000:00010000:1.0:1785774783.013049:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.013051:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013056:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e07b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013087:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e06d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013100:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.013108:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7712d15800) 00010000:00010000:1.0:1785774783.013110:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774783.013113:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1a00, rc 0) 00000100:00100000:1.0:1785774783.013215:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:17767:x1872519648434816:12345-192.168.202.31@tcp:101:ls.0 Request processed in 586us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.013232:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23636 00000100:00100000:0.0:1785774783.026859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.036234:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648435200 00000100:00100000:3.0:1785774783.036248:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648435200 00000100:00100000:3.0:1785774783.036331:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23638 00000100:00100000:3.0:1785774783.036342:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:17767:x1872519648435200:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774783.036380:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774783.036407:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e097 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb6b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.036485:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e09e lrc: 3/1,0 mode: --/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.036499:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e09e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.036511:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e09e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774783.036628:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xaf:0x0]: returning size 4096 00000004:00200000:3.0:1785774783.036634:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785774783.036660:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e09e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.036692:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e097 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb6b expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.036725:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e09e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb6b expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.036735:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7605fd8800) 00010000:00010000:3.0:1785774783.036738:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774783.036742:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774783.036810:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17767:x1872519648435200:12345-192.168.202.31@tcp:101:ls.0 Request processed in 470us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774783.036817:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23638 00000100:00100000:3.0:1785774783.050134:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648435328 00000100:00100000:3.0:1785774783.050147:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648435328 00000100:00100000:3.0:1785774783.050255:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23639 00000100:00100000:3.0:1785774783.050268:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:17767:x1872519648435328:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774783.050295:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774783.050325:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e0a5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb72 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.050417:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.050433:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.050446:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774783.050504:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x5d:0x0]: returning size 4096 00000004:00200000:3.0:1785774783.050510:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774783.050563:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e0a5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.050582:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 11 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.050591:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774783.050595:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774783.050598:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774783.050661:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17767:x1872519648435328:12345-192.168.202.31@tcp:101:ls.0 Request processed in 397us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774783.050677:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23639 00000100:00100000:1.0:1785774783.086715:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648435456 00000100:00100000:1.0:1785774783.086825:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648435456 00000100:00100000:1.0:1785774783.086905:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23640 00000100:00100000:1.0:1785774783.086916:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:17767:x1872519648435456:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.086943:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.086973:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e0b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb79 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.087841:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.087858:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.087873:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774783.087934:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5d:0x0]: returning size 4096 00000004:00200000:1.0:1785774783.087941:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785774783.087989:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e0b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.088289:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.088301:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b7712d15c00) 00010000:00010000:1.0:1785774783.088304:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774783.088309:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1600, rc 0) 00000100:00100000:1.0:1785774783.088395:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17767:x1872519648435456:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1481us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.088403:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23640 00000100:00100000:1.0:1785774783.100325:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648435584 00000100:00100000:1.0:1785774783.100339:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648435584 00000100:00100000:1.0:1785774783.100420:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5018 00000100:00100000:1.0:1785774783.100432:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17767:x1872519648435584:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:0.0:1785774783.126458:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17767:x1872519648435584:12345-192.168.202.31@tcp:37:ls.0 Request processed in 26010us (26550us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.126476:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5018 00000100:00100000:3.0:1785774783.153712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.153757:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648436224 00000100:00100000:3.0:1785774783.153770:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648436224 00000100:00100000:3.0:1785774783.153833:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5019 00000100:00100000:3.0:1785774783.153846:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731e1dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17767:x1872519648436224:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:3.0:1785774783.190399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.190584:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648436480 00000100:00100000:0.0:1785774783.190598:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648436480 00000100:00100000:0.0:1785774783.190678:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5020 00000100:00100000:0.0:1785774783.190691:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:17767:x1872519648436480:12345-192.168.202.31@tcp:35:ls.0 00000040:00080000:0.0:1785774783.191052:0:14532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].397, 344 off598416 00000040:00080000:0.0:1785774783.191117:0:14532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].396, 424 off644272 00000004:00080000:0.0:1785774783.191124:0:14532:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7603f399c0 with version 755 00000004:00080000:1.0:1785774783.191267:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 755 rpc_version 755 00000020:00100000:1.0:1785774783.191306:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774783.191317:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7604e02300 x1872519671184384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774783.191346:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e02300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671184384:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774783.191425:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774783.191481:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77110769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774783.191906:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671184384 00000100:00100000:0.0:1785774783.191912:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671184384 00000100:00100000:0.0:1785774783.191956:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535 00000100:00100000:0.0:1785774783.191963:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:7474:x1872519671184384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774783.192193:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:7474:x1872519671184384:12345-0@lo:1000:osp_up0-1.0 Request processed in 229us (766us total) trans 4294983490 rc 0/0 00000100:00100000:0.0:1785774783.192202:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535 00000100:00100000:3.0:1785774783.192396:0:7474:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983487 gen 2 00000004:00080000:3.0:1785774783.192403:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983486 committed transno 4294983487 00000020:00080000:3.0:1785774783.192410:0:7474:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b77012edc00 refcount 2 committed 0 result 0 batchid 397 00000020:00080000:3.0:1785774783.192415:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544fd00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7701359600 00000020:00080000:3.0:1785774783.192419:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].395 00000020:00080000:3.0:1785774783.192421:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544f200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76026c3a00 00000020:00080000:3.0:1785774783.192425:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].396 00000004:00080000:3.0:1785774783.192463:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983487 committed transno 4294983487 00000100:00100000:3.0:1785774783.192477:0:7474:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b7604e02300 x1872519671184384/t4294983490(4294983490) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 1785774799 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785774783.192503:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e02300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671184384:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1785774783.192628:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 397 committed batchid 391 00000020:00080000:0.0:1785774783.192655:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 391 00000100:00100000:0.0:1785774783.192824:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:17767:x1872519648436480:12345-192.168.202.31@tcp:35:ls.0 Request processed in 2135us (2438us total) trans 4294968418 rc 0/0 00000100:00100000:0.0:1785774783.192834:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5020 00000100:00100000:1.0:1785774783.226284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.243604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.265691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:0.0:1785774783.266562:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e0eb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb8e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.266689:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09e0f2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.266705:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09e0f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.266912:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09e0f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774783.267059:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xba:0x0]: returning size 4096 00000004:00200000:0.0:1785774783.267066:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1785774783.267092:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09e0f2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.267372:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e0eb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb8e expref: 15 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.267400:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09e0f2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb8e expref: 14 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.267410:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xba:0x0].0x0 (ffff9b7605dfdd00) 00010000:00010000:0.0:1785774783.267413:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774783.267417:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:0.0:1785774783.267499:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17767:x1872519648437120:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1380us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.267508:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23643 00010000:00010000:0.0:1785774783.268602:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774783.279917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.281116:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648437248 00000100:00100000:3.0:1785774783.281131:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648437248 00000100:00100000:3.0:1785774783.281270:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23644 00000100:00100000:3.0:1785774783.281282:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:17767:x1872519648437248:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774783.281309:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774783.281338:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e0f9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb95 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.281431:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.281447:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.281461:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774783.281528:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x63:0x0]: returning size 4096 00000004:00200000:3.0:1785774783.281534:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774783.281579:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e0f9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.281602:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.281618:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x63:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:3.0:1785774783.281621:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774783.281626:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774783.281714:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:17767:x1872519648437248:12345-192.168.202.31@tcp:101:ls.0 Request processed in 434us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774783.282968:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23644 00000100:00100000:3.0:1785774783.301857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.302058:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648437376 00000100:00100000:0.0:1785774783.302072:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648437376 00000100:00100000:0.0:1785774783.302149:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23645 00000100:00100000:0.0:1785774783.302198:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:17767:x1872519648437376:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774783.302235:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774783.302269:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09e107 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bb9c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.302347:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.302374:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.302387:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774783.302454:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x63:0x0]: returning size 4096 00000004:00200000:0.0:1785774783.302461:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1785774783.302507:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09e107 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.302532:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.302541:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b7605dfd400) 00010000:00010000:0.0:1785774783.302544:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774783.302548:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744600, rc 0) 00000100:00100000:0.0:1785774783.302616:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:17767:x1872519648437376:12345-192.168.202.31@tcp:101:ls.0 Request processed in 458us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.302624:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23645 00000100:00100000:0.0:1785774783.330949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.365595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774783.418155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000004:00080000:3.0:1785774783.427178:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 756 rpc_version 756 00000020:00100000:3.0:1785774783.427247:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774783.427261:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c96a00 x1872519671184640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774783.428569:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671184640 00000100:00100000:1.0:1785774783.428579:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671184640 00000100:00100000:1.0:1785774783.428650:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1785774783.428661:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:7474:x1872519671184640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774783.428954:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:7474:x1872519671184640:12345-0@lo:1000:osp_up0-1.0 Request processed in 294us (631us total) trans 4294983491 rc 0/0 00000100:00100000:1.0:1785774783.428963:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536 00000100:00100000:3.0:1785774783.429378:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671184640:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774783.448447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.448650:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648438144 00000100:00100000:3.0:1785774783.448674:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648438144 00000100:00100000:3.0:1785774783.448764:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23646 00000100:00100000:3.0:1785774783.448777:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:17767:x1872519648438144:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774783.448811:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774783.448836:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e115 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bba3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774783.448992:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:8627:1872519671184768:0@lo:900:mdt00_004.0 00000100:00100000:3.0:1785774783.449054:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774783.449128:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fde3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774783.449330:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671184768 00000100:00100000:1.0:1785774783.449336:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671184768 00000100:00100000:1.0:1785774783.449390:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785774783.449398:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8627:x1872519671184768:12345-0@lo:900:mdt00_004.0 00000100:00100000:1.0:1785774783.449459:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8627:x1872519671184768:12345-0@lo:900:mdt00_004.0 Request processed in 62us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.449467:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785774783.449515:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:8627:1872519671184768:0@lo:900:mdt00_004.0 00000100:00100000:1.0:1785774783.449586:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671184896:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774783.449621:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774783.449641:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076000 going to sleep for 11 seconds 00000100:00100000:1.0:1785774783.449672:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671184896 00000100:00100000:1.0:1785774783.449676:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671184896 00000100:00100000:1.0:1785774783.449705:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3537 00000100:00100000:1.0:1785774783.449711:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:8627:x1872519671184896:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774783.449800:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:8627:x1872519671184896:12345-0@lo:1000:mdt00_004.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.449806:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3537 00000100:00100000:1.0:1785774783.449834:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671184896:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1785774783.449887:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0600/0x7b7109e1d09e11c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.449897:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0600/0x7b7109e1d09e11c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.449908:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0600/0x7b7109e1d09e11c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774783.449920:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671185024:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1785774783.449950:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774783.449965:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774783.449978:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671185024 00000100:00100000:1.0:1785774783.449982:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671185024 00000100:00100000:1.0:1785774783.450008:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3538 00000100:00100000:1.0:1785774783.450013:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:8627:x1872519671185024:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774783.450022:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.450035:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e123 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e11c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450059:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e11c expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450074:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0e00/0x7b7109e1d09e123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e11c expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450084:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774783.450087:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774783.450092:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0e00, rc 0) 00000100:00100000:1.0:1785774783.450118:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:8627:x1872519671185024:12345-0@lo:101:mdt00_004.0 Request processed in 105us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.450123:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3538 00000100:00100000:1.0:1785774783.450147:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671185024:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774783.450185:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0600/0x7b7109e1d09e11c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e123 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450197:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0600/0x7b7109e1d09e11c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e123 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774783.450230:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1785774783.450238:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0600/0x7b7109e1d09e11c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e123 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450245:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0600/0x7b7109e1d09e11c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e123 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450267:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450275:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450283:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450297:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450304:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450312:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450388:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450396:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450407:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450420:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450425:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450431:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450439:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450445:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.450450:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450458:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450470:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:1.0:1785774783.450472:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.450477:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450483:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e12a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450496:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450503:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450508:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450513:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.450516:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450521:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450529:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x74437f5b (ffff9b7712d15100) 00010000:00010000:1.0:1785774783.450531:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.450534:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450540:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e131 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450582:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e115 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450595:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.450602:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7712d15000) 00010000:00010000:1.0:1785774783.450604:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774783.450606:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1400, rc 0) 00000100:00100000:1.0:1785774783.450667:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17767:x1872519648438144:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1893us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.450674:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23646 00000100:00100000:0.0:1785774783.458975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.459133:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648438400 00000100:00100000:3.0:1785774783.459145:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648438400 00000100:00100000:3.0:1785774783.459510:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23647 00000100:00100000:3.0:1785774783.459521:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:17767:x1872519648438400:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774783.459545:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774783.459571:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e13f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1463:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbaa expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774783.460440:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1463:0x0]: returning size 4096 00010000:00010000:3.0:1785774783.460552:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e13f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbaa expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.460568:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:3.0:1785774783.460571:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774783.460576:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e13f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbaa expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.460593:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774783.460671:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:17767:x1872519648438400:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1145us (1701us total) trans 4294983492 rc 301/301 00000100:00100000:3.0:1785774783.460678:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23647 00000100:00100000:0.0:1785774783.474041:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648438528 00000100:00100000:0.0:1785774783.474054:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648438528 00000100:00100000:0.0:1785774783.474129:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23648 00000100:00100000:0.0:1785774783.474141:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:17767:x1872519648438528:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774783.474229:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774783.474260:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e14d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbb1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.474370:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09e154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.474388:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09e154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.474407:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09e154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774783.474534:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1463:0x0]: returning size 4096 00000004:00200000:0.0:1785774783.474540:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1785774783.474565:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09e154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.474594:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e14d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb1 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.474622:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09e154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb1 expref: 24 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.474632:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7605dfda00) 00010000:00010000:0.0:1785774783.474635:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774783.474639:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744800, rc 0) 00000100:00100000:0.0:1785774783.474857:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:17767:x1872519648438528:12345-192.168.202.31@tcp:101:ls.0 Request processed in 717us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.474865:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23648 00000100:00100000:0.0:1785774783.490444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.501095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774783.501265:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648438784 00000100:00100000:1.0:1785774783.501423:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648438784 00000100:00100000:1.0:1785774783.501502:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23650 00000100:00100000:1.0:1785774783.501514:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:17767:x1872519648438784:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.501542:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.501571:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e169 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbbf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.501646:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.501663:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.501678:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774783.501751:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x6c:0x0]: returning size 4096 00000004:00200000:1.0:1785774783.501758:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785774783.501803:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e169 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.501825:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.501835:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6c:0x0].0x0 (ffff9b7712d15100) 00010000:00010000:1.0:1785774783.501840:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774783.501844:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef1000, rc 0) 00000100:00100000:1.0:1785774783.501920:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17767:x1872519648438784:12345-192.168.202.31@tcp:101:ls.0 Request processed in 408us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.501929:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23650 00000100:00100000:1.0:1785774783.540909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.563294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.574457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000004:00080000:0.0:1785774783.576382:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 721 rpc_version 721 00000020:00100000:0.0:1785774783.576416:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774783.576427:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c2a00 x1872519671185280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774783.576454:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671185280:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774783.576529:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774783.576594:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774783.576721:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671185280 00000100:00100000:1.0:1785774783.576728:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671185280 00000100:00100000:1.0:1785774783.576770:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3539 00000100:00100000:1.0:1785774783.576777:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671185280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774783.576951:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671185280:12345-0@lo:1000:osp_up1-0.0 Request processed in 174us (421us total) trans 4294968421 rc 0/0 00000100:00100000:1.0:1785774783.576959:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3539 00000100:00100000:0.0:1785774783.577146:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671185280:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774783.586321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774783.586534:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648439552 00000100:00100000:1.0:1785774783.586547:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648439552 00000100:00100000:1.0:1785774783.586617:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23651 00000100:00100000:1.0:1785774783.586628:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17767:x1872519648439552:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.586654:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.586690:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e177 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbc6 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586788:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586805:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586818:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586836:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586843:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586849:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586911:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09e18c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586919:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09e18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586926:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09e18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586941:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586948:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586954:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586960:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586966:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.586971:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586980:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.586991:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:1.0:1785774783.586994:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.587009:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587016:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e17e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587030:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587036:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587041:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587046:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.587049:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587054:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587059:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x41f29468 (ffff9b7712d15300) 00010000:00010000:1.0:1785774783.587062:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.587064:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587074:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e185 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587107:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e177 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbc6 expref: 20 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587118:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09e18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbc6 expref: 19 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.587126:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff9b7712d15500) 00010000:00010000:1.0:1785774783.587129:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774783.587131:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce000, rc 0) 00000100:00100000:1.0:1785774783.587243:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:17767:x1872519648439552:12345-192.168.202.31@tcp:101:ls.0 Request processed in 617us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.587250:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23651 00000100:00100000:1.0:1785774783.602336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.615380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.625559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.625679:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648440064 00000100:00100000:0.0:1785774783.625691:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648440064 00000100:00100000:0.0:1785774783.625768:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23654 00000100:00100000:0.0:1785774783.625779:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648440064:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774783.625805:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774783.625832:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e1af lrc: 2/0,0 mode: --/CR res: [0x200000400:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.625903:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.625918:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.625929:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774783.625986:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x72:0x0]: returning size 4096 00000004:00200000:0.0:1785774783.625991:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1785774783.626032:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e1af lrc: 0/0,0 mode: --/CR res: [0x200000400:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 30 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.626053:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.626068:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x72:0x0].0x0 (ffff9b7605dfdf00) 00010000:00010000:0.0:1785774783.626071:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774783.626075:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745200, rc 0) 00000100:00100000:0.0:1785774783.626149:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648440064:12345-192.168.202.31@tcp:101:ls.0 Request processed in 372us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.626156:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23654 00000100:00100000:1.0:1785774783.629468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.641820:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648440320 00000100:00100000:3.0:1785774783.641833:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648440320 00000100:00100000:3.0:1785774783.641899:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5027 00000100:00100000:3.0:1785774783.641909:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648440320:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:3.0:1785774783.652726:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671185408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774783.652806:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774783.653013:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671185408 00000100:00100000:0.0:1785774783.653023:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671185408 00000100:00100000:0.0:1785774783.653095:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1785774783.653104:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671185408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774783.653140:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00080000:1.0:1785774783.653231:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774783.656585:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671185536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774783.656658:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785774783.657084:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774783.657126:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671185536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774783.657425:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671185408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4320us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.657434:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1785774783.660296:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671185408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774783.661874:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648440448 00000100:00100000:0.0:1785774783.661883:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648440448 00000100:00100000:0.0:1785774783.661938:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5028 00000100:00100000:0.0:1785774783.661947:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17767:x1872519648440448:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:3.0:1785774783.671725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000004:00080000:0.0:1785774783.673079:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 722 rpc_version 722 00000020:00100000:0.0:1785774783.673120:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774783.673131:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c1f80 x1872519671185792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774783.673174:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671185792:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774783.673256:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774783.673324:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774783.673409:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671185792 00000100:00100000:1.0:1785774783.673415:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671185792 00000100:00100000:1.0:1785774783.673460:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3540 00000100:00100000:1.0:1785774783.673467:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671185792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774783.673666:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671185792:12345-0@lo:1000:osp_up1-0.0 Request processed in 198us (409us total) trans 4294968422 rc 0/0 00000100:00100000:1.0:1785774783.673675:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3540 00000100:00100000:0.0:1785774783.674199:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671185792:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774783.674920:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731e1d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17767:x1872519648440704:12345-192.168.202.31@tcp:35:ls.0 Request processed in 2983us (3204us total) trans 4294983495 rc 0/0 00000100:00100000:3.0:1785774783.674931:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5029 00000100:00100000:1.0:1785774783.680488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.682550:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671185920 00000100:00100000:0.0:1785774783.682558:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671185920 00000100:00100000:0.0:1785774783.682611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1785774783.682620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671185920:12345-0@lo:104: 00010000:00010000:0.0:1785774783.682637:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.682697:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785774783.682704:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671185920:12345-0@lo:104: Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.682712:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00010000:00010000:1.0:1785774783.682929:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774783.682938:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.682946:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774783.682951:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.682960:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.682994:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.683010:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774783.683047:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.683055:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09dfb7 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfbe expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.683074:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774783.683076:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774783.683078:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774783.683123:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774783.683139:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671186048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774783.683201:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774783.683478:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671186048 00000100:00100000:0.0:1785774783.683484:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671186048 00010000:00010000:0.0:1785774783.683504:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09dfbe lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09dfb7 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774783.683533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:0.0:1785774783.683540:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+18:3655:x1872519671186048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774783.683550:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1785774783.688438:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983495 is committed 00000001:00080000:1.0:1785774783.688468:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983491 is committed 00010000:00010000:0.0:1785774783.688609:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09dfbe lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x23/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09dfb7 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.688631:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x276a6cf1 (ffff9b7731f88400) 00010000:00010000:0.0:1785774783.688636:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.688652:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.688658:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.688695:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774783.688798:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3655:x1872519671186048:12345-0@lo:103:ldlm_bl.0 Request processed in 5256us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.688808:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1785774783.688925:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671186048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774783.691466:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671186176 00000100:00100000:1.0:1785774783.691478:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671186176 00000100:00100000:0.0:1785774783.694291:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541 00000100:00100000:0.0:1785774783.694306:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8469:x1872519671186176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774783.694467:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8469:x1872519671186176:12345-0@lo:1000:mdt00_003.0 Request processed in 164us (5080us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.694475:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541 00000100:00100000:1.0:1785774783.694577:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671186176:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1785774783.694650:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694668:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694682:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694700:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694708:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694715:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694721:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694728:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35aa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.694733:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694741:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694760:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774783.694763:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.694769:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694775:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e1d2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694790:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694796:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694802:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694807:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.694810:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694816:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694822:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x276a6cf1 (ffff9b7731f88400) 00010000:00010000:1.0:1785774783.694825:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.694827:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694832:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e1d9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694886:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09e1cb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694902:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.694910:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:1.0:1785774783.694911:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774783.694914:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cec00, rc 0) 00000100:00100000:1.0:1785774783.694971:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648440960:12345-192.168.202.31@tcp:101:ls.0 Request processed in 14153us (14498us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.694978:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23656 00000100:00100000:1.0:1785774783.710482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.710576:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648441216 00000100:00100000:3.0:1785774783.710589:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648441216 00000100:00100000:3.0:1785774783.710657:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23657 00000100:00100000:3.0:1785774783.710666:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17767:x1872519648441216:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774783.710694:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774783.710724:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e1e7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbf0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774783.710922:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xd8:0x0]: returning size 4096 00010000:00010000:3.0:1785774783.711039:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e1e7 lrc: 1/0,0 mode: --/CR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf0 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.711056:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:3.0:1785774783.711059:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774783.711065:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e1e7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf0 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.711084:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774783.711258:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:17767:x1872519648441216:12345-192.168.202.31@tcp:101:ls.0 Request processed in 592us (787us total) trans 4294968423 rc 301/301 00000100:00100000:3.0:1785774783.711266:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23657 00000100:00100000:3.0:1785774783.725434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774783.725535:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648441344 00000100:00100000:1.0:1785774783.725546:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648441344 00000100:00100000:1.0:1785774783.725614:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23658 00000100:00100000:1.0:1785774783.725624:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:17767:x1872519648441344:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.725654:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.725683:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e1f5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbf7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.725759:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.725776:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.725792:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774783.725854:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x72:0x0]: returning size 4096 00000004:00200000:1.0:1785774783.725860:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785774783.725899:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e1f5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 23 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.725917:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 22 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.725925:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x72:0x0].0x0 (ffff9b7702c6a600) 00010000:00010000:1.0:1785774783.725928:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774783.725931:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774783.726010:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:17767:x1872519648441344:12345-192.168.202.31@tcp:101:ls.0 Request processed in 387us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.726017:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23658 00000100:00100000:0.0:1785774783.732601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774783.732714:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648441472 00000100:00100000:1.0:1785774783.732728:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648441472 00000100:00100000:1.0:1785774783.732799:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23659 00000100:00100000:1.0:1785774783.732811:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441472:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.732838:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.732865:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e203 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bbfe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733010:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733030:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733043:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733054:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733060:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733067:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733073:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.733078:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733085:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733097:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774783.733101:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774783.733106:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733112:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e20a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733147:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e203 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbfe expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733197:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774783.733199:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.733203:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e203 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbfe expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.733217:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774783.733541:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441472:12345-192.168.202.31@tcp:101:ls.0 Request processed in 732us (952us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774783.733548:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23659 00000100:00100000:0.0:1785774783.742544:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648441600 00000100:00100000:0.0:1785774783.742556:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648441600 00000100:00100000:0.0:1785774783.742624:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23660 00000100:00100000:0.0:1785774783.742634:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:17767:x1872519648441600:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774783.742660:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774783.742689:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09e211 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.742776:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e218 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.742798:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e218 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.742811:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e218 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774783.742943:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xd8:0x0]: returning size 4096 00000004:00200000:0.0:1785774783.742948:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1785774783.742971:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e218 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.743010:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09e211 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc05 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.743034:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e218 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc05 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.743045:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7605dfd000) 00010000:00010000:0.0:1785774783.743048:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774783.743051:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745000, rc 0) 00000100:00100000:0.0:1785774783.743118:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:17767:x1872519648441600:12345-192.168.202.31@tcp:101:ls.0 Request processed in 486us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.743124:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23660 00000100:00100000:3.0:1785774783.755480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.755595:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648441728 00000100:00100000:0.0:1785774783.755607:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648441728 00000100:00100000:0.0:1785774783.755677:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23661 00000100:00100000:0.0:1785774783.755688:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441728:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774783.755717:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774783.755750:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e21f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc0c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755902:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755917:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755928:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755937:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755942:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755948:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755953:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774783.755958:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755965:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755975:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:0.0:1785774783.755978:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774783.755981:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.755990:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e226 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.756024:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e21f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc0c expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.756034:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:0.0:1785774783.756036:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774783.756040:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e21f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc0c expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.756054:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:0.0:1785774783.756126:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441728:12345-192.168.202.31@tcp:101:ls.0 Request processed in 441us (658us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774783.756132:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23661 00000100:00100000:1.0:1785774783.763925:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648441856 00000100:00100000:1.0:1785774783.763938:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648441856 00000100:00100000:1.0:1785774783.764013:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23662 00000100:00100000:1.0:1785774783.764024:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441856:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.764051:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.764078:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e22d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc13 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764416:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764434:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764447:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764457:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764463:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764470:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764475:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.764479:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764486:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764496:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774783.764499:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774783.764503:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764508:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764539:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e22d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc13 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764547:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774783.764549:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.764552:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e22d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc13 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.764563:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774783.764678:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441856:12345-192.168.202.31@tcp:101:ls.0 Request processed in 655us (1018us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774783.764686:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23662 00000100:00100000:1.0:1785774783.795887:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648441984 00000100:00100000:1.0:1785774783.796076:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648441984 00000100:00100000:1.0:1785774783.796697:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23663 00000100:00100000:1.0:1785774783.796713:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441984:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.796741:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.796785:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e23b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc1a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.796935:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.796951:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.796963:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.796972:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.796978:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.796985:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.796991:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.796995:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.797015:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.797027:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774783.797031:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774783.797036:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.797043:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09e242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.797080:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e23b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc1a expref: 26 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.797090:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774783.797093:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.797097:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e23b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc1a expref: 26 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.797111:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774783.800638:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648441984:12345-192.168.202.31@tcp:101:ls.0 Request processed in 3918us (13285us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774783.800652:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23663 00000100:00100000:3.0:1785774783.823101:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648442112 00000100:00100000:3.0:1785774783.823124:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648442112 00000100:00100000:3.0:1785774783.845672:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648442240 00000100:00100000:3.0:1785774783.845683:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648442240 00000100:00100000:3.0:1785774783.845750:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23664 00000100:00100000:3.0:1785774783.845760:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648442240:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774783.845785:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774783.845813:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc21 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.845853:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.845867:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774783.845876:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:3.0:1785774783.845879:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774783.845883:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774783.845951:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:17767:x1872519648442240:12345-192.168.202.31@tcp:101:ls.0 Request processed in 193us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774783.845958:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23664 00000100:00100000:0.0:1785774783.863684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774783.863919:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648442368 00000100:00100000:3.0:1785774783.863931:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648442368 00000100:00100000:3.0:1785774783.864007:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5031 00000100:00100000:3.0:1785774783.864017:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:17767:x1872519648442368:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:3.0:1785774783.864360:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:17767:x1872519648442368:12345-192.168.202.31@tcp:37:ls.0 Request processed in 344us (689us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774783.864369:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5031 00000100:00100000:3.0:1785774783.891824:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648442624 00000100:00100000:3.0:1785774783.891837:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648442624 00000100:00100000:3.0:1785774783.891903:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5032 00000100:00100000:3.0:1785774783.891913:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:17767:x1872519648442624:12345-192.168.202.31@tcp:35:ls.0 00000100:00100000:0.0:1785774783.892750:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:17767:x1872519648442624:12345-192.168.202.31@tcp:35:ls.0 Request processed in 835us (1150us total) trans 4294968424 rc 0/0 00000100:00100000:0.0:1785774783.892760:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5032 00000100:00100000:0.0:1785774783.910082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774783.910333:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648442880 00000100:00100000:1.0:1785774783.910356:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648442880 00000100:00100000:1.0:1785774783.910436:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23665 00000100:00100000:1.0:1785774783.910459:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:17767:x1872519648442880:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774783.910491:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774783.910529:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09e250 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc28 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910629:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910647:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910659:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910675:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910682:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910689:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910756:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e265 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910764:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910772:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910789:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910797:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910804:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910812:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910819:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.910824:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910831:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910844:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:1.0:1785774783.910848:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.910853:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910859:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e257 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910874:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910880:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910885:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910889:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774783.910892:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910898:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910904:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xad49086a (ffff9b7702c6a500) 00010000:00010000:1.0:1785774783.910907:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774783.910909:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910914:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e25e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910953:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09e250 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc28 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910965:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc28 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.910973:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774783.910975:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774783.910977:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:1.0:1785774783.911069:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648442880:12345-192.168.202.31@tcp:101:ls.0 Request processed in 622us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.911077:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23665 00000100:00100000:1.0:1785774783.920940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.934777:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648443264 00000100:00100000:0.0:1785774783.934790:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648443264 00000100:00100000:0.0:1785774783.934860:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23667 00000100:00100000:0.0:1785774783.934871:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:17767:x1872519648443264:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774783.934901:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774783.934928:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e27a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc36 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.935016:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e281 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.935031:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.935043:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774783.935525:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1484:0x0]: returning size 4096 00000004:00200000:0.0:1785774783.935532:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1785774783.935560:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.935590:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e27a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc36 expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.935614:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc36 expref: 28 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.935623:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7605dfd800) 00010000:00010000:0.0:1785774783.935625:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774783.935629:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745600, rc 0) 00000100:00100000:0.0:1785774783.935697:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648443264:12345-192.168.202.31@tcp:101:ls.0 Request processed in 827us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774783.935704:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23667 00000100:00100000:0.0:1785774783.954906:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648443392 00000100:00100000:0.0:1785774783.954918:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648443392 00000100:00100000:0.0:1785774783.954989:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23668 00000100:00100000:0.0:1785774783.954999:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648443392:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774783.956330:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774783.956374:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e288 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc3d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.956449:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.956465:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774783.956478:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774783.965499:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x7d:0x0]: returning size 4096 00000004:00200000:1.0:1785774783.965514:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785774783.965599:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e288 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 30 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.965633:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774783.965644:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7d:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:1.0:1785774783.965647:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774783.965651:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745400, rc 0) 00000100:00100000:1.0:1785774783.965759:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648443392:12345-192.168.202.31@tcp:101:ls.0 Request processed in 10759us (10958us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774783.965769:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23668 00000100:00100000:3.0:1785774783.969077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774783.998706:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648443648 00000100:00100000:0.0:1785774783.998717:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648443648 00000100:00100000:0.0:1785774783.998774:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5033 00000100:00100000:0.0:1785774783.998784:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648443648:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:1.0:1785774784.068226:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648443648:12345-192.168.202.31@tcp:37:ls.0 Request processed in 69425us (70063us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.068241:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5033 00000100:00100000:3.0:1785774784.095835:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648443776 00000100:00100000:3.0:1785774784.095844:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648443776 00000100:00100000:3.0:1785774784.095949:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5034 00000100:00100000:3.0:1785774784.095960:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731e1c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:17767:x1872519648443776:12345-192.168.202.31@tcp:37:ls.0 00000100:00080000:1.0:1785774784.097428:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774784.172150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00080000:1.0:1785774784.177205:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1785774784.179218:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 723 rpc_version 723 00000020:00100000:3.0:1785774784.179268:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774784.179281:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605f00e00 x1872519671186432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774784.179312:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671186432:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774784.179424:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774784.179500:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7701377480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774784.180657:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671186432 00000100:00100000:1.0:1785774784.180668:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671186432 00000100:00100000:1.0:1785774784.180741:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3542 00000100:00100000:1.0:1785774784.180751:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671186432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774784.181018:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671186432:12345-0@lo:1000:osp_up1-0.0 Request processed in 268us (1593us total) trans 4294968425 rc 0/0 00000100:00100000:1.0:1785774784.181026:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3542 00000100:00100000:3.0:1785774784.185418:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671186432:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774784.187773:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17767:x1872519648444032:12345-192.168.202.31@tcp:35:ls.0 Request processed in 11598us (15625us total) trans 4294983497 rc 0/0 00000100:00100000:1.0:1785774784.187798:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5035 00000100:00100000:1.0:1785774784.197623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774784.216066:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648444544 00000100:00100000:1.0:1785774784.216079:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648444544 00000100:00100000:1.0:1785774784.216154:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23671 00000100:00100000:1.0:1785774784.216189:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17767:x1872519648444544:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.216220:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.216250:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc52 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774784.217141:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00010000:00010000:1.0:1785774784.217304:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2c0 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc52 expref: 32 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.217322:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774784.217325:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774784.217329:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc52 expref: 32 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.217359:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:1.0:1785774784.217431:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17767:x1872519648444544:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1247us (1827us total) trans 4294983498 rc 301/301 00000100:00100000:1.0:1785774784.217438:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23671 00000100:00100000:0.0:1785774784.243633:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774784.245058:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648444672 00000100:00100000:1.0:1785774784.245073:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648444672 00000100:00100000:1.0:1785774784.245209:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23672 00000100:00100000:1.0:1785774784.245222:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17767:x1872519648444672:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.245254:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.245286:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2ce lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc59 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.245380:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e2d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.245397:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.245413:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774784.245530:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00000004:00200000:1.0:1785774784.245536:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1785774784.245561:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.245591:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2ce lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc59 expref: 33 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.245615:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc59 expref: 32 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.245624:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff9b7702c6aa00) 00010000:00010000:1.0:1785774784.245627:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774784.245630:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cea00, rc 0) 00000100:00100000:1.0:1785774784.245692:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17767:x1872519648444672:12345-192.168.202.31@tcp:101:ls.0 Request processed in 474us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.245699:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23672 00000100:00100000:3.0:1785774784.254611:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648444800 00000100:00100000:3.0:1785774784.254633:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648444800 00000100:00100000:3.0:1785774784.254728:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23673 00000100:00100000:3.0:1785774784.254740:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17767:x1872519648444800:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.254768:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.254811:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e2dc lrc: 2/0,0 mode: --/CR res: [0x200000400:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc60 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.254899:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.254916:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.255257:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.255340:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xa5:0x0]: returning size 4096 00000004:00200000:3.0:1785774784.255354:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774784.255400:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e2dc lrc: 0/0,0 mode: --/CR res: [0x200000400:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 34 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.255422:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.255432:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa5:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:3.0:1785774784.255436:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774784.255441:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774784.255521:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648444800:12345-192.168.202.31@tcp:101:ls.0 Request processed in 782us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774784.255529:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23673 00000100:00100000:0.0:1785774784.269474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774784.269588:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648444928 00000100:00100000:1.0:1785774784.269600:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648444928 00000100:00100000:1.0:1785774784.269676:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23674 00000100:00100000:1.0:1785774784.269687:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:17767:x1872519648444928:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.269712:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.269741:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2ea lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.269810:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.269826:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.269839:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774784.269892:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xa5:0x0]: returning size 4096 00000004:00200000:1.0:1785774784.269897:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785774784.270108:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2ea lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.270129:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 28 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.270138:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa5:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774784.270141:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774784.270144:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00010000:00010000:1.0:1785774784.292977:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774784.294234:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.294548:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648445056 00000100:00100000:3.0:1785774784.294560:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648445056 00000100:00100000:3.0:1785774784.294625:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5036 00000100:00100000:3.0:1785774784.294636:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648445056:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:3.0:1785774784.322080:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648445056:12345-192.168.202.31@tcp:37:ls.0 Request processed in 27429us (27837us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774784.322111:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5036 00000100:00100000:1.0:1785774784.338396:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648445184 00000100:00100000:1.0:1785774784.338408:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648445184 00000100:00100000:1.0:1785774784.338469:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5037 00000100:00100000:1.0:1785774784.338480:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648445184:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:1.0:1785774784.348789:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648445184:12345-192.168.202.31@tcp:37:ls.0 Request processed in 10293us (10519us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.348806:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5037 00000100:00100000:3.0:1785774784.364203:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648445440 00000100:00100000:3.0:1785774784.364225:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648445440 00000100:00100000:3.0:1785774784.364354:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5038 00000100:00100000:3.0:1785774784.364366:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648445440:12345-192.168.202.31@tcp:35:ls.0 00000100:00100000:3.0:1785774784.382930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774784.383093:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648445696 00000100:00100000:1.0:1785774784.383104:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648445696 00000100:00100000:1.0:1785774784.383218:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23675 00000100:00100000:1.0:1785774784.383230:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648445696:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.383256:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.383283:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2f8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc6e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383404:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383422:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383435:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383451:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383459:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383465:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383536:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e30d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383543:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e30d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383551:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e30d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383567:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383574:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383582:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383588:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383594:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774784.383599:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383606:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383618:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:1.0:1785774784.383621:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774784.383626:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383633:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09e2ff lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383647:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383653:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383659:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383663:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774784.383665:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383669:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383674:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xf404c279 (ffff9b7702c6ad00) 00010000:00010000:1.0:1785774784.383676:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774784.383678:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383683:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e306 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383713:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e2f8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc6e expref: 30 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383725:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e30d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc6e expref: 29 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.383734:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:1.0:1785774784.383736:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774784.383738:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce800, rc 0) 00000100:00100000:1.0:1785774784.383808:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648445696:12345-192.168.202.31@tcp:101:ls.0 Request processed in 580us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.383815:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23675 00000100:00100000:0.0:1785774784.387130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.387582:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648445952 00000100:00100000:3.0:1785774784.387593:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648445952 00000100:00100000:3.0:1785774784.387657:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23676 00000100:00100000:3.0:1785774784.387666:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:17767:x1872519648445952:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.387693:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.387722:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e314 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc75 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.387918:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d4:0x0]: returning size 4096 00010000:00010000:3.0:1785774784.388363:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e314 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc75 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.388387:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774784.388390:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774784.388395:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e314 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc75 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.388413:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774784.388592:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:17767:x1872519648445952:12345-192.168.202.31@tcp:101:ls.0 Request processed in 926us (1471us total) trans 4294983500 rc 301/301 00000100:00100000:3.0:1785774784.388600:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23676 00000100:00100000:1.0:1785774784.410868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774784.422551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.422704:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648446208 00000100:00100000:3.0:1785774784.422717:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648446208 00000100:00100000:3.0:1785774784.422791:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23678 00000100:00100000:3.0:1785774784.422801:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:17767:x1872519648446208:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.422828:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.422856:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e330 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc83 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.422927:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.422942:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.422955:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.423097:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xa7:0x0]: returning size 4096 00000004:00200000:3.0:1785774784.423103:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774784.423142:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e330 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 38 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.424063:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 37 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.424074:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa7:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:3.0:1785774784.424077:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774784.424081:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774784.424153:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:17767:x1872519648446208:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1354us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774784.424186:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23678 00000100:00100000:0.0:1785774784.427272:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.427436:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648446336 00000100:00100000:3.0:1785774784.427446:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648446336 00000100:00100000:3.0:1785774784.427501:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23679 00000100:00100000:3.0:1785774784.427510:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648446336:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.427531:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.427551:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e33e lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc8a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.427613:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.427626:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.427637:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.427692:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xa7:0x0]: returning size 4096 00000004:00200000:3.0:1785774784.427696:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774784.427731:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e33e lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.427747:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.427755:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:3.0:1785774784.427757:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774784.427760:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1c00, rc 0) 00000100:00100000:3.0:1785774784.427803:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17767:x1872519648446336:12345-192.168.202.31@tcp:101:ls.0 Request processed in 294us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774784.427810:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23679 00000100:00100000:1.0:1785774784.451329:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.472910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774784.523780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774784.554447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774784.554616:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648447104 00000100:00100000:1.0:1785774784.554628:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648447104 00000100:00100000:1.0:1785774784.554700:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23680 00000100:00100000:1.0:1785774784.554710:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:17767:x1872519648447104:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.554740:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.554764:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e34c lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc91 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.554857:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.554874:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.554888:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.554900:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.554916:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e004 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dffd expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.554925:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.554961:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e004 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09dffd expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774784.554977:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671186560:0@lo:104: 00000100:00100000:1.0:1785774784.555628:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774784.557375:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774784.562480:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671186560 00000100:00100000:3.0:1785774784.562499:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671186560 00000100:00100000:1.0:1785774784.571296:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671186560:0@lo:104: 00010000:00010000:1.0:1785774784.571326:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.575306:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774784.575322:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b000/0x7b7109e1d09dffd lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09e004 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.575336:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774784.575349:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b000/0x7b7109e1d09dffd lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7b7109e1d09e004 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.575362:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b000/0x7b7109e1d09dffd lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09e004 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.585124:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b000/0x7b7109e1d09dffd lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09e004 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.585146:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1785774784.585370:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1785774784.585396:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b000/0x7b7109e1d09dffd lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09e004 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.585407:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b000/0x7b7109e1d09dffd lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09e004 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.585440:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774784.585442:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774784.585445:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774784.597852:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671186688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774784.597953:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774784.602629:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671186688 00000100:00100000:3.0:1785774784.602647:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671186688 00010000:00010000:0.0:1785774784.603130:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e004 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09dffd expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774784.603350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:0.0:1785774784.603361:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671186688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774784.603381:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1785774784.607108:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983501 is committed 00010000:00010000:0.0:1785774784.607353:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e004 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x51102365 bits 0x23/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09dffd expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.607374:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x51102365 (ffff9b7605dfd900) 00010000:00010000:0.0:1785774784.607380:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.607391:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.607399:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.607426:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774784.608084:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.608094:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774784.608397:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3654:x1872519671186688:12345-0@lo:103:ldlm_bl.0 Request processed in 5034us (10440us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774784.608409:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:1.0:1785774784.608764:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671186816:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774784.608818:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774784.608851:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77110769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774784.609595:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671186816:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1785774784.609654:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09e361 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609667:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09e361 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609677:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09e361 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609692:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609697:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609703:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609708:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609714:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774784.609718:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609725:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609734:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774784.609737:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774784.609740:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609750:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e353 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609760:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609764:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609769:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609774:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774784.609776:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609780:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609785:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x51102365 (ffff9b7605dfd900) 00010000:00010000:1.0:1785774784.609787:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774784.609789:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609793:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e35a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609837:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e34c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc91 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609849:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09e361 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc91 expref: 33 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.609857:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7712d15a00) 00010000:00010000:1.0:1785774784.609859:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774784.609861:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce600, rc 0) 00000100:00100000:1.0:1785774784.610429:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648447104:12345-192.168.202.31@tcp:101:ls.0 Request processed in 55720us (55995us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.610436:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23680 00000100:00100000:1.0:1785774784.627183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.627514:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648447360 00000100:00100000:3.0:1785774784.627527:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648447360 00000100:00100000:3.0:1785774784.629646:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23681 00000100:00100000:3.0:1785774784.629668:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17767:x1872519648447360:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.629696:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.629726:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e368 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.629923:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x14e:0x0]: returning size 4096 00010000:00010000:3.0:1785774784.630042:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e368 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc98 expref: 32 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.630060:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774784.630064:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774784.630069:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e368 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc98 expref: 32 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.630093:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774784.630186:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17767:x1872519648447360:12345-192.168.202.31@tcp:101:ls.0 Request processed in 527us (3040us total) trans 4294968426 rc 301/301 00000100:00100000:3.0:1785774784.630193:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23681 00000100:00100000:0.0:1785774784.648277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000001:00080000:1.0:1785774784.648525:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968426 is committed 00000001:00080000:1.0:1785774784.648535:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968425 is committed 00000020:00080000:1.0:1785774784.648555:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 397 batchid updated 00000020:00080000:1.0:1785774784.648569:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 396 batchid updated 00000100:00100000:3.0:1785774784.648648:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648447488 00000100:00100000:3.0:1785774784.648659:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648447488 00000100:00100000:3.0:1785774784.648725:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23682 00000100:00100000:3.0:1785774784.648736:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:17767:x1872519648447488:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.648766:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.648795:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e376 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bc9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.648870:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.648886:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.648900:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.648957:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xab:0x0]: returning size 4096 00000004:00200000:3.0:1785774784.648963:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774784.649012:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e376 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.649032:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 25 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.649042:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xab:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:3.0:1785774784.649045:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774784.649050:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:3.0:1785774784.649123:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648447488:12345-192.168.202.31@tcp:101:ls.0 Request processed in 388us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774784.649130:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23682 00000020:00080000:0.0:1785774784.649627:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 397 00000004:00080000:0.0:1785774784.649703:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7603f39a80 with version 757 00000020:00080000:0.0:1785774784.649715:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 393 cancel update log [0x200000401:0x3:0x0].392: rc = 0 00000020:00080000:0.0:1785774784.649797:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 393 cancel update log [0x240000400:0x3:0x0].393: rc = 0 00000004:00080000:0.0:1785774784.649818:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7603f39000 with version 758 00000020:00080000:0.0:1785774784.649820:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 395 cancel update log [0x200000401:0x3:0x0].393: rc = 0 00000020:00080000:0.0:1785774784.649834:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 395 cancel update log [0x240000400:0x3:0x0].394: rc = 0 00000004:00080000:0.0:1785774784.649849:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7603f39180 with version 759 00000020:00080000:0.0:1785774784.649852:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 396 cancel update log [0x200000401:0x3:0x0].394: rc = 0 00000020:00080000:0.0:1785774784.649865:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 396 cancel update log [0x240000400:0x3:0x0].395: rc = 0 00000004:00080000:0.0:1785774784.649881:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7715f796c0 with version 760 00000020:00080000:0.0:1785774784.649884:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 397 cancel update log [0x200000401:0x3:0x0].395: rc = 0 00000020:00080000:0.0:1785774784.649895:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 397 cancel update log [0x240000400:0x3:0x0].396: rc = 0 00000020:00080000:0.0:1785774784.649901:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 397 00000004:00080000:3.0:1785774784.655812:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 757 rpc_version 757 00000020:00100000:3.0:1785774784.655872:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774784.655885:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605f02680 x1872519671187072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774784.655914:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671187072:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774784.656017:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774784.656090:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774784.656196:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671187072 00000100:00100000:1.0:1785774784.656214:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671187072 00000100:00100000:1.0:1785774784.656282:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544 00000100:00100000:1.0:1785774784.656292:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671187072:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774784.656512:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:7474:x1872519671187072:12345-0@lo:1000:osp_up0-1.0 Request processed in 220us (494us total) trans 4294983502 rc 0/0 00000100:00100000:1.0:1785774784.656520:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544 00000100:00100000:0.0:1785774784.656777:0:7474:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983491 gen 2 00000004:00080000:0.0:1785774784.656784:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983490 committed transno 4294983491 00000020:00080000:0.0:1785774784.656791:0:7474:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7603f39780 refcount 2 committed 0 result 0 batchid 398 00000020:00080000:0.0:1785774784.656796:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603f399c0 00000020:00080000:0.0:1785774784.656800:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].396 00000020:00080000:0.0:1785774784.656803:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7715c36c00 00000020:00080000:0.0:1785774784.656806:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].397 00000004:00080000:0.0:1785774784.656863:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983491 committed transno 4294983491 00000020:00080000:0.0:1785774784.656867:0:7474:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605f8b240 refcount 2 committed 0 result 0 batchid 399 00000020:00080000:0.0:1785774784.656870:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544f700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605fde180 00000020:00080000:0.0:1785774784.656873:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].397 00000020:00080000:0.0:1785774784.656875:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760544f600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7602585000 00000020:00080000:0.0:1785774784.656878:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].398 00000100:00100000:0.0:1785774784.656892:0:7474:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b7605f02680 x1872519671187072/t4294983502(4294983502) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1785774800 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785774784.656911:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671187072:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1785774784.656923:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 758 rpc_version 758 00000020:00100000:0.0:1785774784.656937:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774784.656942:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773465b480 x1872519671187328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774784.656955:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671187328:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774784.656984:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774784.657016:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf80c0 going to sleep for 11 seconds 00000020:00080000:1.0:1785774784.657889:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 399 committed batchid 397 00000020:00080000:1.0:1785774784.657926:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 397 00000100:00100000:1.0:1785774784.662314:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648447616 00000100:00100000:1.0:1785774784.662325:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648447616 00000100:00100000:1.0:1785774784.662403:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23683 00000100:00100000:1.0:1785774784.662414:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648447616:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.662438:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.662466:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e384 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bca6 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662616:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662631:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662645:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662655:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662663:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662670:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662678:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774784.662683:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662691:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662703:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774784.662706:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774784.662711:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662722:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e38b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662757:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e384 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bca6 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662768:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774784.662770:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774784.662773:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e384 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bca6 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.662786:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:1.0:1785774784.662869:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648447616:12345-192.168.202.31@tcp:101:ls.0 Request processed in 456us (758us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774784.662878:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23683 00000100:00100000:0.0:1785774784.677024:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671187968 00000100:00100000:0.0:1785774784.677034:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671187968 00000100:00100000:0.0:1785774784.677098:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3548 00000100:00100000:0.0:1785774784.677109:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671187968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774784.677150:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445007360 avail 1298767872 00000100:00100000:0.0:1785774784.677254:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671187968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774784.677262:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3548 00000100:00100000:3.0:1785774784.678090:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671188096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774784.678128:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774784.678230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.678254:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648447744 00000100:00100000:3.0:1785774784.678258:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648447744 00000100:00100000:3.0:1785774784.678295:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23684 00000100:00100000:3.0:1785774784.678301:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:17767:x1872519648447744:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.678315:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.678354:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e392 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcad expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.678428:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e399 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.678444:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e399 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.678457:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e399 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.678560:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x14e:0x0]: returning size 4096 00000004:00200000:3.0:1785774784.678566:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785774784.678591:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e399 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.678623:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e392 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcad expref: 27 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.678642:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e399 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcad expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.678651:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:3.0:1785774784.678654:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774784.678657:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774784.678697:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:17767:x1872519648447744:12345-192.168.202.31@tcp:101:ls.0 Request processed in 395us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774784.678703:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23684 00000100:00100000:1.0:1785774784.681102:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671188480 00000100:00100000:1.0:1785774784.681109:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671188480 00000100:00100000:1.0:1785774784.681136:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671188352 00000100:00100000:1.0:1785774784.681138:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671188352 00000100:00100000:1.0:1785774784.681149:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1785774784.681155:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671188480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774784.681227:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671188480:12345-0@lo:400:kworker.0 Request processed in 72us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.681233:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1785774784.681246:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1785774784.681251:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671188352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774784.681277:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671188352:12345-0@lo:400:kworker.0 Request processed in 26us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.681282:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000020:00080000:0.0:1785774784.681410:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 394 committed batchid 390 00000020:00080000:0.0:1785774784.681482:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 390 00000100:00080000:3.0:1785774784.681582:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774784.681588:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1785774784.681590:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774784.689575:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648447872 00000100:00100000:1.0:1785774784.689589:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648447872 00000100:00100000:1.0:1785774784.689668:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23685 00000100:00100000:1.0:1785774784.689680:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648447872:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.689708:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.689739:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcb4 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689899:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689918:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689931:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689943:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689950:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689957:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689965:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774784.689971:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.689979:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.690004:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774784.690008:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774784.690013:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.690019:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.690060:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3a0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcb4 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.690071:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774784.690074:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774784.690078:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcb4 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.690093:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:1.0:1785774784.690470:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648447872:12345-192.168.202.31@tcp:101:ls.0 Request processed in 791us (1166us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774784.690479:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23685 00000100:00100000:3.0:1785774784.696517:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648448000 00000100:00100000:3.0:1785774784.696546:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648448000 00000100:00100000:3.0:1785774784.696638:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23686 00000100:00100000:3.0:1785774784.696650:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648448000:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.696678:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.696709:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e3ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcbb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696861:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696883:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696897:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696908:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696915:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696922:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696930:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774784.696934:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696943:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696956:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774784.696959:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774784.696965:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.696971:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e3b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.700473:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e3ae lrc: 1/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcbb expref: 34 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.700499:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774784.700502:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774784.700507:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e3ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcbb expref: 34 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.700535:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774784.700631:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648448000:12345-192.168.202.31@tcp:101:ls.0 Request processed in 3983us (6153us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774784.700640:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23686 00000100:00100000:3.0:1785774784.707003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774784.746051:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648448256 00000100:00100000:0.0:1785774784.746064:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648448256 00000100:00100000:0.0:1785774784.746148:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5042 00000100:00100000:0.0:1785774784.746212:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:17767:x1872519648448256:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:1.0:1785774784.774639:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648448384 00000100:00100000:1.0:1785774784.774658:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648448384 00000100:00100000:1.0:1785774784.775323:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23688 00000100:00100000:1.0:1785774784.775346:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648448384:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.775376:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.775406:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcc9 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.775453:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.775471:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.775480:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774784.775484:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774784.775488:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:1.0:1785774784.775584:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:17767:x1872519648448384:12345-192.168.202.31@tcp:101:ls.0 Request processed in 252us (6746us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.775592:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23688 00000100:00100000:0.0:1785774784.806123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.855627:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774784.872746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774784.872857:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648449024 00000100:00100000:0.0:1785774784.872872:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648449024 00000100:00100000:0.0:1785774784.872955:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23689 00000100:00100000:0.0:1785774784.872968:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:17767:x1872519648449024:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774784.873009:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774784.873037:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09e3d1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcd0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873149:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873218:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873232:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873305:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873318:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873325:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873414:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149b000/0x7b7109e1d09e3e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873422:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149b000/0x7b7109e1d09e3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873428:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149b000/0x7b7109e1d09e3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873444:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873451:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873457:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873464:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873470:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774784.873474:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873482:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873495:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:0.0:1785774784.873498:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774784.873503:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873509:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09e3d8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873525:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873532:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873537:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873543:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774784.873545:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873551:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873557:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x60a2d708 (ffff9b7605dfd300) 00010000:00010000:0.0:1785774784.873559:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774784.873562:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873568:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e3df lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873614:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09e3d1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcd0 expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873627:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149b000/0x7b7109e1d09e3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcd0 expref: 28 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774784.873635:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605dfd700) 00010000:00010000:0.0:1785774784.873637:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774784.873640:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770149b000, rc 0) 00000100:00100000:0.0:1785774784.873715:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648449024:12345-192.168.202.31@tcp:101:ls.0 Request processed in 751us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774784.873724:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23689 00000100:00100000:0.0:1785774784.894437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774784.894560:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648449280 00000100:00100000:1.0:1785774784.894575:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648449280 00000100:00100000:1.0:1785774784.894650:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23690 00000100:00100000:1.0:1785774784.894662:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:17767:x1872519648449280:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.894691:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.894720:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1505:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcd7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774784.894922:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1505:0x0]: returning size 4096 00010000:00010000:1.0:1785774784.895049:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3ed lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcd7 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.895073:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605fccc00) 00010000:00010000:1.0:1785774784.895076:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774784.895081:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcd7 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.895102:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:1.0:1785774784.895244:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:17767:x1872519648449280:12345-192.168.202.31@tcp:101:ls.0 Request processed in 584us (821us total) trans 4294983506 rc 301/301 00000100:00100000:1.0:1785774784.895253:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23690 00000100:00100000:3.0:1785774784.915127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774784.915462:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648449408 00000100:00100000:1.0:1785774784.915475:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648449408 00000100:00100000:1.0:1785774784.915559:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23691 00000100:00100000:1.0:1785774784.915571:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:17767:x1872519648449408:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.915603:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.915635:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3fb lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcde expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.915724:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.915741:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.915753:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774784.915878:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1505:0x0]: returning size 4096 00000004:00200000:1.0:1785774784.915885:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1785774784.915911:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.915939:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e3fb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcde expref: 37 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.915963:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcde expref: 36 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.915973:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605fcc300) 00010000:00010000:1.0:1785774784.915977:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774784.915981:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cee00, rc 0) 00000100:00100000:1.0:1785774784.920542:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:17767:x1872519648449408:12345-192.168.202.31@tcp:101:ls.0 Request processed in 4956us (5412us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.920560:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23691 00000100:00100000:3.0:1785774784.946899:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648449536 00000100:00100000:3.0:1785774784.946912:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648449536 00000100:00100000:3.0:1785774784.947002:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23692 00000100:00100000:3.0:1785774784.947014:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:17767:x1872519648449536:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774784.947041:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774784.947073:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e409 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bce5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.947191:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.947473:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.947507:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774784.947561:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xbd:0x0]: returning size 4096 00000004:00200000:3.0:1785774784.947567:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774784.947606:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e409 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 38 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.947627:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 37 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774784.947635:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbd:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774784.947639:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774784.947643:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1e00, rc 0) 00000100:00100000:3.0:1785774784.947707:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:17767:x1872519648449536:12345-192.168.202.31@tcp:101:ls.0 Request processed in 695us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774784.947712:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23692 00000100:00100000:1.0:1785774784.952255:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648449664 00000100:00100000:1.0:1785774784.952269:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648449664 00000100:00100000:1.0:1785774784.952353:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23693 00000100:00100000:1.0:1785774784.952366:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17767:x1872519648449664:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774784.952392:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774784.952420:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e417 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcec expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.952496:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 3/1,0 mode: --/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.952511:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.952529:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774784.952590:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xbd:0x0]: returning size 4096 00000004:00200000:1.0:1785774784.952596:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1785774784.952645:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e417 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.952668:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 29 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774784.952678:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbd:0x0].0x0 (ffff9b7605fccc00) 00010000:00010000:1.0:1785774784.952682:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774784.952686:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce200, rc 0) 00000100:00100000:1.0:1785774784.952770:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648449664:12345-192.168.202.31@tcp:101:ls.0 Request processed in 407us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774784.952778:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23693 00000100:00100000:0.0:1785774784.971105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774784.975812:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:17767:x1872519648449792:12345-192.168.202.31@tcp:37:ls.0 Request processed in 4216us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774784.975829:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5045 00000100:00100000:0.0:1785774784.991326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.000086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.000228:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648450176 00000100:00100000:1.0:1785774785.000240:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648450176 00000100:00100000:1.0:1785774785.000312:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5047 00000100:00100000:1.0:1785774785.000325:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:17767:x1872519648450176:12345-192.168.202.31@tcp:35:ls.0 00000100:00100000:1.0:1785774785.000627:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:17767:x1872519648450176:12345-192.168.202.31@tcp:35:ls.0 Request processed in 304us (551us total) trans 4294983507 rc 0/0 00000100:00100000:1.0:1785774785.000636:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5047 00000100:00100000:3.0:1785774785.005695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.007681:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648450432 00000100:00100000:1.0:1785774785.007696:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648450432 00000100:00100000:1.0:1785774785.007778:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23694 00000100:00100000:1.0:1785774785.007789:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17767:x1872519648450432:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774785.007816:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.007842:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e425 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcf3 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.007936:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.007953:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.007967:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.007994:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008004:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008011:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008080:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09e43a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008088:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09e43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008094:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09e43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008115:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008122:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008128:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008136:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008143:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.008148:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.008157:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009330:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:1.0:1785774785.009344:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.009351:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009358:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e42c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009377:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009383:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009390:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009394:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.009397:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009403:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009409:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xcefb0e88 (ffff9b7605fccd00) 00010000:00010000:1.0:1785774785.009412:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.009415:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009421:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e433 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009469:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e425 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcf3 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009486:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09e43a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcf3 expref: 30 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.009494:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605fcc700) 00010000:00010000:1.0:1785774785.009496:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774785.009499:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf000, rc 0) 00000100:00100000:1.0:1785774785.011618:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17767:x1872519648450432:12345-192.168.202.31@tcp:101:ls.0 Request processed in 3821us (5924us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.011634:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23694 00000100:00100000:3.0:1785774785.029636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.031605:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648450688 00000100:00100000:1.0:1785774785.031621:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648450688 00000100:00100000:1.0:1785774785.031699:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23695 00000100:00100000:1.0:1785774785.031711:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:17767:x1872519648450688:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774785.031751:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.031777:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e441 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1511:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bcfa expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.031974:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1511:0x0]: returning size 4096 00010000:00010000:1.0:1785774785.032301:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e441 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcfa expref: 40 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.032321:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605fccd00) 00010000:00010000:1.0:1785774785.032324:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774785.032330:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e441 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcfa expref: 40 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.032361:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:1.0:1785774785.032439:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:17767:x1872519648450688:12345-192.168.202.31@tcp:101:ls.0 Request processed in 731us (2818us total) trans 4294983508 rc 301/301 00000100:00100000:1.0:1785774785.032448:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23695 00000100:00100000:3.0:1785774785.049562:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648450816 00000100:00100000:3.0:1785774785.049575:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648450816 00000100:00100000:3.0:1785774785.049650:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23696 00000100:00100000:3.0:1785774785.049661:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:17767:x1872519648450816:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774785.049692:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.049721:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e44f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd01 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.049812:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d09e456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.049828:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d09e456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.049841:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d09e456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774785.049957:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1511:0x0]: returning size 4096 00000004:00200000:3.0:1785774785.049963:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785774785.049998:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d09e456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.050024:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e44f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd01 expref: 41 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.050050:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d09e456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd01 expref: 40 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.050060:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774785.050063:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774785.050067:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca0600, rc 0) 00000100:00100000:3.0:1785774785.053571:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:17767:x1872519648450816:12345-192.168.202.31@tcp:101:ls.0 Request processed in 3897us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.053586:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23696 00000100:00100000:0.0:1785774785.069447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.069558:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648450944 00000100:00100000:3.0:1785774785.069571:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648450944 00000100:00100000:3.0:1785774785.069648:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23697 00000100:00100000:3.0:1785774785.069659:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:17767:x1872519648450944:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774785.069687:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.069714:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e45d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.069786:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.069802:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.069819:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774785.069878:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xc2:0x0]: returning size 4096 00000004:00200000:3.0:1785774785.069884:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774785.069922:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e45d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 42 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.069940:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 41 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.069948:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc2:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:3.0:1785774785.069952:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774785.069955:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca0e00, rc 0) 00000100:00100000:3.0:1785774785.075068:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:17767:x1872519648450944:12345-192.168.202.31@tcp:101:ls.0 Request processed in 5391us (5904us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.075086:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23697 00000100:00100000:0.0:1785774785.081763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.081917:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648451072 00000100:00100000:3.0:1785774785.081931:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648451072 00000100:00100000:3.0:1785774785.082030:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23698 00000100:00100000:3.0:1785774785.082042:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17767:x1872519648451072:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774785.082071:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.082109:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e46b lrc: 2/0,0 mode: --/CR res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd0f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.082497:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.082516:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.082532:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774785.082599:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xc2:0x0]: returning size 4096 00000004:00200000:0.0:1785774785.082606:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1785774785.082657:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e46b lrc: 0/0,0 mode: --/CR res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 32 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.082679:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.082689:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:0.0:1785774785.082691:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774785.082696:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770149a000, rc 0) 00000100:00100000:0.0:1785774785.082774:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17767:x1872519648451072:12345-192.168.202.31@tcp:101:ls.0 Request processed in 734us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.082781:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23698 00000100:00100000:0.0:1785774785.101938:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.102211:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648451200 00000100:00100000:1.0:1785774785.102224:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648451200 00000100:00100000:1.0:1785774785.102294:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5048 00000100:00100000:1.0:1785774785.102306:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:17767:x1872519648451200:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:0.0:1785774785.130991:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648451328 00000100:00100000:0.0:1785774785.131003:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648451328 00000100:00100000:0.0:1785774785.131074:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5049 00000100:00100000:0.0:1785774785.131086:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732244050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17767:x1872519648451328:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:1.0:1785774785.158870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774785.169253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.169416:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648451840 00000100:00100000:3.0:1785774785.169428:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648451840 00000100:00100000:3.0:1785774785.169501:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23699 00000100:00100000:3.0:1785774785.169511:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+42:17767:x1872519648451840:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774785.169542:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.169568:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e479 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd16 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.169679:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.169695:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.169726:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.169740:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.169747:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.169771:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774785.169919:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 4096 00010000:00010000:3.0:1785774785.170001:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170008:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170013:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170019:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170024:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774785.170028:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170034:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170046:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:3.0:1785774785.170049:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774785.170054:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170061:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e480 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170074:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170081:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170086:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170090:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774785.170092:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170097:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170102:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xa20ac6a2 (ffff9b7602507500) 00010000:00010000:3.0:1785774785.170104:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774785.170106:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170112:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e487 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170151:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e479 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd16 expref: 44 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170207:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:3.0:1785774785.170211:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774785.170215:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e479 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd16 expref: 44 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.170225:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1400, rc 0) 00000100:00100000:3.0:1785774785.170459:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:17767:x1872519648451840:12345-192.168.202.31@tcp:101:ls.0 Request processed in 948us (1218us total) trans 4294983510 rc 301/301 00000100:00100000:3.0:1785774785.170468:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23699 00000100:00100000:3.0:1785774785.189105:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671189504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774785.189257:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.189621:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671189504 00000100:00100000:0.0:1785774785.189631:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671189504 00000100:00100000:0.0:1785774785.189694:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1785774785.189706:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671189504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774785.189738:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774785.189791:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671189504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.189800:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1785774785.189925:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671189504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774785.190000:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648451968 00000100:00100000:1.0:1785774785.190006:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648451968 00000100:00100000:1.0:1785774785.190045:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23700 00000100:00100000:1.0:1785774785.190053:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:17767:x1872519648451968:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774785.190071:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.190097:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e495 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd1d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.190241:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e49c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.190258:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.190271:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.190383:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 4096 00000004:00200000:1.0:1785774785.190390:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1785774785.190414:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.190443:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e495 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd1d expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.190462:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e49c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd1d expref: 44 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.190480:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff9b7605fccd00) 00010000:00010000:1.0:1785774785.190483:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774785.190487:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774785.190538:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:17767:x1872519648451968:12345-192.168.202.31@tcp:101:ls.0 Request processed in 486us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.190545:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23700 00000100:00100000:0.0:1785774785.208524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774785.219413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.219571:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648452224 00000100:00100000:3.0:1785774785.219584:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648452224 00000100:00100000:3.0:1785774785.219657:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23702 00000100:00100000:3.0:1785774785.219668:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17767:x1872519648452224:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774785.219695:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.219724:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e4b1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd2b expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.219799:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.219815:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.219830:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774785.219890:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xcd:0x0]: returning size 4096 00000004:00200000:3.0:1785774785.219897:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774785.219942:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e4b1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 33 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.219967:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 32 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.219976:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774785.219980:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774785.219994:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca0200, rc 0) 00000100:00100000:3.0:1785774785.220067:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17767:x1872519648452224:12345-192.168.202.31@tcp:101:ls.0 Request processed in 401us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.220076:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23702 00000100:00100000:3.0:1785774785.224383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774785.249725:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17767:x1872519648452352:12345-192.168.202.31@tcp:37:ls.0 Request processed in 25088us (25339us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.249744:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5051 00000100:00100000:3.0:1785774785.264912:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648452480 00000100:00100000:3.0:1785774785.264924:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648452480 00000100:00100000:3.0:1785774785.264996:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5052 00000100:00100000:3.0:1785774785.265006:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17767:x1872519648452480:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:3.0:1785774785.278565:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17767:x1872519648452480:12345-192.168.202.31@tcp:37:ls.0 Request processed in 13545us (13739us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.278585:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5052 00000100:00100000:0.0:1785774785.301497:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648452736 00000100:00100000:0.0:1785774785.301511:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648452736 00000100:00100000:0.0:1785774785.301584:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5053 00000100:00100000:0.0:1785774785.301596:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17767:x1872519648452736:12345-192.168.202.31@tcp:35:ls.0 00000100:00100000:0.0:1785774785.301892:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17767:x1872519648452736:12345-192.168.202.31@tcp:35:ls.0 Request processed in 298us (507us total) trans 4294983511 rc 0/0 00000100:00100000:0.0:1785774785.301900:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5053 00010000:00010000:0.0:1785774785.318779:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774785.325220:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648452992 00000100:00100000:1.0:1785774785.325234:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648452992 00000100:00100000:1.0:1785774785.325310:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23703 00000100:00100000:1.0:1785774785.325322:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17767:x1872519648452992:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774785.325361:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.325387:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4bf lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325477:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325492:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325519:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325533:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325540:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325564:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.325669:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1531:0x0]: returning size 4096 00010000:00010000:1.0:1785774785.325754:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325761:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325767:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325772:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325777:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.325781:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325787:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325813:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774785.325817:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.325821:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325827:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4c6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325839:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325846:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325851:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325855:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.325857:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325861:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325878:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9b7605fcc500) 00010000:00010000:1.0:1785774785.325879:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.325881:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325886:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4cd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325921:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4bf lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd32 expref: 48 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325929:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774785.325931:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774785.325934:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4bf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd32 expref: 48 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.325941:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:1.0:1785774785.326013:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17767:x1872519648452992:12345-192.168.202.31@tcp:101:ls.0 Request processed in 694us (972us total) trans 4294983512 rc 301/301 00000100:00100000:1.0:1785774785.326021:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23703 00000100:00100000:0.0:1785774785.356521:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648453120 00000100:00100000:0.0:1785774785.356534:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648453120 00000100:00100000:0.0:1785774785.356609:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23704 00000100:00100000:0.0:1785774785.356620:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17767:x1872519648453120:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774785.356652:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774785.356682:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e4db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd39 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.356815:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e4e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.356831:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.356846:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774785.356875:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1531:0x0]: returning size 4096 00000004:00200000:0.0:1785774785.356880:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774785.356901:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.356929:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e4db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd39 expref: 49 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.356950:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd39 expref: 48 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.356959:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9b7605dfd300) 00010000:00010000:0.0:1785774785.356963:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774785.356967:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:0.0:1785774785.357048:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17767:x1872519648453120:12345-192.168.202.31@tcp:101:ls.0 Request processed in 429us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.357055:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23704 00000100:00100000:3.0:1785774785.370515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.394662:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732246450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17767:x1872519648453248:12345-192.168.202.31@tcp:37:ls.0 Request processed in 23793us (24143us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.394685:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5054 00000100:00100000:1.0:1785774785.410451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.428751:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648453760 00000100:00100000:1.0:1785774785.428764:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648453760 00000100:00100000:1.0:1785774785.428838:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23705 00000100:00100000:1.0:1785774785.428849:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17767:x1872519648453760:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774785.428878:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.428904:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e4e9 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd40 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429011:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429029:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429042:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429058:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429065:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429072:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429509:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429522:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429530:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429548:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429556:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429563:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429571:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429577:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.429581:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429589:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429602:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdc00) 00010000:00010000:1.0:1785774785.429605:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.429610:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429617:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e4f0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429635:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429642:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429649:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429654:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.429657:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429663:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429669:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x61b4f7ef (ffff9b7605fcc500) 00010000:00010000:1.0:1785774785.429671:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.429673:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429679:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09e4f7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429715:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e4e9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd40 expref: 34 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429728:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd40 expref: 33 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.429743:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7605fcc600) 00010000:00010000:1.0:1785774785.429745:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774785.429747:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:0.0:1785774785.444757:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648453760:12345-192.168.202.31@tcp:101:ls.0 Request processed in 15893us (16117us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.444773:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23705 00000100:00100000:3.0:1785774785.449446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.470680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.471655:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648454144 00000100:00100000:3.0:1785774785.471669:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648454144 00000100:00100000:3.0:1785774785.471752:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23707 00000100:00100000:3.0:1785774785.471765:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:17767:x1872519648454144:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1785774785.471792:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.471822:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e513 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd4e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.471898:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.471914:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.471929:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774785.471988:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x2d:0x0]: returning size 4096 00000004:00200000:3.0:1785774785.472005:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774785.472048:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e513 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 35 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.472069:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 34 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.472079:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2d:0x0].0x0 (ffff9b7602507800) 00010000:00010000:3.0:1785774785.472083:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774785.472086:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1800, rc 0) 00000100:00100000:3.0:1785774785.474446:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:17767:x1872519648454144:12345-192.168.202.31@tcp:101:ls.0 Request processed in 2667us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.474459:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23707 00000100:00100000:3.0:1785774785.484631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774785.484876:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648454272 00000100:00100000:0.0:1785774785.484888:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648454272 00000100:00100000:0.0:1785774785.484961:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23708 00000100:00100000:0.0:1785774785.484971:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:17767:x1872519648454272:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1785774785.485007:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774785.485037:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e521 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd55 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.485135:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.485193:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.485302:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.485354:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.485372:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602759c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671189632:0@lo:104: 00000100:00100000:0.0:1785774785.485428:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.485490:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774785.487483:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671189632 00000100:00100000:3.0:1785774785.487496:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671189632 00000100:00100000:3.0:1785774785.487566:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1785774785.487575:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6530:x1872519671189632:12345-0@lo:104: 00010000:00010000:3.0:1785774785.487594:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.487684:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774785.487689:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6530:x1872519671189632:12345-0@lo:104: Request processed in 117us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.487696:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00010000:00010000:1.0:1785774785.487813:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774785.487822:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.487831:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774785.487835:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.487844:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.487879:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.487884:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774785.487917:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 1/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.487924:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ef0c00/0x7b7109e1d09dfcc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09dfd3 expref: -99 pid: 20646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.487944:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774785.487946:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774785.487949:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774785.487958:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774785.487971:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671189760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774785.488013:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.488053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671189760 00000100:00100000:1.0:1785774785.488058:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671189760 00010000:00010000:1.0:1785774785.488081:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.488119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:1.0:1785774785.488126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734582c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+18:3656:x1872519671189760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774785.488138:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1785774785.488739:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602759c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671189632:0@lo:104: 00010000:00010000:1.0:1785774785.488761:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1785774785.491996:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 394 00000004:00080000:1.0:1785774785.492075:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605f8b780 with version 724 00000020:00080000:1.0:1785774785.492088:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 391 cancel update log [0x240000401:0x3:0x0].378: rc = 0 00000020:00080000:1.0:1785774785.492241:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 391 cancel update log [0x200000400:0x3:0x0].378: rc = 0 00000004:00080000:1.0:1785774785.492268:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605f8b3c0 with version 725 00000020:00080000:1.0:1785774785.492271:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 392 cancel update log [0x240000401:0x3:0x0].379: rc = 0 00000020:00080000:1.0:1785774785.492292:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 392 cancel update log [0x200000400:0x3:0x0].379: rc = 0 00000004:00080000:1.0:1785774785.492355:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7603c85240 with version 726 00000020:00080000:1.0:1785774785.492359:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 393 cancel update log [0x240000401:0x3:0x0].380: rc = 0 00000004:00080000:0.0:1785774785.492362:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 724 rpc_version 724 00000020:00080000:1.0:1785774785.492381:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 393 cancel update log [0x200000400:0x3:0x0].380: rc = 0 00000004:00080000:1.0:1785774785.492398:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7603c853c0 with version 727 00000020:00080000:1.0:1785774785.492401:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 394 cancel update log [0x240000401:0x3:0x0].381: rc = 0 00000020:00100000:0.0:1785774785.492404:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:1.0:1785774785.492417:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 394 cancel update log [0x200000400:0x3:0x0].381: rc = 0 00000100:00100000:0.0:1785774785.492417:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7602759c00 x1872519671190016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1785774785.492423:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 394 00000100:00100000:0.0:1785774785.492446:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602759c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190016:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.492529:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.492570:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.494469:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671190016 00000100:00100000:1.0:1785774785.494485:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671190016 00000100:00100000:1.0:1785774785.494551:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549 00000100:00100000:1.0:1785774785.494561:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7689:x1872519671190016:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774785.494770:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671190016:12345-0@lo:1000:osp_up1-0.0 Request processed in 209us (2241us total) trans 4294968428 rc 0/0 00000100:00100000:1.0:1785774785.494778:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549 00000100:00100000:0.0:1785774785.499457:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602759c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190016:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774785.499480:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 725 rpc_version 725 00000020:00100000:0.0:1785774785.499518:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774785.499527:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7602759880 x1872519671190272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774785.499553:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602759880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190272:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.499632:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.499665:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.499690:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671190272 00000100:00100000:0.0:1785774785.499696:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671190272 00000100:00100000:0.0:1785774785.499757:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550 00000100:00100000:0.0:1785774785.499766:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671190272:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.499932:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671190272:12345-0@lo:1000:osp_up1-0.0 Request processed in 166us (299us total) trans 4294968429 rc 0/0 00000100:00100000:0.0:1785774785.499941:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550 00000100:00100000:0.0:1785774785.499972:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602759880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190272:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774785.499978:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 726 rpc_version 726 00000020:00100000:0.0:1785774785.499989:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774785.499995:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b78700 x1872519671190528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774785.500007:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190528:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.500029:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.500041:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.500071:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671190528 00000100:00100000:0.0:1785774785.500075:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671190528 00000100:00100000:0.0:1785774785.500096:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3551 00000100:00100000:0.0:1785774785.500102:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671190528:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.500268:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671190528:12345-0@lo:1000:osp_up1-0.0 Request processed in 165us (237us total) trans 4294968430 rc 0/0 00000100:00100000:0.0:1785774785.500276:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3551 00000100:00100000:0.0:1785774785.500309:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190528:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774785.500316:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 727 rpc_version 727 00000020:00100000:0.0:1785774785.500327:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774785.500342:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b79500 x1872519671190784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774785.500356:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190784:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.500383:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.500397:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.500411:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671190784 00000100:00100000:0.0:1785774785.500414:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671190784 00000100:00100000:0.0:1785774785.500435:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552 00000100:00100000:0.0:1785774785.500441:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671190784:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.500510:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671190784:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (126us total) trans 4294968431 rc 0/0 00000100:00100000:0.0:1785774785.500516:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552 00000100:00100000:0.0:1785774785.500546:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671190784:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1785774785.516379:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09dfd3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09dfcc expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.516408:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:3.0:1785774785.516413:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.516425:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.516432:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.516474:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774785.516582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734582c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671189760:12345-0@lo:103:ldlm_bl.0 Request processed in 28453us (28565us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.516593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00010000:00010000:1.0:1785774785.516699:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.516707:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.516849:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13e5:0x0]: returning size 4096 00000004:00200000:1.0:1785774785.516856:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1785774785.516880:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.516915:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09e521 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd55 expref: 43 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.516938:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd55 expref: 42 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.516946:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:1.0:1785774785.516949:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774785.516952:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744a00, rc 0) 00000100:00100000:1.0:1785774785.517021:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+42:17767:x1872519648454272:12345-192.168.202.31@tcp:101:ls.0 Request processed in 32053us (32403us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.517029:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23708 00000100:00100000:3.0:1785774785.551011:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648454400 00000100:00100000:3.0:1785774785.551024:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648454400 00000100:00100000:3.0:1785774785.551098:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5056 00000100:00100000:3.0:1785774785.551110:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:17767:x1872519648454400:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:0.0:1785774785.565715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.566367:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5057 00000100:00100000:1.0:1785774785.566382:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+42:17767:x1872519648454656:12345-192.168.202.31@tcp:35:ls.0 00000100:00100000:1.0:1785774785.566653:0:14532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14532:1872519671190912:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1785774785.566712:0:14532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.566833:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671190912 00000100:00100000:0.0:1785774785.566838:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671190912 00000100:00100000:0.0:1785774785.566870:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553 00000100:00100000:0.0:1785774785.566876:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14532:x1872519671190912:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1785774785.566949:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14532:x1872519671190912:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.566957:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553 00000100:00100000:1.0:1785774785.569383:0:14532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.569436:0:14532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e01880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14532:1872519671190912:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:1.0:1785774785.569687:0:14532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].382, 320 off579728 00000040:00080000:1.0:1785774785.569743:0:14532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].382, 400 off633568 00000004:00080000:1.0:1785774785.569749:0:14532:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605ce4300 with version 728 00000004:00080000:0.0:1785774785.571463:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 728 rpc_version 728 00000020:00100000:0.0:1785774785.571509:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774785.571520:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b7bb80 x1872519671191168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1536/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774785.571546:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671191168:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.571624:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.571730:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671191168 00000100:00100000:1.0:1785774785.571739:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671191168 00000100:00100000:1.0:1785774785.571804:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3554 00000100:00100000:1.0:1785774785.571812:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671191168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774785.572034:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671191168:12345-0@lo:1000:osp_up1-0.0 Request processed in 221us (409us total) trans 4294968432 rc 0/0 00000100:00100000:1.0:1785774785.572042:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3554 00000100:00100000:0.0:1785774785.581342:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.581432:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671191168:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774785.581708:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:17767:x1872519648454656:12345-192.168.202.31@tcp:35:ls.0 Request processed in 15325us (15999us total) trans 4294983515 rc 0/0 00000100:00100000:1.0:1785774785.581732:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5057 00000100:00100000:3.0:1785774785.640699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.640760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.641082:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648454784 00000100:00100000:1.0:1785774785.641094:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648454784 00000100:00100000:1.0:1785774785.641214:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3555 00000100:00100000:1.0:1785774785.641225:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:2416:x1872519648454784:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:1.0:1785774785.641276:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.641301:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09e52f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd5c expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641379:0:7692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641395:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641408:0:7692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641421:0:7692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641427:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641434:0:7692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641508:0:7692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d09e544 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641514:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d09e544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641519:0:7692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d09e544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.641613:0:7692:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 4096 00000004:00200000:1.0:1785774785.641618:0:7692:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1785774785.641662:0:7692:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d09e544 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641674:0:7692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641680:0:7692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641686:0:7692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641691:0:7692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.641695:0:7692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641702:0:7692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641714:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774785.641716:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.641720:0:7692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641725:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d09e536 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641737:0:7692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641746:0:7692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641751:0:7692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641755:0:7692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.641757:0:7692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641762:0:7692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641767:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xa20ac6a2 (ffff9b7605fcc800) 00010000:00010000:1.0:1785774785.641768:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.641770:0:7692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641774:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09e53d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641799:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09e52f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd5c expref: 45 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641810:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d09e544 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd5c expref: 44 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641815:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff9b7605fccd00) 00010000:00010000:1.0:1785774785.641817:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774785.641820:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700030e00, rc 0) 00010000:00010000:1.0:1785774785.641825:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.641831:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09e54b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd63 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641849:0:7692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641856:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641863:0:7692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641874:0:7692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641881:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641886:0:7692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641906:0:7692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09e560 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641912:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09e560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641918:0:7692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09e560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.641934:0:7692:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1531:0x0]: returning size 4096 00000004:00200000:1.0:1785774785.641937:0:7692:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1785774785.641945:0:7692:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09e560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641952:0:7692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641957:0:7692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641963:0:7692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641966:0:7692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.641969:0:7692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641973:0:7692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.641991:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774785.641993:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.641996:0:7692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642000:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d09e552 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642009:0:7692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642013:0:7692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642022:0:7692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642027:0:7692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.642029:0:7692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642033:0:7692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642039:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9b7605fcce00) 00010000:00010000:1.0:1785774785.642041:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.642044:0:7692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642049:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e559 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7692 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642066:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09e54b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd63 expref: 46 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642076:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09e560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd63 expref: 45 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.642082:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9b7605dfd300) 00010000:00010000:1.0:1785774785.642083:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774785.642086:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0000, rc 0) 00000100:00100000:1.0:1785774785.642198:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:2416:x1872519648454784:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 975us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.642224:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3555 00000100:00100000:0.0:1785774785.649535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.661479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774785.661597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648455424 00000100:00100000:0.0:1785774785.661610:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648455424 00000100:00100000:0.0:1785774785.661694:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1368 00000100:00100000:0.0:1785774785.661704:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:2416:x1872519648455424:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:0.0:1785774785.661723:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774785.661762:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e2b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc4b expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.661785:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff9b7604f39e00) 00010000:00010000:0.0:1785774785.661798:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774785.661865:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:2416:x1872519648455424:12345-192.168.202.31@tcp:103:rm.0 Request processed in 163us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.661872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1368 00000100:00100000:3.0:1785774785.664482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.666031:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671191296 00000100:00100000:3.0:1785774785.666037:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671191296 00000100:00100000:3.0:1785774785.666080:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556 00000100:00100000:3.0:1785774785.666088:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:8627:x1872519671191296:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774785.666102:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.666119:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e57c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e575 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.666147:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09e020 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb3a expref: 32 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.666190:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e57c lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e575 expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.666228:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09e020 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb3a expref: 32 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.666245:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09e020 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb3a expref: 32 pid: 6529 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.666258:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671191424:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774785.666326:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774785.684014:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671191296:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774785.684059:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.684076:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.684472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774785.685086:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671191552 00000100:00100000:0.0:1785774785.685090:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671191552 00000100:00100000:0.0:1785774785.685140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1785774785.685147:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671191552:12345-0@lo:105: 00010000:00010000:0.0:1785774785.685192:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.685204:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.685213:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.685221:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.685228:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.685237:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.685260:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35b000) 00000100:00100000:0.0:1785774785.685304:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671191552:12345-0@lo:105: Request processed in 157us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.685312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1785774785.685407:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671191552:0@lo:105: 00010000:00010000:1.0:1785774785.685427:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774785.685480:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:2416:x1872519648455808:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 801us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.685488:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1600 00000100:00100000:1.0:1785774785.685820:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671191680 00000100:00100000:1.0:1785774785.685825:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671191680 00000100:00100000:1.0:1785774785.685865:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3557 00000100:00100000:1.0:1785774785.685872:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:8627:x1872519671191680:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774785.685891:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.685908:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0c00/0x7b7109e1d09e58a lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e583 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.685929:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0c00/0x7b7109e1d09e58a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e583 expref: 12 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.685942:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0c00/0x7b7109e1d09e58a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e583 expref: 12 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.685950:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x2f36419c (ffff9b7605fcce00) 00010000:00010000:1.0:1785774785.685954:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.685957:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0c00, rc 0) 00000100:00100000:1.0:1785774785.685987:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:8627:x1872519671191680:12345-0@lo:101:mdt00_004.0 Request processed in 116us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.685992:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3557 00000100:00100000:1.0:1785774785.686360:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671191808 00000100:00100000:1.0:1785774785.686365:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671191808 00000100:00100000:1.0:1785774785.686388:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558 00000100:00100000:1.0:1785774785.686394:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:8627:x1872519671191808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774785.686472:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:8627:x1872519671191808:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.686480:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558 00000100:00100000:1.0:1785774785.686914:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671191936 00000100:00100000:1.0:1785774785.686918:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671191936 00000100:00100000:1.0:1785774785.686945:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559 00000100:00100000:1.0:1785774785.686951:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:8627:x1872519671191936:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774785.687051:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:8627:x1872519671191936:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (215us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774785.687057:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559 00000100:00100000:3.0:1785774785.687214:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671191936:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1785774785.687261:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.687270:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.687279:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.687291:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671192064:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774785.687318:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.687351:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d780 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.687461:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671192064 00000100:00100000:1.0:1785774785.687466:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671192064 00000100:00100000:1.0:1785774785.687498:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3560 00000100:00100000:1.0:1785774785.687505:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:8627:x1872519671192064:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774785.687513:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.687527:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e598 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e591 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.687547:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e598 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e591 expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.687558:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e598 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e591 expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.687571:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:1.0:1785774785.687574:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774785.687577:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0800, rc 0) 00000100:00100000:1.0:1785774785.687616:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:8627:x1872519671192064:12345-0@lo:101:mdt00_004.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.687623:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3560 00000100:00100000:0.0:1785774785.687796:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671192064:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774785.687809:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e598 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687820:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e598 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687853:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687861:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687870:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687890:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687902:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687911:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687934:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.687949:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 46 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.687960:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671192192:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774785.688027:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.696878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.697091:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671192192:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774785.697126:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.700561:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648455936 00000100:00100000:1.0:1785774785.700579:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648455936 00010000:00010000:1.0:1785774785.700636:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 47 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.700688:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1601 00000100:00100000:1.0:1785774785.700698:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:2417:x1872519648455936:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774785.700716:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774785.700724:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 47 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.700739:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 47 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.700768:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e2e3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc60 expref: 47 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.700785:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa5:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:1.0:1785774785.700790:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.700803:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.700812:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.700844:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774785.700918:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:2417:x1872519648455936:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 220us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.700927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1601 00010000:00010000:3.0:1785774785.706486:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.706508:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.706586:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.706593:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.706607:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.706634:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671192320:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774785.706711:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.706757:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.711453:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671192320 00000100:00100000:1.0:1785774785.711472:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671192320 00000100:00100000:1.0:1785774785.711572:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561 00000100:00100000:1.0:1785774785.711585:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:8627:x1872519671192320:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774785.711613:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.711642:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e5ad expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.711683:0:7692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.711694:0:7692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.711737:0:7692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.711753:0:7692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 31 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.711769:0:7692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7692:1872519671192448:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774785.711881:0:7692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4540 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.716471:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e01880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7692:1872519671192448:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774785.716521:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.716537:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa5:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774785.716541:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774785.716545:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.716557:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.716565:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0400, rc 0) 00000100:00100000:1.0:1785774785.716635:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:8627:x1872519671192320:12345-0@lo:101:mdt00_004.0 Request processed in 5052us (9923us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.716645:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561 00000100:00100000:3.0:1785774785.718481:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671192320:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774785.718509:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 4/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.718524:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 4/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.721131:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648456064 00000100:00100000:1.0:1785774785.721143:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648456064 00010000:00010000:1.0:1785774785.721239:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 32 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.721294:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1602 00000100:00100000:1.0:1785774785.721305:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:2416:x1872519648456064:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774785.721340:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774785.721349:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 32 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.721363:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 32 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.721392:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e2f1 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc67 expref: 32 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.721412:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa5:0x0].0x0 (ffff9b7702c6a500) 00010000:00010000:1.0:1785774785.721420:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 13 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.721433:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 13 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.721444:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 13 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.721490:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5b4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e5ad expref: 13 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.721508:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9541:1872519671192576:0@lo:105: 00000100:00100000:1.0:1785774785.721572:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.721612:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.721732:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671192576 00000100:00100000:0.0:1785774785.721738:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671192576 00000100:00100000:0.0:1785774785.721784:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1785774785.721792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9541:x1872519671192576:12345-0@lo:105: 00010000:00010000:0.0:1785774785.721804:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.721815:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.721824:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.721831:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.721839:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.721846:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.721876:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ca1000) 00000100:00100000:0.0:1785774785.721929:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9541:x1872519671192576:12345-0@lo:105: Request processed in 138us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.721938:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00010000:00010000:1.0:1785774785.724414:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.724434:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.725153:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671192704:0@lo:403:mdt00_004.0 00000100:00100000:1.0:1785774785.725261:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.725295:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4000 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.731189:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671192704:0@lo:403:mdt00_004.0 00000040:00080000:1.0:1785774785.732466:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].383, 952 off580680 00000040:00080000:1.0:1785774785.732674:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].383, 1032 off634600 00000004:00080000:1.0:1785774785.732681:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605ce4000 with version 729 00000100:00100000:0.0:1785774785.748553:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671192960 00000100:00100000:0.0:1785774785.748572:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671192960 00000100:00100000:0.0:1785774785.748653:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3563 00000100:00100000:0.0:1785774785.748665:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:7689:x1872519671192960:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.749298:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7689:x1872519671192960:12345-0@lo:1000:osp_up1-0.0 Request processed in 634us (16139us total) trans 4294968433 rc 0/0 00000100:00100000:0.0:1785774785.749309:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3563 00000004:00200000:1.0:1785774785.749892:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d2:0x0]: returning size 4096 00010000:00010000:1.0:1785774785.749923:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.749935:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.749943:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.749950:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.749955:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.749964:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.749982:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa5:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:1.0:1785774785.749987:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774785.749994:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750000:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09e5a6 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750025:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750035:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750043:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1000/0x7b7109e1d09e5ad lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e5b4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750073:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774785.750084:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xa5:0x0] 00010000:00010000:1.0:1785774785.750095:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750110:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750116:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750121:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770149ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774785.750124:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750130:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750139:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d2:0x0].0x0 (ffff9b7605dfdb00) 00010000:00010000:1.0:1785774785.750141:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.750144:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750151:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e59f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750205:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e598 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750214:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e598 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750221:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ca1200/0x7b7109e1d09e591 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e598 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750238:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1785774785.750250:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1785774785.750255:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750263:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750270:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b000/0x7b7109e1d09e575 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e57c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750287:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:1.0:1785774785.750292:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1785774785.750297:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ba00/0x7b7109e1d09e583 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e58a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.750306:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ba00/0x7b7109e1d09e583 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e58a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.750400:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648455680:12345-192.168.202.31@tcp:36:rm.0 Request processed in 85042us (85926us total) trans 4294983518 rc 0/0 00000100:00100000:1.0:1785774785.750409:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23710 00010000:00010000:3.0:1785774785.751342:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774785.751352:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774785.751363:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671193088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774785.751398:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.751938:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671193088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774785.756712:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774785.762502:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648456320 00000100:00100000:1.0:1785774785.762514:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648456320 00000100:00100000:1.0:1785774785.762585:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23711 00000100:00100000:1.0:1785774785.762595:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648456320:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1785774785.762626:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.762651:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd71 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.762833:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 4096 00010000:00010000:1.0:1785774785.762940:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5bb lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd71 expref: 48 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.762956:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff9b7605fccd00) 00010000:00010000:1.0:1785774785.762959:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774785.762963:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd71 expref: 48 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.762975:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0400, rc 0) 00000100:00100000:1.0:1785774785.763040:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648456320:12345-192.168.202.31@tcp:101:rm.0 Request processed in 447us (629us total) trans 4294983519 rc 301/301 00000100:00100000:1.0:1785774785.763049:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23711 00000100:00100000:0.0:1785774785.778663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774785.779554:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d09e5de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779565:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d09e5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779575:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d09e5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774785.779678:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1441:0x0]: returning size 4096 00000004:00200000:3.0:1785774785.779685:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785774785.779716:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d09e5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779730:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e5d0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779736:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e5d0 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779742:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e5d0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779749:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35aa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774785.779753:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e5d0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779761:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e5d0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779774:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:3.0:1785774785.779778:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774785.779782:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e5d0 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779788:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09e5d0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779806:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779812:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e5d7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779818:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779823:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774785.779826:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779832:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e5d7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779839:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x4fa399f7 (ffff9b7604f39f00) 00010000:00010000:3.0:1785774785.779842:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774785.779844:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e5d7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779849:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e5d7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779885:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e5c9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd78 expref: 49 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779899:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d09e5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd78 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.779912:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1441:0x0].0x0 (ffff9b7605dfd600) 00010000:00010000:3.0:1785774785.779915:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774785.779918:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca0c00, rc 0) 00000100:00100000:3.0:1785774785.780010:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:2417:x1872519648456448:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 1086us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.780020:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3564 00000100:00100000:0.0:1785774785.782622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774785.782735:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648456704 00000100:00100000:1.0:1785774785.782747:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648456704 00000100:00100000:1.0:1785774785.782817:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5059 00000100:00100000:1.0:1785774785.782829:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648456704:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1785774785.783102:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:17768:x1872519648456704:12345-192.168.202.31@tcp:35:rm.0 Request processed in 274us (488us total) trans 4294983520 rc 0/0 00000100:00100000:1.0:1785774785.783111:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5059 00000100:00100000:1.0:1785774785.795502:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648456960 00000100:00100000:1.0:1785774785.795515:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648456960 00000100:00100000:1.0:1785774785.795589:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23712 00000100:00100000:1.0:1785774785.795600:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:17768:x1872519648456960:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774785.795676:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1785774785.795710:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d09e544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd5c expref: 49 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795734:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e49c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd1d expref: 48 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795747:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff9b7605fccd00) 00010000:00010000:1.0:1785774785.795766:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09e012 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb33 expref: 47 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795775:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fd8700) 00010000:00010000:1.0:1785774785.795783:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774785.795809:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795824:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795835:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795847:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795855:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795862:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795940:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795948:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795955:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795976:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.795998:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e4aa lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd24 expref: 46 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.796014:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 4/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.796054:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e4aa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd24 expref: 46 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.796069:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e4aa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd24 expref: 46 pid: 6529 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.796086:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671193472:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774785.796787:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77346ff840 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.801638:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648457088 00000100:00100000:0.0:1785774785.801647:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648457088 00010000:00010000:0.0:1785774785.801692:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e4aa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd24 expref: 47 pid: 6529 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.801738:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1603 00000100:00100000:0.0:1785774785.801748:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:2416:x1872519648457088:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774785.801765:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774785.801773:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e4aa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd24 expref: 47 pid: 6529 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.801787:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e4aa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd24 expref: 47 pid: 6529 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.801813:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e4aa lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd24 expref: 47 pid: 6529 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.801831:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff9b7604f39c00) 00010000:00010000:0.0:1785774785.801836:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.801853:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.801862:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.801893:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774785.801953:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:2416:x1872519648457088:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 206us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.801962:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1603 00010000:00010000:1.0:1785774785.802021:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.802031:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.802083:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.802092:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.802104:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.802127:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671193600:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1785774785.802209:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.802233:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77346ff780 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.803321:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671193600 00000100:00100000:0.0:1785774785.803338:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671193600 00000100:00100000:0.0:1785774785.803380:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565 00000100:00100000:0.0:1785774785.803387:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:8469:x1872519671193600:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774785.803411:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774785.803429:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e601 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.803457:0:20645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 30 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.803467:0:20645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.803493:0:20645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 30 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.803508:0:20645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 30 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.803522:0:20645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20645:1872519671193728:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774785.803589:0:20645:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.812528:0:20645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20645:1872519671193728:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774785.812582:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.812598:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7602507500) 00010000:00010000:0.0:1785774785.812601:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774785.812606:0:20645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.812616:0:20645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.812623:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2000, rc 0) 00000100:00100000:0.0:1785774785.812725:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:8469:x1872519671193600:12345-0@lo:101:mdt00_003.0 Request processed in 9338us (10515us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.812736:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565 00000100:00100000:1.0:1785774785.820573:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671193600:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774785.820614:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.820631:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.822706:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648457216 00000100:00100000:1.0:1785774785.822716:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648457216 00010000:00010000:1.0:1785774785.822760:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 31 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.822809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1604 00000100:00100000:1.0:1785774785.822818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:2417:x1872519648457216:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774785.822837:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774785.822845:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 31 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.822859:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 31 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.822885:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0200/0x7b7109e1d09e4b8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd2b expref: 31 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.822904:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7602507500) 00010000:00010000:1.0:1785774785.822911:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 12 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.822931:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 12 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.822941:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 12 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.822983:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 12 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.823000:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6514:1872519671193856:0@lo:105: 00000100:00100000:1.0:1785774785.823057:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.823091:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77346ff780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774785.823473:0:16514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785774785.823488:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671193856 00000100:00100000:3.0:1785774785.823491:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671193856 00000100:00100000:3.0:1785774785.823532:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1785774785.823541:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7601bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671193856:12345-0@lo:105: 00010000:00010000:3.0:1785774785.823553:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.823562:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.823570:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.823577:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.823583:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.823594:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.823616:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b76057cea00) 00000100:00100000:3.0:1785774785.823658:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7601bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671193856:12345-0@lo:105: Request processed in 118us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.823664:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1785774785.823755:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6514:1872519671193856:0@lo:105: 00010000:00010000:3.0:1785774785.823772:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774785.823810:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2417:x1872519648457216:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 994us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.823817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1604 00010000:00010000:1.0:1785774785.824057:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.824067:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.824779:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671193984:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1785774785.824828:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.824847:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77346ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774785.825059:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671193984 00000100:00100000:3.0:1785774785.825064:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671193984 00000100:00100000:3.0:1785774785.825100:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3566 00000100:00100000:3.0:1785774785.825107:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:8469:x1872519671193984:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1785774785.826910:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:8469:x1872519671193984:12345-0@lo:403:mdt00_003.0 Request processed in 1799us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.826920:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3566 00000100:00100000:1.0:1785774785.827425:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671193984:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1785774785.828384:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].384, 952 off581632 00000040:00080000:1.0:1785774785.828587:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].384, 1032 off635632 00000004:00080000:1.0:1785774785.828594:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b77346ffe40 with version 730 00000004:00080000:0.0:1785774785.828806:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 730 rpc_version 730 00000020:00100000:0.0:1785774785.828844:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774785.828854:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b79f80 x1872519671194240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774785.828876:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671194240:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774785.828929:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.828964:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.833445:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671194240:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1785774785.842623:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 4096 00010000:00010000:0.0:1785774785.842666:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842680:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842689:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842696:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774785.842702:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842712:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842733:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff9b7604f39c00) 00010000:00010000:0.0:1785774785.842736:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774785.842741:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842749:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e5fa lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842777:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842786:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842794:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.842956:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774785.842970:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xcd:0x0] 00010000:00010000:0.0:1785774785.843038:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843047:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843054:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843060:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770149ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774785.843063:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843070:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843079:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:0.0:1785774785.843082:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774785.843085:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843093:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d09e5f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843130:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843137:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843145:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843151:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843156:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774785.843174:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843180:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843188:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fcc200) 00010000:00010000:0.0:1785774785.843191:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774785.843194:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843200:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d09e5e5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774785.843214:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c539ca48 reply state 0000000094e5aff8 transno 4294983521 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843228:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.843236:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xa20ac6a2 (ffff9b7605fcc500) 00010000:00010000:0.0:1785774785.843238:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774785.843242:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774785.843416:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648456960:12345-192.168.202.31@tcp:36:rm.0 Request processed in 47810us (48340us total) trans 4294983521 rc 0/0 00000100:00100000:0.0:1785774785.843428:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23712 00010000:00010000:1.0:1785774785.854817:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774785.854840:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.854855:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774785.854865:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774785.854877:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.855021:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.855031:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774785.855069:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.855084:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cea00/0x7b7109e1d09e601 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e608 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.855116:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774785.855118:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774785.855120:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774785.855215:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671194368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774785.855320:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.855539:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671194368 00000100:00100000:3.0:1785774785.855548:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671194368 00000100:00100000:3.0:1785774785.855622:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1785774785.855631:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3655:x1872519671194368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774785.855646:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774785.855670:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e608 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e601 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.855686:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcd:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774785.855697:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774785.855751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3655:x1872519671194368:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.855758:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:1.0:1785774785.855845:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671194368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774785.869665:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648457472 00000100:00100000:1.0:1785774785.869678:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648457472 00000100:00100000:1.0:1785774785.869757:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23713 00000100:00100000:1.0:1785774785.869769:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17768:x1872519648457472:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1785774785.869797:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.869824:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e60f lrc: 2/0,0 mode: --/CR res: [0x240000402:0xba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd7f expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774785.870029:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xba:0x0]: returning size 4096 00010000:00010000:1.0:1785774785.870223:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e60f lrc: 1/0,0 mode: --/CR res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd7f expref: 32 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.870242:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xba:0x0].0x0 (ffff9b7605dfdd00) 00010000:00010000:1.0:1785774785.870246:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774785.870251:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09e60f lrc: 0/0,0 mode: --/CR res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd7f expref: 32 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.870270:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774785.870363:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17768:x1872519648457472:12345-192.168.202.31@tcp:101:rm.0 Request processed in 596us (824us total) trans 4294968435 rc 301/301 00000100:00100000:1.0:1785774785.870371:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23713 00000100:00100000:0.0:1785774785.880465:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648457728 00000100:00100000:0.0:1785774785.880478:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648457728 00000100:00100000:0.0:1785774785.880552:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5060 00000100:00100000:0.0:1785774785.880571:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732245450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:17768:x1872519648457728:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:0.0:1785774785.880859:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732245450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17768:x1872519648457728:12345-192.168.202.31@tcp:35:rm.0 Request processed in 297us (540us total) trans 4294968436 rc 0/0 00000100:00100000:0.0:1785774785.880868:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5060 00000100:00100000:3.0:1785774785.888825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774785.888874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774785.898584:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648458112 00000100:00100000:0.0:1785774785.898604:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648458112 00000100:00100000:0.0:1785774785.898692:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23714 00000100:00100000:0.0:1785774785.898704:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:17768:x1872519648458112:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774785.898811:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774785.898848:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09e0f2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb8e expref: 32 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.898871:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xba:0x0].0x0 (ffff9b7605dfdd00) 00010000:00010000:0.0:1785774785.898884:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774785.898947:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.898956:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.898973:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.899014:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194496:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1785774785.899097:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.899150:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774785.899608:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671194496 00000100:00100000:3.0:1785774785.899615:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671194496 00000100:00100000:3.0:1785774785.899658:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568 00000100:00100000:3.0:1785774785.899666:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6529:x1872519671194496:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774785.899684:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.899705:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e624 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e61d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.899732:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e624 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e61d expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.899747:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e624 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e61d expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.899757:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774785.899760:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774785.899762:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1400, rc 0) 00000100:00100000:3.0:1785774785.910412:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671194496:12345-0@lo:101:mdt00_000.0 Request processed in 10728us (11296us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.910626:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568 00000100:00100000:0.0:1785774785.912119:0:6529:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983505 gen 2 00000004:00080000:0.0:1785774785.912130:0:6529:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983502 committed transno 4294983505 00000004:00080000:0.0:1785774785.912156:0:6529:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983503 committed transno 4294983505 00000004:00080000:0.0:1785774785.912179:0:6529:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983504 committed transno 4294983505 00000004:00080000:0.0:1785774785.912189:0:6529:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983505 committed transno 4294983505 00000100:00100000:0.0:1785774785.912217:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194496:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774785.912249:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.912266:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774785.912290:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774785.912361:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.912368:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.912379:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.912400:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194624:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1785774785.912576:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774785.912635:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.915748:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671194624 00000100:00100000:1.0:1785774785.915767:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671194624 00000100:00100000:1.0:1785774785.915846:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3569 00000100:00100000:1.0:1785774785.915858:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671194624:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774785.915883:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774785.915913:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e632 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e62b expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.915964:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e632 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e62b expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.915989:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e632 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e62b expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.915999:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x2ad0e892 (ffff9b7605fccd00) 00010000:00010000:1.0:1785774785.916002:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774785.916006:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774785.916099:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671194624:12345-0@lo:101:mdt00_000.0 Request processed in 243us (3522us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.916106:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3569 00000100:00100000:1.0:1785774785.916181:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194624:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774785.916496:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e632 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.916510:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e632 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774785.916536:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1785774785.916660:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194752:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785774785.916704:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774785.924634:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.941607:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3570 00000100:00100000:0.0:1785774785.941626:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671194752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785774785.941800:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671194752:12345-0@lo:1000:mdt00_000.0 Request processed in 180us (25095us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.941809:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3570 00000100:00100000:3.0:1785774785.942143:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194752:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774785.942269:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194880:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774785.942317:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.942377:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4db40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.942442:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671194880 00000100:00100000:1.0:1785774785.942450:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671194880 00000100:00100000:1.0:1785774785.942491:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571 00000100:00100000:1.0:1785774785.942499:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671194880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785774785.942614:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671194880:12345-0@lo:1000:mdt00_000.0 Request processed in 116us (296us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774785.942622:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571 00000100:00100000:3.0:1785774785.942758:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671194880:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1785774785.942824:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.942836:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.942847:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.942863:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671195008:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1785774785.942886:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.942908:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774785.942920:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671195008 00000100:00100000:3.0:1785774785.942924:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671195008 00000100:00100000:3.0:1785774785.942944:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3572 00000100:00100000:3.0:1785774785.942950:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671195008:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774785.942960:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774785.942988:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d09e640 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e639 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943017:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d09e640 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e639 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943034:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d09e640 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e639 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943044:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xba:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774785.943047:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774785.943051:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1200, rc 0) 00000100:00100000:3.0:1785774785.943078:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:6529:x1872519671195008:12345-0@lo:101:mdt00_000.0 Request processed in 128us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774785.943084:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3572 00000100:00100000:3.0:1785774785.943107:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671195008:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774785.943120:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e640 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943139:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e640 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943186:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1000/0x7b7109e1d09e647 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943195:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1000/0x7b7109e1d09e647 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943205:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1000/0x7b7109e1d09e647 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943222:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 3/0,1 mode: --/EX res: [0x240000400:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943236:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943246:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 4/0,1 mode: --/EX res: [0x240000400:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943270:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.943285:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 31 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.943297:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671195136:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774785.943381:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d180 going to sleep for 11 seconds 00000100:00100000:1.0:1785774785.950516:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648458240 00000100:00100000:1.0:1785774785.950529:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648458240 00010000:00010000:1.0:1785774785.950584:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 32 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774785.950643:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1605 00000100:00100000:1.0:1785774785.950654:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:2416:x1872519648458240:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774785.950676:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774785.950685:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 32 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.950707:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 32 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.950736:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x63:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:1.0:1785774785.950742:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 3/0,1 mode: --/EX res: [0x240000400:0x63:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.950754:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x63:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.950763:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x63:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774785.950788:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774785.950866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:2416:x1872519648458240:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 213us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.950876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1605 00010000:00010000:3.0:1785774785.967295:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e100 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb95 expref: 31 pid: 6531 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.967353:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671195136:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774785.967383:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.967394:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.967399:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca0a00/0x7b7109e1d09e64e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.968709:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.968723:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.968738:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.968767:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671195264:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1785774785.968851:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.968890:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.969020:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671195264 00000100:00100000:0.0:1785774785.969030:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671195264 00000100:00100000:0.0:1785774785.969116:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573 00000100:00100000:0.0:1785774785.969128:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:6529:x1872519671195264:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774785.969150:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774785.969193:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e655 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.969225:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.969238:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 4/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.969267:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.969283:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 45 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774785.969301:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671195392:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774785.969394:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.979344:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671195392:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774785.979390:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 3/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.979405:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b7605dfd400) 00010000:00010000:0.0:1785774785.979408:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774785.979412:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 3/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.979422:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 3/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.979428:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3600, rc 0) 00000100:00100000:0.0:1785774785.979506:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671195264:12345-0@lo:101:mdt00_000.0 Request processed in 10380us (10654us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.979530:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573 00000100:00100000:3.0:1785774785.981935:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648458368 00000100:00100000:3.0:1785774785.981948:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648458368 00010000:00010000:3.0:1785774785.981997:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 46 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.982048:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1606 00000100:00100000:3.0:1785774785.982059:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:2417:x1872519648458368:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774785.982079:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774785.982087:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 46 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.982112:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 46 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.982137:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09e10e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb9c expref: 46 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.982155:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b7605dfd400) 00010000:00010000:3.0:1785774785.982222:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.982235:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.982245:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774785.982286:0:19895:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774785.982304:0:19895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f710e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19895:1872519671195520:0@lo:105: 00000100:00100000:3.0:1785774785.982382:0:19895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774785.982422:0:19895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4db40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774785.983291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671195520 00000100:00100000:0.0:1785774785.983299:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671195520 00000100:00100000:0.0:1785774785.983352:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1785774785.983360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671195520:12345-0@lo:105: 00010000:00010000:0.0:1785774785.983373:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.983388:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.983396:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.983403:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.983410:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.983418:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774785.983443:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ca0200) 00000100:00100000:0.0:1785774785.983505:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671195520:12345-0@lo:105: Request processed in 146us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774785.983512:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1785774785.983613:0:19895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f710e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19895:1872519671195520:0@lo:105: 00010000:00010000:1.0:1785774785.983634:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774785.983696:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:2417:x1872519648458368:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1637us (5391us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774785.983704:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1606 00000100:00100000:1.0:1785774785.998724:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671195648 00000100:00100000:1.0:1785774785.998744:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671195648 00000100:00100000:1.0:1785774785.998818:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574 00000100:00100000:1.0:1785774785.998829:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671195648:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1785774786.002998:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671195648:12345-0@lo:403:mdt00_000.0 Request processed in 4158us (18235us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.003020:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574 00000004:00080000:0.0:1785774786.012383:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 761 rpc_version 761 00000020:00100000:0.0:1785774786.012435:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774786.012447:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b79180 x1872519671195904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774786.012477:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671195904:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774786.012568:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.012611:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.017555:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671195904:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1785774786.021529:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774786.021551:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021565:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.021574:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.021584:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021652:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021659:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.021707:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021715:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0200/0x7b7109e1d09e655 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e65c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021742:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774786.021746:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e640 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021752:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.021756:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e640 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.021763:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e640 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021783:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 4/0,0 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e640 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021789:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.021821:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ca0000/0x7b7109e1d09e639 lrc: 3/0,0 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e640 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.021831:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.021833:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.021835:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774786.031660:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774786.031704:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671196032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.031808:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.031872:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774786.031882:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671196160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.031905:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.032016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671196032 00000100:00100000:1.0:1785774786.032026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671196032 00000100:00100000:1.0:1785774786.032099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1785774786.032110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734581450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3655:x1872519671196032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.032129:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.032185:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e65c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e655 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.032219:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b7605dfd400) 00010000:00010000:1.0:1785774786.032234:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.032280:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734581450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3655:x1872519671196032:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.032288:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1785774786.032352:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671196160 00000100:00100000:1.0:1785774786.032357:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671196160 00000100:00100000:1.0:1785774786.032384:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1785774786.032390:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3654:x1872519671196160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.032397:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.032409:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d09e640 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xba:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e639 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.032420:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xba:0x0].0x0 (ffff9b7602507400) 00010000:00010000:1.0:1785774786.032428:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.032458:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3654:x1872519671196160:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.032465:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1785774786.032513:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671196160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.032546:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671196032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774786.033091:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774786.033098:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.033106:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774786.033112:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774786.033121:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.033193:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.033201:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774786.033221:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.033229:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3800/0x7b7109e1d09e61d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e624 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.033242:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774786.033244:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774786.033247:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774786.033252:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774786.033261:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671196288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.033290:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774786.033406:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774786.033754:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671196288 00000100:00100000:1.0:1785774786.033760:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671196288 00000100:00100000:1.0:1785774786.033797:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1785774786.033805:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+16:3653:x1872519671196288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.033815:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.033829:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d09e624 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e61d expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.033842:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7602507500) 00010000:00010000:1.0:1785774786.033850:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.033884:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671196288:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.033891:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1785774786.034272:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671196288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.045557:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648458624 00000100:00100000:0.0:1785774786.045569:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648458624 00000100:00100000:0.0:1785774786.045660:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23715 00000100:00100000:0.0:1785774786.045673:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648458624:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1785774786.045706:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.045731:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e663 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1484:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd86 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774786.045936:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1484:0x0]: returning size 4096 00010000:00010000:0.0:1785774786.046057:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e663 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd86 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.046075:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7605dfd800) 00010000:00010000:0.0:1785774786.046079:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774786.046084:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e663 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd86 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.046107:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2a00, rc 0) 00000100:00100000:0.0:1785774786.046257:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648458624:12345-192.168.202.31@tcp:101:rm.0 Request processed in 587us (838us total) trans 4294983523 rc 301/301 00000100:00100000:0.0:1785774786.046265:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23715 00000100:00080000:3.0:1785774786.047085:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774786.059708:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.059800:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648458880 00000100:00100000:3.0:1785774786.059812:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648458880 00000100:00100000:3.0:1785774786.059878:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5061 00000100:00100000:3.0:1785774786.059888:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648458880:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:0.0:1785774786.083212:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648458880:12345-192.168.202.31@tcp:35:rm.0 Request processed in 23274us (23465us total) trans 4294983524 rc 0/0 00000100:00100000:0.0:1785774786.083234:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5061 00000100:00100000:0.0:1785774786.087238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.087279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.087429:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648459264 00000100:00100000:3.0:1785774786.087442:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648459264 00000100:00100000:3.0:1785774786.087512:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23716 00000100:00100000:3.0:1785774786.087525:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648459264:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774786.087598:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.087634:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09e281 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc36 expref: 47 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.087657:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7605dfd800) 00010000:00010000:3.0:1785774786.087671:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774786.087736:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.087745:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.087756:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.087785:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196416:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774786.087850:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.087909:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.087989:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671196416 00000100:00100000:0.0:1785774786.087994:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671196416 00000100:00100000:0.0:1785774786.088037:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576 00000100:00100000:0.0:1785774786.088045:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6530:x1872519671196416:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774786.088060:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.088078:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e678 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e671 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.088104:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e678 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e671 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.088120:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e678 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e671 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.088127:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdd00) 00010000:00010000:0.0:1785774786.088130:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.088133:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2a00, rc 0) 00000100:00100000:0.0:1785774786.088208:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:6530:x1872519671196416:12345-0@lo:101:mdt00_001.0 Request processed in 163us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.088216:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576 00000100:00100000:3.0:1785774786.088587:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196416:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774786.088607:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e678 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.088617:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e678 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774786.088639:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1785774786.088662:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.088668:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.088676:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.088688:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196544:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774786.090135:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.090271:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.090310:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671196544 00000100:00100000:3.0:1785774786.090474:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671196544 00000100:00100000:3.0:1785774786.090535:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577 00000100:00100000:1.0:1785774786.091224:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648459008 00000100:00100000:1.0:1785774786.091236:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648459008 00000100:00100000:3.0:1785774786.091262:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6530:x1872519671196544:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774786.091289:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1785774786.091342:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1377 00000100:00100000:1.0:1785774786.091357:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:2416:x1872519648459008:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:3.0:1785774786.091373:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d09e686 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e67f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.091376:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.091407:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e265 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc28 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.091412:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d09e686 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e67f expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.091459:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d09e686 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e67f expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.091464:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:3.0:1785774786.091480:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xad49086a (ffff9b7602507d00) 00010000:00010000:1.0:1785774786.091483:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774786.091485:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774786.091491:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:1.0:1785774786.091794:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648459008:12345-192.168.202.31@tcp:103:rm.0 Request processed in 440us (4566us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.091804:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1377 00000100:00080000:1.0:1785774786.091828:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774786.096548:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6530:x1872519671196544:12345-0@lo:101:mdt00_001.0 Request processed in 5997us (6410us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.096563:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577 00000100:00100000:0.0:1785774786.098493:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196544:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774786.098532:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.098549:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774786.098579:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1785774786.098655:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196672:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774786.098723:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.098783:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.099088:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196672:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774786.099284:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196800:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774786.099674:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.099708:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.099930:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196800:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1785774786.099982:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745e00/0x7b7109e1d09e68d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.099990:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745e00/0x7b7109e1d09e68d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.099999:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745e00/0x7b7109e1d09e68d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.100012:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671196928:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774786.100037:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.100055:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.100066:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671196928 00000100:00100000:3.0:1785774786.100069:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671196928 00000100:00100000:3.0:1785774786.100090:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580 00000100:00100000:3.0:1785774786.100095:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6530:x1872519671196928:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774786.100104:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774786.100117:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e694 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e68d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.100137:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e694 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e68d expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.100148:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e694 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e68d expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.100155:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7602507600) 00010000:00010000:3.0:1785774786.100177:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774786.100181:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744000, rc 0) 00000100:00100000:3.0:1785774786.100709:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6530:x1872519671196928:12345-0@lo:101:mdt00_001.0 Request processed in 612us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.100715:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580 00010000:00010000:0.0:1785774786.115641:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.115653:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.115663:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.115683:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.115694:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.115705:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.115736:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.115751:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 46 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.115764:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671197056:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774786.115846:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.120092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.120242:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671197056:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774786.120277:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.120385:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648459392 00000100:00100000:1.0:1785774786.120399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648459392 00010000:00010000:1.0:1785774786.120445:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 47 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.120494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1607 00000100:00100000:1.0:1785774786.120502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:2416:x1872519648459392:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.120516:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.120521:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 47 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.120533:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 47 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.120554:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09e28f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc3d expref: 47 pid: 6530 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.120569:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7d:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:1.0:1785774786.120574:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.120583:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.120589:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.120736:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.120794:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:2416:x1872519648459392:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 292us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.120800:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1607 00010000:00010000:3.0:1785774786.122754:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.122767:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.122820:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.122827:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.122838:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.122858:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671197184:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774786.122932:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.123007:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.131527:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581 00000100:00100000:0.0:1785774786.131542:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6530:x1872519671197184:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774786.131562:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.131583:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e6b0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e6a9 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.131622:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e29d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc44 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.131634:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e6b0 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e6a9 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.131675:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e29d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc44 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.131693:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e29d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc44 expref: 29 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.131707:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307fb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671197312:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774786.131797:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.137753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.138051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648459520 00000100:00100000:1.0:1785774786.138057:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648459520 00010000:00010000:1.0:1785774786.138083:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e29d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc44 expref: 30 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.138115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1608 00000100:00100000:1.0:1785774786.138122:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648459520:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.138138:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.138144:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e29d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc44 expref: 30 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.138155:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e29d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc44 expref: 30 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.138204:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e29d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc44 expref: 30 pid: 8627 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.138225:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7d:0x0].0x0 (ffff9b7604f39500) 00010000:00010000:1.0:1785774786.138229:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e6b0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6a9 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.138239:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e6b0 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e6a9 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.138248:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e6b0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e6a9 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.138275:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e6b0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6a9 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.138287:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671197440:0@lo:105: 00000100:00100000:1.0:1785774786.138334:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.138363:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.138530:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671197440 00000100:00100000:0.0:1785774786.138534:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671197440 00000100:00100000:0.0:1785774786.138567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1785774786.138573:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671197440:12345-0@lo:105: 00010000:00010000:0.0:1785774786.138583:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.138593:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.138601:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.139405:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.139413:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.139422:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.139437:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec0000) 00000100:00100000:0.0:1785774786.139472:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671197440:12345-0@lo:105: Request processed in 898us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.139479:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1785774786.139716:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671197184:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774786.139729:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.142476:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fe2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671197568:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1785774786.142540:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.142571:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.150130:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6530:x1872519671197568:12345-0@lo:403:mdt00_001.0 Request processed in 7017us (7581us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.150144:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582 00000100:00100000:3.0:1785774786.153311:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671197568:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1785774786.157700:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].385, 952 off582584 00000040:00080000:3.0:1785774786.157859:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].385, 1032 off636664 00000004:00080000:3.0:1785774786.157866:0:6530:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605e4de40 with version 731 00000004:00080000:1.0:1785774786.160492:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 731 rpc_version 731 00000020:00100000:1.0:1785774786.160531:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774786.160540:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7604e03480 x1872519671197824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774786.160561:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671197824:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774786.160632:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.160659:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.161552:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671197824 00000100:00100000:3.0:1785774786.161559:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671197824 00000100:00100000:3.0:1785774786.161617:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583 00000100:00100000:3.0:1785774786.161624:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:7689:x1872519671197824:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774786.161970:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:7689:x1872519671197824:12345-0@lo:1000:osp_up1-0.0 Request processed in 346us (1337us total) trans 4294968438 rc 0/0 00000100:00100000:3.0:1785774786.161978:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583 00000100:00100000:1.0:1785774786.162190:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671197824:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1785774786.162303:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1484:0x0]: returning size 4096 00010000:00010000:0.0:1785774786.162339:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162350:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162358:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162365:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774786.162370:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162378:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162395:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7d:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:0.0:1785774786.162398:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774786.162403:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162413:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e6a2 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162433:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162442:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162449:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0000/0x7b7109e1d09e6a9 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e6b0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162468:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774786.162475:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x7d:0x0] 00010000:00010000:0.0:1785774786.162484:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162490:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162496:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162502:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774786.162505:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162510:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162523:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7605dfd200) 00010000:00010000:0.0:1785774786.162525:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.162529:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162535:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e69b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162547:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745e00/0x7b7109e1d09e68d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e694 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162553:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745e00/0x7b7109e1d09e68d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e694 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162560:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711745e00/0x7b7109e1d09e68d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e694 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162578:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1785774786.162587:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774786.162591:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e678 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162598:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e678 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162611:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744600/0x7b7109e1d09e671 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e678 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162626:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1785774786.162630:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774786.162634:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.162640:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.162699:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648459264:12345-192.168.202.31@tcp:36:rm.0 Request processed in 75176us (75417us total) trans 4294983525 rc 0/0 00000100:00100000:0.0:1785774786.162706:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23716 00010000:00010000:1.0:1785774786.163350:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774786.163362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671198208 00000100:00100000:1.0:1785774786.163367:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671198208 00000100:00100000:1.0:1785774786.163405:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1785774786.163411:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+18:3654:x1872519671198208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.163422:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.163439:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e678 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e671 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.163451:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfdd00) 00010000:00010000:1.0:1785774786.163458:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.163486:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3654:x1872519671198208:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.163492:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1785774786.163509:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671198080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.163531:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.163546:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774786.163551:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671197952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.163576:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.163601:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671198208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.163630:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671198080 00000100:00100000:1.0:1785774786.163633:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671198080 00000100:00100000:1.0:1785774786.163651:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671197952 00000100:00100000:1.0:1785774786.163653:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671197952 00000100:00100000:1.0:1785774786.163666:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1785774786.163671:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734582450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+18:3656:x1872519671198080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.163677:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.163687:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09e694 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1484:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e68d expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.163697:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1484:0x0].0x0 (ffff9b7602507600) 00010000:00010000:1.0:1785774786.163702:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.163724:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734582450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671198080:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.163729:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1785774786.163759:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1785774786.163763:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671197952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.163769:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.163778:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e6b0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e6a9 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.163787:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7d:0x0].0x0 (ffff9b7604f39500) 00010000:00010000:1.0:1785774786.163793:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.163808:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+15:3656:x1872519671197952:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.163814:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1785774786.163832:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671197952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.163838:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671198080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774786.165477:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774786.168826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.200136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.200351:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648460032 00000100:00100000:1.0:1785774786.200360:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648460032 00000100:00100000:1.0:1785774786.200410:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5062 00000100:00100000:1.0:1785774786.200418:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648460032:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1785774786.200647:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648460032:12345-192.168.202.31@tcp:35:rm.0 Request processed in 230us (519us total) trans 4294983527 rc 0/0 00000100:00100000:1.0:1785774786.200658:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5062 00000100:00100000:1.0:1785774786.212692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.212734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.214336:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648460160 00000100:00100000:3.0:1785774786.214349:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648460160 00000100:00100000:3.0:1785774786.214423:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1381 00000100:00100000:3.0:1785774786.214434:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:2417:x1872519648460160:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:3.0:1785774786.214450:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.214477:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09e18c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbc6 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.214497:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff9b7712d15500) 00010000:00010000:3.0:1785774786.214508:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.214579:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:2417:x1872519648460160:12345-192.168.202.31@tcp:103:rm.0 Request processed in 147us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.214588:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1381 00000100:00100000:1.0:1785774786.217946:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671198336 00000100:00100000:1.0:1785774786.217962:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671198336 00000100:00100000:1.0:1785774786.218031:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584 00000100:00100000:1.0:1785774786.218039:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:8627:x1872519671198336:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.218062:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774786.218084:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e6cc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e6c5 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.218110:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e6cc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e6c5 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.218123:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e6cc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6c5 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.218130:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fcca00) 00010000:00010000:1.0:1785774786.218133:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774786.218136:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:1.0:1785774786.218254:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:8627:x1872519671198336:12345-0@lo:101:mdt00_004.0 Request processed in 215us (5130us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.218261:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584 00000100:00100000:0.0:1785774786.218689:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671198464 00000100:00100000:0.0:1785774786.218693:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671198464 00000100:00100000:0.0:1785774786.218724:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585 00000100:00100000:0.0:1785774786.218730:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:8627:x1872519671198464:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774786.218737:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.218748:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e6da lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e6d3 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.218761:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e6da lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e6d3 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.218770:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e6da lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6d3 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.218776:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x41f29468 (ffff9b7605dfd200) 00010000:00010000:0.0:1785774786.218779:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.218781:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2e00, rc 0) 00000100:00100000:0.0:1785774786.218835:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:8627:x1872519671198464:12345-0@lo:101:mdt00_004.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.218840:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585 00000100:00100000:1.0:1785774786.218918:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671198464:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.218927:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.218942:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774786.218953:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1785774786.218982:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671198592:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774786.219025:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.219046:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.219085:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671198592 00000100:00100000:0.0:1785774786.219088:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671198592 00000100:00100000:0.0:1785774786.219451:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586 00000100:00100000:0.0:1785774786.219457:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:8627:x1872519671198592:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774786.219510:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:8627:x1872519671198592:12345-0@lo:1000:mdt00_004.0 Request processed in 53us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.219516:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586 00000100:00100000:1.0:1785774786.219603:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671198592:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774786.219646:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671198720:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774786.219681:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.219705:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.220087:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671198720:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1785774786.220121:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220128:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220135:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.220143:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671198848:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1785774786.220306:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.220341:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.220416:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:8627:x1872519671198848:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774786.220424:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.220434:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e6e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e6e1 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.220448:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e6e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e6e1 expref: 18 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.220457:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e6e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6e1 expref: 18 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.220463:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff9b7604f39c00) 00010000:00010000:2.0:1785774786.220466:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774786.220468:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774786.220506:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:8627:x1872519671198848:12345-0@lo:101:mdt00_004.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.220512:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588 00000100:00100000:1.0:1785774786.220595:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671198848:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.220656:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220666:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220687:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220695:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220701:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220715:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220724:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 47 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220731:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220750:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 47 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.220761:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 47 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.220770:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671198976:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774786.220827:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.227894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.227990:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648460544 00000100:00100000:3.0:1785774786.228004:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648460544 00010000:00010000:3.0:1785774786.228055:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 48 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.228157:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1609 00000100:00100000:3.0:1785774786.228204:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:2416:x1872519648460544:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774786.228222:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.228229:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 48 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.228243:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 48 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.228274:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x72:0x0].0x0 (ffff9b7605dfdf00) 00010000:00010000:3.0:1785774786.228280:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.228290:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.228298:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.228318:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.228398:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:2416:x1872519648460544:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 195us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.228405:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1609 00010000:00010000:2.0:1785774786.229805:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09e1b6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbdb expref: 47 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.229831:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671198976:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774786.229854:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.229864:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.229869:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.229919:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 3/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.229927:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 3/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.229938:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 3/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.229957:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671199104:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774786.230023:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.230054:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ceca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.230112:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671199104 00000100:00100000:0.0:1785774786.230118:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671199104 00000100:00100000:0.0:1785774786.230196:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589 00000100:00100000:0.0:1785774786.230205:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:8627:x1872519671199104:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774786.230221:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.230240:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e6fd expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.230268:0:7692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e1c4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe2 expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.230279:0:7692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 19 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.230306:0:7692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe2 expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.230343:0:7692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe2 expref: 27 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.230356:0:7692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7692:1872519671199232:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774786.230421:0:7692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.240646:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7692:1872519671199232:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774786.240694:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 19 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.240710:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x72:0x0].0x0 (ffff9b7604f39000) 00010000:00010000:0.0:1785774786.240713:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774786.240718:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 19 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.240729:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 19 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.240737:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774786.240875:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:8627:x1872519671199104:12345-0@lo:101:mdt00_004.0 Request processed in 10669us (10849us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.240884:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589 00000100:00100000:2.0:1785774786.246761:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671199104:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774786.246809:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 4/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.246827:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 4/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.249807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.250644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648460672 00000100:00100000:2.0:1785774786.250656:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648460672 00010000:00010000:2.0:1785774786.250705:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe2 expref: 28 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.250757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1610 00000100:00100000:2.0:1785774786.250767:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:2416:x1872519648460672:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774786.250784:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774786.250792:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e1c4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe2 expref: 28 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.250805:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e1c4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe2 expref: 28 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.250829:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e1c4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe2 expref: 28 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.250847:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x72:0x0].0x0 (ffff9b7604f39000) 00010000:00010000:2.0:1785774786.250854:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.250865:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.250873:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.250910:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.250925:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6514:1872519671199360:0@lo:105: 00000100:00100000:2.0:1785774786.250979:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.251036:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ceca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.251291:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671199360 00000100:00100000:0.0:1785774786.251295:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671199360 00000100:00100000:0.0:1785774786.251339:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1785774786.251347:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671199360:12345-0@lo:105: 00010000:00010000:0.0:1785774786.251360:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 5/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.251369:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 5/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.251377:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 5/0,1 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.251385:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.251392:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.251400:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.251442:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35ae00) 00000100:00100000:0.0:1785774786.251491:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6514:x1872519671199360:12345-0@lo:105: Request processed in 144us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.251499:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1785774786.251668:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6514:1872519671199360:0@lo:105: 00010000:00010000:3.0:1785774786.251691:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.251750:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:2416:x1872519648460672:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 984us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.251757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1610 00010000:00010000:1.0:1785774786.251918:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.251928:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.253128:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671199488:0@lo:403:mdt00_004.0 00000100:00100000:1.0:1785774786.254359:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.254387:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.256290:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671199488 00000100:00100000:0.0:1785774786.256303:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671199488 00000100:00100000:0.0:1785774786.256390:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3590 00000100:00100000:0.0:1785774786.256402:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:8627:x1872519671199488:12345-0@lo:403:mdt00_004.0 00000100:00100000:0.0:1785774786.263183:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:8627:x1872519671199488:12345-0@lo:403:mdt00_004.0 Request processed in 6753us (8793us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.264393:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671199488:0@lo:403:mdt00_004.0 00000040:00080000:2.0:1785774786.265732:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].386, 952 off583536 00000040:00080000:2.0:1785774786.265930:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].386, 1032 off637696 00000004:00080000:2.0:1785774786.265937:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605ceca80 with version 732 00000004:00080000:1.0:1785774786.266343:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 732 rpc_version 732 00000020:00100000:1.0:1785774786.266383:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774786.266392:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b78380 x1872519671199744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774786.266416:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671199744:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774786.266496:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.266529:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.266683:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3590 00000100:00100000:0.0:1785774786.266719:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671199744 00000100:00100000:0.0:1785774786.266727:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671199744 00000100:00100000:0.0:1785774786.266764:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591 00000100:00100000:0.0:1785774786.266771:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+19:7689:x1872519671199744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774786.270887:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+20:7689:x1872519671199744:12345-0@lo:1000:osp_up1-0.0 Request processed in 4104us (4379us total) trans 4294968439 rc 0/0 00000100:00100000:0.0:1785774786.272078:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591 00000100:00100000:1.0:1785774786.279395:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671199744:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1785774786.280416:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x146e:0x0]: returning size 4096 00010000:00010000:2.0:1785774786.280452:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280465:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280475:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280482:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.280487:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280495:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280515:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x72:0x0].0x0 (ffff9b7605dfdf00) 00010000:00010000:2.0:1785774786.280518:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774786.280524:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280530:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e6f6 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280556:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280564:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280576:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280608:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774786.280619:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x72:0x0] 00010000:00010000:2.0:1785774786.280633:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280640:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280646:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280652:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.280655:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280661:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280670:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff9b7605fccf00) 00010000:00010000:2.0:1785774786.280673:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774786.280676:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280683:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09e6ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280696:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280705:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280713:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280737:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1785774786.280752:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1785774786.280757:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280764:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280771:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280789:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1785774786.280792:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1785774786.280798:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.280806:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.280908:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648460416:12345-192.168.202.31@tcp:36:rm.0 Request processed in 68005us (68220us total) trans 4294983528 rc 0/0 00000100:00100000:2.0:1785774786.280922:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23718 00010000:00010000:3.0:1785774786.281062:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785774786.281071:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281079:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774786.281083:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774786.281092:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281136:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 2/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281143:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774786.281199:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 1/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281207:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e6fd lrc: 0/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e704 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281225:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774786.281228:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281233:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774786.281236:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774786.281243:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281260:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281266:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774786.281282:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281289:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e6e1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6e8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281301:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774786.281304:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281309:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774786.281312:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774786.281319:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281347:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281353:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774786.281359:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281369:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e6c5 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281382:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774786.281383:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774786.281385:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774786.281395:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774786.281411:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671199872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.281489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.281544:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671199872 00000100:00100000:3.0:1785774786.281564:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671199872 00000100:00100000:3.0:1785774786.281616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1785774786.281627:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+20:3653:x1872519671199872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774786.281643:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.281665:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e704 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e6fd expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281678:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x72:0x0].0x0 (ffff9b7604f39000) 00010000:00010000:3.0:1785774786.281686:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.281727:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+19:3653:x1872519671199872:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.281734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1785774786.281755:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671200128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.281779:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.281801:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774786.281807:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671200000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.281830:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.281855:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671200128 00000100:00100000:3.0:1785774786.281858:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671200128 00000100:00100000:2.0:1785774786.281869:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671199872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.281882:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671200000 00000100:00100000:3.0:1785774786.281885:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671200000 00000100:00100000:3.0:1785774786.281915:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1785774786.281921:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+20:3656:x1872519671200128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774786.281931:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.281944:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e6cc lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e6c5 expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.281955:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fcca00) 00010000:00010000:3.0:1785774786.281961:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.282002:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+19:3656:x1872519671200128:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.282010:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1785774786.282024:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1785774786.282029:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734580050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+18:3656:x1872519671200000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774786.282037:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.282048:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e6e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x146e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e6e1 expref: 18 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.282058:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x146e:0x0].0x0 (ffff9b7604f39c00) 00010000:00010000:3.0:1785774786.282063:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.282083:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734580050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671200000:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.282088:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1785774786.282138:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671200000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.282147:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671200128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.282462:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.286745:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774786.293815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.295437:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648460928 00000100:00100000:2.0:1785774786.295453:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648460928 00000100:00100000:2.0:1785774786.295530:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23719 00000100:00100000:2.0:1785774786.295541:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:17768:x1872519648460928:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774786.295572:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.295599:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e70b lrc: 2/0,0 mode: --/CR res: [0x240000402:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774786.295787:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xaf:0x0]: returning size 4096 00010000:00010000:2.0:1785774786.295900:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e70b lrc: 1/0,0 mode: --/CR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd94 expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.295916:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7605fd8800) 00010000:00010000:2.0:1785774786.295919:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774786.295924:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e70b lrc: 0/0,0 mode: --/CR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd94 expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.295937:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35be00, rc 0) 00000100:00100000:2.0:1785774786.296016:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17768:x1872519648460928:12345-192.168.202.31@tcp:101:rm.0 Request processed in 476us (2213us total) trans 4294968440 rc 301/301 00000100:00100000:2.0:1785774786.296024:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23719 00000100:00100000:1.0:1785774786.326512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.326703:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648461184 00000100:00100000:0.0:1785774786.326717:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648461184 00000100:00100000:0.0:1785774786.326847:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5063 00000100:00100000:0.0:1785774786.326859:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17768:x1872519648461184:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:0.0:1785774786.328458:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17768:x1872519648461184:12345-192.168.202.31@tcp:35:rm.0 Request processed in 1596us (1954us total) trans 4294968441 rc 0/0 00000100:00100000:0.0:1785774786.328471:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5063 00000100:00100000:3.0:1785774786.338963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.339738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.342439:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648461568 00000100:00100000:0.0:1785774786.342456:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648461568 00000100:00100000:0.0:1785774786.342526:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23720 00000100:00100000:0.0:1785774786.342536:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17768:x1872519648461568:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774786.342616:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.342646:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e09e lrc: 0/0,0 mode: --/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb6b expref: 29 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.342668:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7605fd8800) 00010000:00010000:0.0:1785774786.342679:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774786.342737:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.342746:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.342757:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.342781:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200256:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774786.342849:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.342910:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.342928:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671200256 00000100:00100000:0.0:1785774786.342931:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671200256 00000100:00100000:0.0:1785774786.342959:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592 00000100:00100000:0.0:1785774786.342964:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671200256:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.342988:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.343003:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09e720 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e719 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343026:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09e720 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e719 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343038:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09e720 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e719 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343046:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605dfd900) 00010000:00010000:0.0:1785774786.343050:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.343052:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2200, rc 0) 00000100:00100000:0.0:1785774786.343088:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:8469:x1872519671200256:12345-0@lo:101:mdt00_003.0 Request processed in 124us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.343095:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592 00000100:00100000:0.0:1785774786.343139:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200256:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.343155:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343206:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774786.343226:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774786.343244:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343250:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343256:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.343264:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200384:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774786.343283:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.343308:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.343320:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671200384 00000100:00100000:0.0:1785774786.343334:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671200384 00000100:00100000:0.0:1785774786.343362:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593 00000100:00100000:0.0:1785774786.343367:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:8469:x1872519671200384:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.343375:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.343387:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09e72e lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e727 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343402:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09e72e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e727 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343413:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09e72e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e727 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343419:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x43f6259d (ffff9b7605dfdd00) 00010000:00010000:0.0:1785774786.343421:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.343424:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2c00, rc 0) 00000100:00100000:0.0:1785774786.343452:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:8469:x1872519671200384:12345-0@lo:101:mdt00_003.0 Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.343458:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593 00000100:00100000:0.0:1785774786.343480:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200384:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.343490:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343498:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774786.343509:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1785774786.343544:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200512:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.343569:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.343581:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.343593:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671200512 00000100:00100000:0.0:1785774786.343596:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671200512 00000100:00100000:0.0:1785774786.343610:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1785774786.343615:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:8469:x1872519671200512:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.343672:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:8469:x1872519671200512:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.343679:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1785774786.343702:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200512:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.343742:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200640:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.343766:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.343779:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.343789:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671200640 00000100:00100000:0.0:1785774786.343792:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671200640 00000100:00100000:0.0:1785774786.343805:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1785774786.343810:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:8469:x1872519671200640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.343888:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:8469:x1872519671200640:12345-0@lo:1000:mdt00_003.0 Request processed in 77us (121us total) trans 0 rc 1/1 00000100:00100000:0.0:1785774786.343894:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1785774786.343913:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200640:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1785774786.343944:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343951:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.343957:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.343965:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200768:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774786.343984:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.343995:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.344005:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671200768 00000100:00100000:0.0:1785774786.344007:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671200768 00000100:00100000:0.0:1785774786.344021:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596 00000100:00100000:0.0:1785774786.344025:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:8469:x1872519671200768:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.344033:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.344042:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 2/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e735 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.344059:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.344068:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 4/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e735 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.344089:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.344101:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 46 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.344112:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671200896:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774786.344196:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8e40 going to sleep for 11 seconds 00010000:00010000:3.0:1785774786.346354:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774786.347336:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648461312 00000100:00100000:1.0:1785774786.347349:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648461312 00010000:00010000:1.0:1785774786.350529:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 47 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.351510:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1611 00000100:00100000:1.0:1785774786.351526:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:2416:x1872519648461312:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:1.0:1785774786.351549:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.351566:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 47 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.351580:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 47 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.351607:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7712d15800) 00010000:00010000:1.0:1785774786.351614:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 3/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e735 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.351626:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e735 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.351635:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e735 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.351673:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e735 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.351688:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671201024:0@lo:105: 00000100:00100000:1.0:1785774786.351743:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.351779:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c480 going to sleep for 11 seconds 00010000:00010000:2.0:1785774786.351889:0:6534:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000034958d7 x1872519671200896) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 1/0,0 mode: --/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 47 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.351909:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d09e082 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb5d expref: 47 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.351923:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671200896:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774786.351942:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7712d15800) 00010000:00010000:2.0:1785774786.351953:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e735 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.351960:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7712d15800) 00010000:00010000:2.0:1785774786.351963:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774786.351965:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2400, rc 0) 00000100:00100000:2.0:1785774786.352016:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:8469:x1872519671200768:12345-0@lo:101:mdt00_003.0 Request processed in 7989us (8031us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.352024:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596 00000100:00100000:0.0:1785774786.352145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671201024 00000100:00100000:0.0:1785774786.352152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671201024 00000100:00100000:0.0:1785774786.352203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1785774786.352209:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671201024:12345-0@lo:105: 00010000:00010000:0.0:1785774786.352220:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 4/0,1 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.352230:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 4/0,1 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.352238:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 4/0,1 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.352244:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.352251:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.352258:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.352269:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec2600) 00000100:00100000:0.0:1785774786.352301:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671201024:12345-0@lo:105: Request processed in 93us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.352306:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1785774786.352480:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671200768:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774786.352497:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.352538:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.353493:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.353510:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.353537:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.353549:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 28 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.353569:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 4/0,1 mode: --/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.353596:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 28 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.353613:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 28 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.353627:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671201152:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774786.353697:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c000 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.353720:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671201024:0@lo:105: 00010000:00010000:1.0:1785774786.353732:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.353754:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:2416:x1872519648461312:12345-192.168.202.31@tcp:103:rm.0 Request processed in 2235us (14805us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.353763:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1611 00000100:00100000:1.0:1785774786.375581:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671201152:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774786.375620:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.376391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.376517:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648461696 00000100:00100000:3.0:1785774786.376526:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648461696 00010000:00010000:3.0:1785774786.376585:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 29 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.376626:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1612 00000100:00100000:3.0:1785774786.376636:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:2416:x1872519648461696:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774786.376654:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.376662:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 29 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.376675:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 29 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.376701:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09e0ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb72 expref: 29 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.376720:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774786.376725:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.376737:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.376747:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.376777:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.376836:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:2416:x1872519648461696:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 200us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.376844:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1612 00010000:00010000:2.0:1785774786.377042:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377052:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377109:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377117:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377130:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.377152:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671201280:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1785774786.377229:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.377256:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.377274:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671201280 00000100:00100000:2.0:1785774786.377279:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671201280 00000100:00100000:2.0:1785774786.377313:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597 00000100:00100000:2.0:1785774786.377319:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:8469:x1872519671201280:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774786.377349:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.377365:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e751 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377388:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 45 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377397:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377518:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 45 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.377533:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 45 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.377545:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671201408:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774786.377909:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.386574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.386821:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671201408:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774786.386868:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.386884:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b7712d15c00) 00010000:00010000:3.0:1785774786.386887:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774786.386893:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.386905:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.386913:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b000, rc 0) 00000100:00100000:3.0:1785774786.386989:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:8469:x1872519671201280:12345-0@lo:101:mdt00_003.0 Request processed in 9669us (9759us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.386999:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597 00000100:00100000:1.0:1785774786.387688:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648461824 00000100:00100000:1.0:1785774786.387698:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648461824 00010000:00010000:1.0:1785774786.387740:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 46 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.387780:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1613 00000100:00100000:1.0:1785774786.387791:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:2417:x1872519648461824:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.387809:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.387817:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 46 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.387830:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 46 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.387857:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d09e0ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb79 expref: 46 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.387872:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b7712d15c00) 00010000:00010000:1.0:1785774786.387877:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.387893:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.387902:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.387939:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.387955:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671201536:0@lo:105: 00000100:00100000:1.0:1785774786.388000:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.388044:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c000 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.388067:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671201536 00000100:00100000:1.0:1785774786.388071:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671201536 00000100:00100000:1.0:1785774786.388114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1785774786.388122:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671201536:12345-0@lo:105: 00010000:00010000:1.0:1785774786.388135:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.388146:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.388155:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.388543:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.388717:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671201280:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774786.388758:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.388768:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.396841:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.397735:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671201664:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1785774786.397839:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.397896:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8540 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.399709:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671201664 00000100:00100000:2.0:1785774786.399721:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671201664 00000100:00100000:2.0:1785774786.399793:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598 00000100:00100000:2.0:1785774786.399803:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:8469:x1872519671201664:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1785774786.403951:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:8469:x1872519671201664:12345-0@lo:403:mdt00_003.0 Request processed in 4136us (6099us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.403969:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598 00000100:00100000:3.0:1785774786.404560:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671201664:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1785774786.406865:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].400, 952 off600664 00000040:00080000:3.0:1785774786.407084:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].399, 1032 off646760 00000004:00080000:3.0:1785774786.407091:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605e4d780 with version 762 00000004:00080000:2.0:1785774786.415363:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 762 rpc_version 762 00000020:00100000:2.0:1785774786.415437:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774786.415450:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c0380 x1872519671201920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774786.415483:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671201920:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774786.415570:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.415606:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.415760:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671201920 00000100:00100000:0.0:1785774786.415770:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671201920 00000100:00100000:0.0:1785774786.415830:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00100000:0.0:1785774786.415839:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:7474:x1872519671201920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774786.416377:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:7474:x1872519671201920:12345-0@lo:1000:osp_up0-1.0 Request processed in 537us (805us total) trans 4294983529 rc 0/0 00000100:00100000:0.0:1785774786.416386:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1785774786.416794:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671201920:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1785774786.417403:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35be00) 00000100:00100000:1.0:1785774786.417470:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671201536:12345-0@lo:105: Request processed in 29349us (29469us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.417481:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1785774786.417596:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671201536:0@lo:105: 00010000:00010000:2.0:1785774786.417615:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774786.417671:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:2417:x1872519648461824:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 29880us (31124us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.417681:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1613 00000004:00200000:0.0:1785774786.419122:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xaf:0x0]: returning size 4096 00010000:00010000:0.0:1785774786.419185:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419196:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419205:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419212:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774786.419217:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419225:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419245:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:0.0:1785774786.419248:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774786.419253:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 2/0,0 mode: --/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419264:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e74a lrc: 0/0,0 mode: --/EX res: [0x240000400:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419291:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419300:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419307:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419338:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774786.419350:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x5d:0x0] 00010000:00010000:0.0:1785774786.419362:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419368:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419374:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419379:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774786.419382:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419388:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419399:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7605fcc400) 00010000:00010000:0.0:1785774786.419401:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.419405:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419410:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e743 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.419509:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774786.419518:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.419526:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774786.419531:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774786.419541:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.419592:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.419599:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774786.419626:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.419634:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09e751 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e758 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.419651:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774786.419653:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774786.419654:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.419728:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419737:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419744:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419764:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774786.419778:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774786.419783:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419790:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419798:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419812:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1785774786.419816:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1785774786.419823:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774786.419828:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419836:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.419840:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.419848:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419868:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419874:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.419881:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 1/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419890:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2600/0x7b7109e1d09e735 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e73c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419903:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774786.419907:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419913:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.419917:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.419931:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419945:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419951:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.419964:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419972:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3000/0x7b7109e1d09e719 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e720 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.419983:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.419985:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.419987:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774786.420005:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671202304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.420077:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774786.420129:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.420137:0:8469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.420231:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17768:x1872519648461568:12345-192.168.202.31@tcp:36:rm.0 Request processed in 77694us (80491us total) trans 4294968442 rc 0/0 00000100:00100000:0.0:1785774786.420241:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23720 00000100:00100000:2.0:1785774786.420340:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671202176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774786.420370:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.420399:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774786.420404:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671202048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774786.420432:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785774786.420736:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774786.420938:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202304 00000100:00100000:1.0:1785774786.420947:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202304 00000100:00100000:1.0:1785774786.420996:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202176 00000100:00100000:1.0:1785774786.420999:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202176 00000100:00100000:1.0:1785774786.421015:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202048 00000100:00100000:1.0:1785774786.421018:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202048 00000100:00100000:1.0:1785774786.421035:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1785774786.421045:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3655:x1872519671202304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.421060:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.421082:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09e720 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e719 expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.421097:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605dfd900) 00010000:00010000:1.0:1785774786.421106:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.421140:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3655:x1872519671202304:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.421147:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1785774786.421186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1785774786.421192:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3654:x1872519671202176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.421202:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.421213:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09e73c lrc: 0/0,0 mode: --/EX res: [0x240000402:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e735 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.421223:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaf:0x0].0x0 (ffff9b7712d15800) 00010000:00010000:1.0:1785774786.421230:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.421257:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+19:3654:x1872519671202176:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.421264:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1785774786.421277:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1785774786.421284:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3654:x1872519671202048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.421292:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.421303:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e758 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e751 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.421315:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b7712d15c00) 00010000:00010000:1.0:1785774786.421333:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.421355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3654:x1872519671202048:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.421362:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1785774786.421399:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671202048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.421408:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671202176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.423835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.425680:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648461952 00000100:00100000:2.0:1785774786.425690:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648461952 00000100:00100000:2.0:1785774786.425754:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23721 00000100:00100000:2.0:1785774786.425764:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648461952:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774786.425793:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.425817:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e75f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bd9b expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.425975:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.425993:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426008:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426018:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426025:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426032:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426039:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.426044:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426052:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426064:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:2.0:1785774786.426068:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774786.426073:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426079:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426114:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e75f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd9b expref: 46 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426125:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:2.0:1785774786.426128:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774786.426132:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e75f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd9b expref: 46 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.426142:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774786.426222:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648461952:12345-192.168.202.31@tcp:101:rm.0 Request processed in 459us (2394us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774786.426230:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23721 00000100:00100000:0.0:1785774786.426472:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671202304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774786.444801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.446534:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648462080 00000100:00100000:0.0:1785774786.446547:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648462080 00000100:00100000:0.0:1785774786.446631:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23722 00000100:00100000:0.0:1785774786.446642:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462080:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1785774786.446674:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.446698:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09e76d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bda2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446836:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446853:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446867:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446878:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446886:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446892:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446899:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774786.446904:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446917:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446931:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:0.0:1785774786.446934:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774786.446939:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446945:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09e774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446979:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09e76d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bda2 expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.446990:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:0.0:1785774786.446992:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.446995:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09e76d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bda2 expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.447005:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3000, rc 0) 00000100:00100000:0.0:1785774786.447087:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462080:12345-192.168.202.31@tcp:101:rm.0 Request processed in 446us (2300us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774786.447096:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23722 00000100:00100000:3.0:1785774786.453818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.454005:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648462336 00000100:00100000:0.0:1785774786.454018:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648462336 00000100:00100000:0.0:1785774786.454101:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23723 00000100:00100000:0.0:1785774786.454113:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:17768:x1872519648462336:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1785774786.454146:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.454199:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e77b lrc: 2/0,0 mode: --/CR res: [0x240000402:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bda9 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774786.454412:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xd8:0x0]: returning size 4096 00010000:00010000:0.0:1785774786.454535:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e77b lrc: 1/0,0 mode: --/CR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bda9 expref: 30 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.454713:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7605dfd000) 00010000:00010000:0.0:1785774786.454717:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774786.454724:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e77b lrc: 0/0,0 mode: --/CR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bda9 expref: 30 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.454740:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2000, rc 0) 00000100:00100000:0.0:1785774786.454813:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17768:x1872519648462336:12345-192.168.202.31@tcp:101:rm.0 Request processed in 702us (1009us total) trans 4294968443 rc 301/301 00000100:00100000:0.0:1785774786.454820:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23723 00000100:00100000:3.0:1785774786.463810:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.464315:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648462464 00000100:00100000:1.0:1785774786.464340:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648462464 00000100:00100000:1.0:1785774786.464432:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23724 00000100:00100000:1.0:1785774786.464445:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462464:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1785774786.464472:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774786.464496:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09e789 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464677:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464696:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464709:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464721:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464729:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464737:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464743:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774786.464748:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464757:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464770:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:1.0:1785774786.464774:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774786.464779:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464786:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09e790 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464819:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09e789 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdb0 expref: 46 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464830:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:1.0:1785774786.464832:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774786.464836:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09e789 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdb0 expref: 46 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.464846:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce000, rc 0) 00000100:00100000:1.0:1785774786.464919:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462464:12345-192.168.202.31@tcp:101:rm.0 Request processed in 477us (1123us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774786.464926:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23724 00000100:00100000:1.0:1785774786.475393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.475521:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648462592 00000100:00100000:2.0:1785774786.475534:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648462592 00000100:00100000:2.0:1785774786.475608:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23725 00000100:00100000:2.0:1785774786.475618:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462592:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774786.475644:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.475671:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e797 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdb7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475814:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475832:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475845:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475856:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475863:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475870:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475877:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.475882:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475890:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475902:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:2.0:1785774786.475906:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774786.475910:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475918:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09e79e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475950:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e797 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdb7 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475961:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:2.0:1785774786.475963:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774786.475967:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e797 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdb7 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.475975:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774786.476040:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462592:12345-192.168.202.31@tcp:101:rm.0 Request processed in 424us (661us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774786.476048:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23725 00000100:00100000:3.0:1785774786.483139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.483385:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648462720 00000100:00100000:0.0:1785774786.483398:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648462720 00000100:00100000:0.0:1785774786.483465:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5064 00000100:00100000:0.0:1785774786.483475:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462720:12345-192.168.202.31@tcp:37:rm.0 00000100:00100000:0.0:1785774786.483658:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648462720:12345-192.168.202.31@tcp:37:rm.0 Request processed in 184us (534us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774786.483680:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5064 00000100:00100000:3.0:1785774786.525550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.525667:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648462976 00000100:00100000:0.0:1785774786.525680:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648462976 00000100:00100000:0.0:1785774786.525754:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5065 00000100:00100000:0.0:1785774786.525766:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17768:x1872519648462976:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:0.0:1785774786.526056:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17768:x1872519648462976:12345-192.168.202.31@tcp:35:rm.0 Request processed in 292us (520us total) trans 4294968444 rc 0/0 00000100:00100000:0.0:1785774786.526065:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5065 00000100:00100000:1.0:1785774786.534524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.538544:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648463360 00000100:00100000:3.0:1785774786.538562:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648463360 00000100:00100000:3.0:1785774786.538649:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23726 00000100:00100000:3.0:1785774786.538660:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:17768:x1872519648463360:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774786.538735:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.538767:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09e218 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc05 expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.538789:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7605dfd000) 00010000:00010000:3.0:1785774786.538802:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774786.538862:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.538871:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.538880:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.538903:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202432:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774786.538975:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.539020:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.539236:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202432 00000100:00100000:0.0:1785774786.539241:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202432 00000100:00100000:0.0:1785774786.539278:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600 00000100:00100000:0.0:1785774786.539284:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:8627:x1872519671202432:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774786.539296:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.539314:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e7ac lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e7a5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.539356:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e7ac lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e7a5 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.539369:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e7ac lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7a5 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.539376:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:0.0:1785774786.539379:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.539381:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2000, rc 0) 00000100:00100000:0.0:1785774786.539435:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:8627:x1872519671202432:12345-0@lo:101:mdt00_004.0 Request processed in 150us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.539440:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600 00000100:00100000:3.0:1785774786.540222:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202432:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774786.540239:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.540250:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774786.540280:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774786.540303:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.540309:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.540316:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.540338:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202560:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774786.540362:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.540389:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.540442:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202560 00000100:00100000:0.0:1785774786.540446:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202560 00000100:00100000:0.0:1785774786.540477:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:0.0:1785774786.540483:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:8627:x1872519671202560:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774786.540494:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.540507:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09e7ba lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e7b3 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.540525:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09e7ba lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e7b3 expref: 19 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.540535:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09e7ba lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7b3 expref: 19 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.540542:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x276a6cf1 (ffff9b7605dfd800) 00010000:00010000:0.0:1785774786.540544:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.540546:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3000, rc 0) 00000100:00100000:0.0:1785774786.540591:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:8627:x1872519671202560:12345-0@lo:101:mdt00_004.0 Request processed in 108us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.540610:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00100000:2.0:1785774786.540736:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202560:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774786.540747:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.540755:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774786.540766:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1785774786.540800:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202688:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774786.540828:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.540853:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.540896:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202688 00000100:00100000:3.0:1785774786.540900:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202688 00000100:00100000:3.0:1785774786.540928:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602 00000100:00100000:3.0:1785774786.540933:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:8627:x1872519671202688:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774786.541001:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:8627:x1872519671202688:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.541007:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602 00000100:00100000:2.0:1785774786.541119:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202688:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774786.541156:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202816:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774786.541203:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.541218:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.541680:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202816 00000100:00100000:3.0:1785774786.541685:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202816 00000100:00100000:3.0:1785774786.541719:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603 00000100:00100000:3.0:1785774786.541726:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:8627:x1872519671202816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774786.541824:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:8627:x1872519671202816:12345-0@lo:1000:mdt00_004.0 Request processed in 98us (619us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774786.541831:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603 00000100:00100000:1.0:1785774786.541894:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202816:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1785774786.541941:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.541949:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.541958:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.541977:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202944:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1785774786.542006:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.542037:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.542086:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671202944 00000100:00100000:2.0:1785774786.542090:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671202944 00000100:00100000:2.0:1785774786.542134:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604 00000100:00100000:2.0:1785774786.542140:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:8627:x1872519671202944:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774786.542149:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.542180:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e7c1 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.542201:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 44 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.542211:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 4/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e7c1 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.542237:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 44 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.542252:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 44 pid: 8469 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.542264:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671203072:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774786.542334:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce4480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.542665:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.542834:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648463104 00000100:00100000:1.0:1785774786.542839:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648463104 00010000:00010000:1.0:1785774786.542860:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 45 pid: 8469 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.542890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1614 00000100:00100000:1.0:1785774786.542896:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734581850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:2417:x1872519648463104:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:1.0:1785774786.542906:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774786.542912:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 45 pid: 8469 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.542924:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 45 pid: 8469 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.542942:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:1.0:1785774786.542948:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 3/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e7c1 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.542959:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e7c1 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.542968:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e7c1 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.542997:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7c1 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.543007:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6516:1872519671203200:0@lo:105: 00000100:00100000:1.0:1785774786.543038:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.543064:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c300 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.543081:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671203200 00000100:00100000:1.0:1785774786.543085:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671203200 00000100:00100000:1.0:1785774786.543126:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1785774786.543134:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6516:x1872519671203200:12345-0@lo:105: 00010000:00010000:1.0:1785774786.543145:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 4/0,1 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.543155:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 4/0,1 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.543190:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 4/0,1 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.543199:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.543206:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.543215:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.543234:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b76057ce000) 00000100:00100000:1.0:1785774786.543267:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6516:x1872519671203200:12345-0@lo:105: Request processed in 134us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.543273:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1785774786.543305:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6516:1872519671203200:0@lo:105: 00010000:00010000:1.0:1785774786.543317:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774786.543356:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734581850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:2417:x1872519648463104:12345-192.168.202.31@tcp:103:rm.0 Request processed in 459us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.543363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1614 00010000:00010000:2.0:1785774786.545095:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000ccc7efd7 x1872519671203072) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 1/0,0 mode: --/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 44 pid: 8469 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.545127:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09e1e0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbe9 expref: 44 pid: 8469 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.545150:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671203072:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774786.545192:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:2.0:1785774786.545202:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7c1 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.545211:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:2.0:1785774786.545214:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774786.545216:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774786.545258:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:8627:x1872519671202944:12345-0@lo:101:mdt00_004.0 Request processed in 3117us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.545265:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604 00000100:00100000:1.0:1785774786.546639:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671202944:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.546660:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546703:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 3/0,1 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546716:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546729:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546750:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546761:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546776:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546810:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.546826:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 29 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.546841:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671203328:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774786.546907:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.550474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.550567:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671203328:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774786.550600:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.551720:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648463488 00000100:00100000:0.0:1785774786.551731:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648463488 00010000:00010000:0.0:1785774786.551778:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 30 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.551820:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1615 00000100:00100000:0.0:1785774786.551829:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2417:x1872519648463488:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.551847:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.551854:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 30 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.551871:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 30 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.551894:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e1fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x72:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbf7 expref: 30 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.551911:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x72:0x0].0x0 (ffff9b7702c6a600) 00010000:00010000:0.0:1785774786.551916:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.551925:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.551932:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.552222:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.552286:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:2417:x1872519648463488:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 457us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.552294:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1615 00010000:00010000:3.0:1785774786.560447:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.560470:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.560546:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.560564:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.560580:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.560610:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671203456:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774786.560686:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.560715:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cecd80 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.560929:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671203456 00000100:00100000:1.0:1785774786.560938:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671203456 00000100:00100000:1.0:1785774786.561001:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605 00000100:00100000:1.0:1785774786.561012:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:8627:x1872519671203456:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.561034:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774786.561053:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e7dd expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.561091:0:20645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.561112:0:20645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 21 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.561142:0:20645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.561186:0:20645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 43 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.561199:0:20645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20645:1872519671203584:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774786.561273:0:20645:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.565225:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.565228:0:20645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20645:1872519671203584:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774786.565270:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 21 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.565285:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:1.0:1785774786.565289:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774786.565293:0:20645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 21 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.565305:0:20645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 21 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.565313:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00000100:00100000:1.0:1785774786.565385:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:8627:x1872519671203456:12345-0@lo:101:mdt00_004.0 Request processed in 4375us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.565396:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605 00000100:00100000:0.0:1785774786.565505:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648463616 00000100:00100000:0.0:1785774786.565514:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648463616 00010000:00010000:0.0:1785774786.565559:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 44 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.565592:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1616 00000100:00100000:0.0:1785774786.565601:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:2417:x1872519648463616:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.565619:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.565626:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 44 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.565638:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 44 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.565660:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e249 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc21 expref: 44 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.565673:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:0.0:1785774786.565677:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.565687:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.565696:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.565727:0:19895:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.565739:0:19895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19895:1872519671203712:0@lo:105: 00000100:00100000:0.0:1785774786.565777:0:19895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.565818:0:19895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.565979:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671203456:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774786.565999:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.566011:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.567082:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1785774786.567098:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671203712 00000100:00100000:2.0:1785774786.567104:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671203712 00000100:00100000:2.0:1785774786.567146:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1785774786.567200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671203712:12345-0@lo:105: 00010000:00010000:2.0:1785774786.567214:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 5/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.567224:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 5/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.567234:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 5/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.567243:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.567250:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.567258:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.567276:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec1600) 00000100:00100000:2.0:1785774786.567333:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19895:x1872519671203712:12345-0@lo:105: Request processed in 178us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.567340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00010000:00010000:3.0:1785774786.567341:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.567350:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774786.567838:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].401, 888 off601552 00000040:00080000:3.0:1785774786.568039:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].400, 968 off647728 00000004:00080000:3.0:1785774786.568046:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605cecd80 with version 763 00000100:00100000:0.0:1785774786.568258:0:19895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19895:1872519671203712:0@lo:105: 00010000:00010000:0.0:1785774786.568273:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.568330:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:2417:x1872519648463616:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 2718us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.568340:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1616 00000004:00080000:2.0:1785774786.572121:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 763 rpc_version 763 00000020:00100000:2.0:1785774786.572232:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774786.572243:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605f03100 x1872519671203968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1952/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774786.572270:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671203968:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774786.572357:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.572395:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ce40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.574379:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671203968 00000100:00100000:3.0:1785774786.574391:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671203968 00000100:00100000:3.0:1785774786.574468:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606 00000100:00100000:3.0:1785774786.574479:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:7474:x1872519671203968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774786.575089:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:7474:x1872519671203968:12345-0@lo:1000:osp_up0-1.0 Request processed in 611us (2730us total) trans 4294983530 rc 0/0 00000100:00100000:3.0:1785774786.575098:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606 00000100:00100000:0.0:1785774786.575242:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671203968:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1785774786.575408:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xd8:0x0]: returning size 4096 00010000:00010000:3.0:1785774786.575450:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575462:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575472:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575479:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774786.575484:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575494:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575513:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x72:0x0].0x0 (ffff9b7702c6a600) 00010000:00010000:3.0:1785774786.575516:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774786.575521:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575528:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09e7d6 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575559:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575567:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575575:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575600:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774786.575612:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x72:0x0] 00010000:00010000:3.0:1785774786.575620:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575626:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575631:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575641:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774786.575644:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575649:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575657:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7605fccf00) 00010000:00010000:3.0:1785774786.575659:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774786.575661:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 2/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575667:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09e7cf lrc: 0/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575681:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575689:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.575695:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.578082:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1785774786.578117:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774786.578492:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.578504:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.578513:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589431:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785774786.589451:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589468:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.589477:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.589490:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589553:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589560:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.589595:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 1/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589603:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09e7dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589623:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774786.589627:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589633:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.589636:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.589642:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589656:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589660:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.589676:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 1/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589681:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce000/0x7b7109e1d09e7c1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7c8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589694:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774786.589698:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589703:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.589707:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.589712:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589727:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589731:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.589735:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.589742:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.589744:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.589745:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774786.589773:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671204352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.589850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.589894:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774786.589899:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671204224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.589917:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.589951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204352 00000100:00100000:0.0:1785774786.589960:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204352 00000100:00100000:0.0:1785774786.590010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204224 00000100:00100000:0.0:1785774786.590012:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204224 00000100:00100000:0.0:1785774786.590034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1785774786.590041:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+23:3654:x1872519671204352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.590055:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.590077:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e7ac lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e7a5 expref: 23 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.590091:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:0.0:1785774786.590102:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.590132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+22:3654:x1872519671204352:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.590139:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1785774786.590155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1785774786.590190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+21:3654:x1872519671204224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.590198:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.590209:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e7c8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xd8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e7c1 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.590220:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd8:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:0.0:1785774786.590227:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.590248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+20:3654:x1872519671204224:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.590255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1785774786.590277:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774786.590286:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671204096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.590311:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.590369:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671204224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.590378:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671204352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.590401:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204096 00000100:00100000:0.0:1785774786.590404:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204096 00000100:00100000:0.0:1785774786.590426:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1785774786.590432:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+20:3655:x1872519671204096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.590439:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.590451:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09e7e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e7dd expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.590468:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:0.0:1785774786.590475:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.590498:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+19:3655:x1872519671204096:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.590505:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1785774786.590526:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671204096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.601699:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774786.610835:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785774786.610856:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09e7a5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7ac expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774786.610895:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774786.610905:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.610913:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.611041:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:17768:x1872519648463360:12345-192.168.202.31@tcp:36:rm.0 Request processed in 72376us (76523us total) trans 4294968445 rc 0/0 00000100:00100000:3.0:1785774786.611051:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23726 00010000:00010000:0.0:1785774786.611199:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774786.633253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.633402:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648463872 00000100:00100000:0.0:1785774786.633415:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648463872 00000100:00100000:0.0:1785774786.633491:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23727 00000100:00100000:0.0:1785774786.633502:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:17768:x1872519648463872:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1785774786.633529:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.633565:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e7eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774786.633754:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d4:0x0]: returning size 4096 00010000:00010000:0.0:1785774786.633860:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e7eb lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdbe expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.633876:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7604f39400) 00010000:00010000:0.0:1785774786.633879:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774786.633884:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09e7eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdbe expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.633897:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2000, rc 0) 00000100:00100000:0.0:1785774786.633970:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:17768:x1872519648463872:12345-192.168.202.31@tcp:101:rm.0 Request processed in 470us (732us total) trans 4294983531 rc 301/301 00000100:00100000:0.0:1785774786.633978:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23727 00000100:00100000:1.0:1785774786.638643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.639600:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648464128 00000100:00100000:2.0:1785774786.639612:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648464128 00000100:00100000:2.0:1785774786.639673:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5066 00000100:00100000:2.0:1785774786.639684:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732247050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:17768:x1872519648464128:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:2.0:1785774786.639943:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732247050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648464128:12345-192.168.202.31@tcp:35:rm.0 Request processed in 261us (1308us total) trans 4294983532 rc 0/0 00000100:00100000:2.0:1785774786.639953:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5066 00000100:00100000:1.0:1785774786.654021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.654099:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648464256 00000100:00100000:0.0:1785774786.654127:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648464256 00000100:00100000:0.0:1785774786.654257:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1391 00000100:00100000:0.0:1785774786.654268:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:2417:x1872519648464256:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:0.0:1785774786.654288:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.654317:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e30d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc6e expref: 29 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.654351:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7702c6ae00) 00010000:00010000:0.0:1785774786.654363:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.654418:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:2417:x1872519648464256:12345-192.168.202.31@tcp:103:rm.0 Request processed in 153us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.654426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1391 00000100:00100000:3.0:1785774786.668626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.668744:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648464512 00000100:00100000:0.0:1785774786.668757:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648464512 00000100:00100000:0.0:1785774786.668830:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23728 00000100:00100000:0.0:1785774786.668841:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648464512:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774786.668917:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.668955:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e329 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14d4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc7c expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.668979:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7604f39400) 00010000:00010000:0.0:1785774786.668993:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774786.669056:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.669066:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.669078:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.669106:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204480:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774786.669241:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.669310:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.669476:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204480 00000100:00100000:3.0:1785774786.669481:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204480 00000100:00100000:3.0:1785774786.669525:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:3.0:1785774786.669534:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:8469:x1872519671204480:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774786.669547:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774786.669564:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e800 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e7f9 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.669597:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e800 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e7f9 expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.669611:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e800 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e7f9 expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.669620:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7602507600) 00010000:00010000:3.0:1785774786.669624:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774786.669626:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774786.669682:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:8469:x1872519671204480:12345-0@lo:101:mdt00_003.0 Request processed in 149us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.669689:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:0.0:1785774786.676480:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204480:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.676519:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.676538:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774786.676568:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774786.676635:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.676644:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.676656:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.676678:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204608:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774786.676757:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.676816:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.680414:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204608 00000100:00100000:3.0:1785774786.680434:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204608 00000100:00100000:3.0:1785774786.680524:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:3.0:1785774786.680536:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:8469:x1872519671204608:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774786.680562:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774786.680595:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e80e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e807 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.680632:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e80e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e807 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.680650:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e80e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e807 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.680660:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xf404c279 (ffff9b7602507700) 00010000:00010000:3.0:1785774786.680664:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774786.680669:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774786.680750:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+19:8469:x1872519671204608:12345-0@lo:101:mdt00_003.0 Request processed in 216us (3993us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.680757:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:0.0:1785774786.685506:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204608:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.685545:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.685563:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774786.685594:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1785774786.685679:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.685756:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.685815:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.686201:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204736 00000100:00100000:3.0:1785774786.686211:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204736 00000100:00100000:3.0:1785774786.686281:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609 00000100:00100000:3.0:1785774786.686291:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:8469:x1872519671204736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774786.686399:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:8469:x1872519671204736:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.686408:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609 00000100:00100000:0.0:1785774786.686588:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.686637:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774786.686664:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.686699:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.686744:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204864 00000100:00100000:3.0:1785774786.686748:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204864 00000100:00100000:3.0:1785774786.686774:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610 00000100:00100000:3.0:1785774786.686781:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:8469:x1872519671204864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774786.686873:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:8469:x1872519671204864:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (208us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774786.686880:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610 00000100:00100000:0.0:1785774786.686981:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204864:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1785774786.687044:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687055:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687066:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.687078:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204992:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774786.687103:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.687123:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.687232:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671204992 00000100:00100000:2.0:1785774786.687238:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671204992 00000100:00100000:2.0:1785774786.687277:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3611 00000100:00100000:2.0:1785774786.687286:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:8469:x1872519671204992:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774786.687296:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.687317:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e81c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e815 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.687355:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e81c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e815 expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.687369:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e81c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e815 expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.687378:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7604f39e00) 00010000:00010000:2.0:1785774786.687381:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774786.687385:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b600, rc 0) 00000100:00100000:2.0:1785774786.687427:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+20:8469:x1872519671204992:12345-0@lo:101:mdt00_003.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.687433:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3611 00000100:00100000:0.0:1785774786.687537:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671204992:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774786.687550:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687561:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687587:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687595:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687617:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687634:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687645:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 44 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687653:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 4/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687678:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 44 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.687691:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 44 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.687706:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671205120:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774786.687777:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.696828:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.697124:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671205120:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774786.697193:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.698034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648464640 00000100:00100000:2.0:1785774786.698045:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648464640 00010000:00010000:2.0:1785774786.698093:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 45 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.698155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1617 00000100:00100000:2.0:1785774786.698194:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:2417:x1872519648464640:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774786.698213:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774786.698221:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 45 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.698234:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 45 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.698259:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09e337 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc83 expref: 45 pid: 6529 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.698279:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa7:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:2.0:1785774786.698285:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,1 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.698295:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.698303:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.698346:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774786.698415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:2417:x1872519648464640:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 230us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.698423:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1617 00010000:00010000:1.0:1785774786.699394:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.699408:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.699488:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.699497:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.699510:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.699538:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671205248:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1785774786.699601:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.699643:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.699940:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671205248 00000100:00100000:3.0:1785774786.699948:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671205248 00000100:00100000:3.0:1785774786.700003:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612 00000100:00100000:3.0:1785774786.700011:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:8469:x1872519671205248:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774786.700031:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774786.700047:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e831 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.700072:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.700083:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.700121:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.700135:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 27 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.700154:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671205376:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774786.700241:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77012edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.708821:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671205376:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774786.708868:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.708883:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:3.0:1785774786.708886:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774786.708890:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.708900:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.708907:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774786.708978:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+21:8469:x1872519671205248:12345-0@lo:101:mdt00_003.0 Request processed in 8966us (9377us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.708989:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612 00000100:00100000:1.0:1785774786.709557:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671205248:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774786.709583:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.709597:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.718856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.718987:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648464768 00000100:00100000:0.0:1785774786.718999:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648464768 00010000:00010000:0.0:1785774786.719050:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 28 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.719105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1618 00000100:00100000:0.0:1785774786.719115:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:2419:x1872519648464768:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.719133:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.719140:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 28 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.719155:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 28 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.719243:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e345 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc8a expref: 28 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.719262:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:0.0:1785774786.719269:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.719282:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.719291:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.719345:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.719362:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671205504:0@lo:105: 00000100:00100000:0.0:1785774786.719470:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.719509:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.719893:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671205504 00000100:00100000:1.0:1785774786.719899:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671205504 00000100:00100000:1.0:1785774786.719944:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1785774786.719953:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671205504:12345-0@lo:105: 00010000:00010000:1.0:1785774786.719965:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.719976:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.719984:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.719991:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.719997:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.720005:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.720032:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b76057ce000) 00000100:00100000:1.0:1785774786.720082:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671205504:12345-0@lo:105: Request processed in 131us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.720090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00010000:00010000:2.0:1785774786.720154:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.720195:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.721004:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671205632:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1785774786.721057:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.721091:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad240 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.723699:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671205632 00000100:00100000:1.0:1785774786.723713:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671205632 00000100:00100000:1.0:1785774786.723795:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613 00000100:00100000:1.0:1785774786.723804:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:8469:x1872519671205632:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1785774786.724725:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671205504:0@lo:105: 00010000:00010000:3.0:1785774786.724753:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774786.724834:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:2419:x1872519648464768:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 5717us (5987us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.724845:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1618 00000100:00100000:1.0:1785774786.735924:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:8469:x1872519671205632:12345-0@lo:403:mdt00_003.0 Request processed in 12108us (14853us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774786.735941:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613 00000100:00100000:2.0:1785774786.736751:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671205632:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1785774786.737956:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].387, 952 off584488 00000040:00080000:2.0:1785774786.738206:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].387, 1032 off638728 00000004:00080000:2.0:1785774786.738214:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b77093ad240 with version 733 00000004:00080000:1.0:1785774786.739064:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 733 rpc_version 733 00000020:00100000:1.0:1785774786.739109:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774786.739120:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603081500 x1872519671205888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774786.739152:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671205888:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774786.740651:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.740694:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.740803:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671205888 00000100:00100000:2.0:1785774786.740812:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671205888 00000100:00100000:2.0:1785774786.740930:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3614 00000100:00100000:2.0:1785774786.740941:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:7689:x1872519671205888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774786.743660:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+22:7689:x1872519671205888:12345-0@lo:1000:osp_up1-0.0 Request processed in 2712us (3003us total) trans 4294968446 rc 0/0 00000100:00100000:2.0:1785774786.743677:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3614 00000100:00100000:1.0:1785774786.743838:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671205888:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1785774786.745104:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14d4:0x0]: returning size 4096 00010000:00010000:0.0:1785774786.745139:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745151:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745197:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745205:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774786.745210:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745219:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745241:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa7:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:0.0:1785774786.745245:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774786.745251:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 2/0,0 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745258:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e82a lrc: 0/0,0 mode: --/EX res: [0x200000400:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745286:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745296:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745303:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745339:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774786.745350:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xa7:0x0] 00010000:00010000:0.0:1785774786.745362:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745369:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745376:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745382:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774786.745385:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745392:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745400:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7605dfd000) 00010000:00010000:0.0:1785774786.745403:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.745406:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745412:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e823 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745442:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745450:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745458:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745475:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1785774786.745488:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774786.745499:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774786.745505:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745512:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.745516:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.745529:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745574:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745582:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.745614:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745622:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e831 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e838 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745638:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774786.745642:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745648:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.745652:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.745659:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745677:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745684:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.745690:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745697:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2800/0x7b7109e1d09e815 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e81c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745708:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.745710:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.745712:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774786.745730:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671206016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.745804:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.745840:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774786.745847:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671206144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.745871:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774786.745899:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745907:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745915:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745926:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774786.745930:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774786.745935:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.745943:0:8469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.746038:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:17768:x1872519648464512:12345-192.168.202.31@tcp:36:rm.0 Request processed in 77196us (77423us total) trans 4294983533 rc 0/0 00000100:00100000:0.0:1785774786.746047:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23728 00000100:00100000:0.0:1785774786.750750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671206016 00000100:00100000:0.0:1785774786.750771:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671206016 00000100:00100000:0.0:1785774786.750871:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671206144 00000100:00100000:0.0:1785774786.750874:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671206144 00000100:00100000:0.0:1785774786.750906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1785774786.750916:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+23:3655:x1872519671206016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.750940:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.751032:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e838 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xa7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e831 expref: 23 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.751062:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa7:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:0.0:1785774786.751076:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.751202:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671206016:12345-0@lo:103:ldlm_bl.0 Request processed in 287us (5399us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.751211:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1785774786.751231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1785774786.751237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671206144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.751248:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.751260:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e81c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e815 expref: 21 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.751272:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d4:0x0].0x0 (ffff9b7604f39e00) 00010000:00010000:0.0:1785774786.751282:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.751311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+20:3655:x1872519671206144:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (5438us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.751316:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1785774786.751393:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671206144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.751404:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671206016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774786.751537:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774786.751546:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.751556:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774786.751563:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774786.751573:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.751616:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.751623:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774786.751648:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.751655:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e7f9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e800 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.751676:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774786.751678:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774786.751680:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774786.751687:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774786.751702:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671206272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.751744:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785774786.751923:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774786.755785:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671206272 00000100:00100000:0.0:1785774786.755806:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671206272 00000100:00100000:0.0:1785774786.755905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:0.0:1785774786.755915:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+20:3654:x1872519671206272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774786.755938:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.755974:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e800 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e7f9 expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.755999:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7602507600) 00010000:00010000:0.0:1785774786.756011:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.756111:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+19:3654:x1872519671206272:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (4366us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.756119:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1785774786.759787:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671206272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774786.762922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.763023:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648465024 00000100:00100000:1.0:1785774786.763033:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648465024 00000100:00100000:1.0:1785774786.763111:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23729 00000100:00100000:1.0:1785774786.763122:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:17768:x1872519648465024:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1785774786.763197:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774786.763225:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09e83f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdc5 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774786.763367:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1531:0x0]: returning size 4096 00010000:00010000:1.0:1785774786.763493:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09e83f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1531:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdc5 expref: 46 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.763511:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9b7605dfd300) 00010000:00010000:1.0:1785774786.763515:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774786.763521:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09e83f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1531:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdc5 expref: 46 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.763538:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774786.763659:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648465024:12345-192.168.202.31@tcp:101:rm.0 Request processed in 537us (745us total) trans 4294983534 rc 301/301 00000100:00100000:1.0:1785774786.763667:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23729 00000100:00100000:1.0:1785774786.768815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.769237:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648465280 00000100:00100000:0.0:1785774786.769250:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648465280 00000100:00100000:0.0:1785774786.769332:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5067 00000100:00100000:0.0:1785774786.769345:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:17768:x1872519648465280:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:0.0:1785774786.769648:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648465280:12345-192.168.202.31@tcp:35:rm.0 Request processed in 304us (843us total) trans 4294983535 rc 0/0 00000100:00100000:0.0:1785774786.769656:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5067 00000100:00100000:1.0:1785774786.795195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.795351:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648465536 00000100:00100000:2.0:1785774786.795364:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648465536 00000100:00100000:2.0:1785774786.795431:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23730 00000100:00100000:2.0:1785774786.795441:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648465536:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774786.795542:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1785774786.795585:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d09e560 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd63 expref: 46 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795608:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09e4e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd39 expref: 45 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795624:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9b7605dfd300) 00010000:00010000:2.0:1785774786.795637:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774786.795667:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795680:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795689:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795700:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795706:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795712:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795787:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795793:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.795799:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774786.796087:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1531:0x0]: returning size 4096 00010000:00010000:2.0:1785774786.796105:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796112:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796118:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796123:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.796127:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796134:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796153:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9b7604f39700) 00010000:00010000:2.0:1785774786.796156:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774786.796193:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796200:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e85b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796222:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796227:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796233:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796238:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796243:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.796246:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796250:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796256:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7604f39600) 00010000:00010000:2.0:1785774786.796258:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774786.796260:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796264:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e84d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774786.796273:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060883782 reply state 000000008ad96e7c transno 4294983536 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796284:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.796289:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9b7604f39800) 00010000:00010000:2.0:1785774786.796291:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774786.796294:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774786.796385:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648465536:12345-192.168.202.31@tcp:36:rm.0 Request processed in 944us (1228us total) trans 4294983536 rc 0/0 00000100:00100000:2.0:1785774786.796393:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23730 00000100:00100000:2.0:1785774786.823153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.823545:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648465792 00000100:00100000:0.0:1785774786.823559:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648465792 00000100:00100000:0.0:1785774786.823636:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23731 00000100:00100000:0.0:1785774786.823649:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:17768:x1872519648465792:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1785774786.823683:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.823709:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e862 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1441:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdcc expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774786.823898:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1441:0x0]: returning size 4096 00010000:00010000:0.0:1785774786.824018:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e862 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1441:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdcc expref: 48 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.824035:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1441:0x0].0x0 (ffff9b7605dfd600) 00010000:00010000:0.0:1785774786.824038:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774786.824044:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1441:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdcc expref: 48 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.824058:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774786.824128:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648465792:12345-192.168.202.31@tcp:101:rm.0 Request processed in 481us (992us total) trans 4294983537 rc 301/301 00000100:00100000:0.0:1785774786.824135:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23731 00000100:00100000:0.0:1785774786.838380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.839521:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648466048 00000100:00100000:2.0:1785774786.839534:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648466048 00000100:00100000:2.0:1785774786.839604:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5068 00000100:00100000:2.0:1785774786.839616:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648466048:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:2.0:1785774786.839895:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648466048:12345-192.168.202.31@tcp:35:rm.0 Request processed in 281us (1526us total) trans 4294983538 rc 0/0 00000100:00100000:2.0:1785774786.839903:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5068 00000100:00100000:1.0:1785774786.867679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.868510:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648466304 00000100:00100000:0.0:1785774786.868524:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648466304 00000100:00100000:0.0:1785774786.868601:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23732 00000100:00100000:0.0:1785774786.868614:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648466304:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774786.868721:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1785774786.868757:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d09e5de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd78 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868783:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09e04a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1441:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb48 expref: 47 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868795:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1441:0x0].0x0 (ffff9b7605dfd600) 00010000:00010000:0.0:1785774786.868810:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774786.868843:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868859:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868869:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868883:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868890:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868897:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868977:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868986:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.868999:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.869017:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.869028:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 46 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.869037:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.869075:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 46 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.869090:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 46 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.869108:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671206400:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774786.869341:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.877063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.877155:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648466432 00000100:00100000:2.0:1785774786.877199:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648466432 00010000:00010000:2.0:1785774786.877255:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 47 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.877299:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1619 00000100:00100000:2.0:1785774786.877310:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:2416:x1872519648466432:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774786.877339:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774786.877348:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 47 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.877363:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 47 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.877392:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5c:0x0].0x0 (ffff9b7605dfde00) 00010000:00010000:2.0:1785774786.877398:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.877410:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.877428:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.877457:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774786.877521:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:2416:x1872519648466432:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 213us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.877529:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1619 00010000:00010000:0.0:1785774786.878843:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09e058 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb4f expref: 46 pid: 8627 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.878866:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6530:1872519671206400:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774786.878890:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.878902:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.878910:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.878974:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.878982:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.878994:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.879016:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671206528:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1785774786.879063:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774786.879097:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.882770:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671206528 00000100:00100000:2.0:1785774786.882787:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671206528 00000100:00100000:2.0:1785774786.882870:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615 00000100:00100000:2.0:1785774786.882881:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:6530:x1872519671206528:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1785774786.882910:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774786.882934:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e88c expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.882980:0:7692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09e066 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb56 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.882990:0:7692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e88c expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.883026:0:7692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09e066 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb56 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.883041:0:7692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09e066 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb56 expref: 26 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.883056:0:7692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7692:1872519671206656:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774786.883435:0:7692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.894578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774786.898330:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648466560 00000100:00100000:2.0:1785774786.898347:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648466560 00010000:00010000:2.0:1785774786.898408:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09e066 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb56 expref: 27 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.898463:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1620 00000100:00100000:2.0:1785774786.898473:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:2417:x1872519648466560:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774786.898492:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774786.898499:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09e066 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb56 expref: 27 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898515:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09e066 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb56 expref: 27 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898542:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5c:0x0].0x0 (ffff9b7604f39900) 00010000:00010000:2.0:1785774786.898550:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e88c expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898563:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e88c expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898574:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e88c expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898614:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e88c expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.898630:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9541:1872519671206784:0@lo:105: 00000100:00100000:2.0:1785774786.898702:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.898740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671206784 00000100:00100000:2.0:1785774786.898743:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671206784 00000100:00100000:2.0:1785774786.898769:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1785774786.898775:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9541:x1872519671206784:12345-0@lo:105: 00010000:00010000:2.0:1785774786.898787:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898796:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898804:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898811:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898819:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898827:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.898840:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec3400) 00000100:00100000:2.0:1785774786.898868:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9541:x1872519671206784:12345-0@lo:105: Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.898874:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1785774786.898907:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.898933:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9541:1872519671206784:0@lo:105: 00010000:00010000:2.0:1785774786.898953:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774786.899006:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:2417:x1872519648466560:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 535us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.899013:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1620 00010000:00010000:0.0:1785774786.908697:0:7692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09e066 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bb56 expref: 26 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774786.908730:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:7692:1872519671206656:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774786.908771:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e88c expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.908783:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5c:0x0].0x0 (ffff9b7604f39900) 00010000:00010000:0.0:1785774786.908786:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774786.908790:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b600, rc 0) 00000100:00100000:0.0:1785774786.908908:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:6530:x1872519671206528:12345-0@lo:101:mdt00_001.0 Request processed in 26026us (29842us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.908919:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615 00000100:00100000:2.0:1785774786.909187:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671206528:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1785774786.909211:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774786.911720:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671206912:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1785774786.911807:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.911855:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774786.913551:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671206912 00000100:00100000:3.0:1785774786.913563:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671206912 00000100:00100000:3.0:1785774786.913635:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616 00000100:00100000:3.0:1785774786.913647:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:6530:x1872519671206912:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1785774786.929901:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+20:6530:x1872519671206912:12345-0@lo:403:mdt00_001.0 Request processed in 16240us (18078us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774786.929922:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616 00000100:00100000:0.0:1785774786.930125:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6530:1872519671206912:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1785774786.931245:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].388, 952 off585440 00000040:00080000:0.0:1785774786.931463:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].388, 1032 off639760 00000004:00080000:0.0:1785774786.931469:0:6530:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf80c0 with version 734 00000004:00080000:1.0:1785774786.931670:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 734 rpc_version 734 00000020:00100000:1.0:1785774786.931712:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774786.931721:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fe2ca80 x1872519671207168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774786.931747:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fe2ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671207168:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774786.931810:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.931849:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.932001:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671207168 00000100:00100000:2.0:1785774786.932010:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671207168 00000100:00100000:2.0:1785774786.932067:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617 00000100:00100000:2.0:1785774786.932077:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+20:7689:x1872519671207168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774786.932459:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:7689:x1872519671207168:12345-0@lo:1000:osp_up1-0.0 Request processed in 382us (646us total) trans 4294968447 rc 0/0 00000100:00100000:2.0:1785774786.932468:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617 00000100:00100000:1.0:1785774786.932850:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671207168:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1785774786.933119:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1441:0x0]: returning size 4096 00010000:00010000:2.0:1785774786.933145:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933174:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933192:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933204:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.933209:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933218:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933238:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5c:0x0].0x0 (ffff9b7605dfde00) 00010000:00010000:2.0:1785774786.933242:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774786.933247:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933253:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e885 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933279:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933288:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933295:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933325:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774786.933336:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5c:0x0] 00010000:00010000:2.0:1785774786.933348:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933356:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933363:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933368:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.933371:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933378:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933387:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1441:0x0].0x0 (ffff9b7605dfd900) 00010000:00010000:2.0:1785774786.933389:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774786.933393:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933399:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e87e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933429:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933436:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933442:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933448:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933453:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774786.933456:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933461:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933483:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605dfdb00) 00010000:00010000:2.0:1785774786.933485:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774786.933487:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933492:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e870 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774786.933504:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096ba536d reply state 000000002e4b5f7c transno 4294983539 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933518:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.933527:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x4fa399f7 (ffff9b7605dfd000) 00010000:00010000:2.0:1785774786.933529:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774786.933532:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774786.933608:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648466304:12345-192.168.202.31@tcp:36:rm.0 Request processed in 64996us (65941us total) trans 4294983539 rc 0/0 00000100:00100000:2.0:1785774786.933615:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23732 00010000:00010000:0.0:1785774786.934004:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774786.934012:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.934019:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774786.934024:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774786.934032:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.934067:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.934073:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774786.934104:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.934111:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3400/0x7b7109e1d09e88c lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e893 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.934125:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.934127:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774786.934128:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774786.934137:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774786.934150:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671207296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774786.938670:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774786.942113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671207296 00000100:00100000:2.0:1785774786.942129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671207296 00000100:00100000:2.0:1785774786.942263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1785774786.942278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734581c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+21:3653:x1872519671207296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774786.942303:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774786.942353:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09e893 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e88c expref: 21 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774786.942379:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5c:0x0].0x0 (ffff9b7604f39900) 00010000:00010000:2.0:1785774786.942406:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774786.942491:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734581c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+20:3653:x1872519671207296:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.942500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1785774786.950762:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671207296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774786.958817:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774786.958908:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648466816 00000100:00100000:3.0:1785774786.958920:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648466816 00000100:00100000:3.0:1785774786.958999:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23733 00000100:00100000:3.0:1785774786.959009:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:17768:x1872519648466816:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1785774786.959042:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774786.959068:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e89a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1505:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdd3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774786.959334:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1505:0x0]: returning size 4096 00010000:00010000:3.0:1785774786.959465:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e89a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdd3 expref: 49 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.959485:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605fcc300) 00010000:00010000:3.0:1785774786.959488:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774786.959494:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e89a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdd3 expref: 49 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.959510:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774786.959579:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648466816:12345-192.168.202.31@tcp:101:rm.0 Request processed in 570us (774us total) trans 4294983540 rc 301/301 00000100:00100000:3.0:1785774786.959587:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23733 00000100:00100000:0.0:1785774786.974402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.975510:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648467072 00000100:00100000:1.0:1785774786.975523:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648467072 00000100:00100000:1.0:1785774786.975600:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5069 00000100:00100000:1.0:1785774786.975613:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648467072:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1785774786.975887:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:17768:x1872519648467072:12345-192.168.202.31@tcp:35:rm.0 Request processed in 276us (1497us total) trans 4294983541 rc 0/0 00000100:00100000:1.0:1785774786.975895:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5069 00000100:00100000:1.0:1785774786.993519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774786.993564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774786.993682:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648467200 00000100:00100000:0.0:1785774786.993695:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648467200 00000100:00100000:0.0:1785774786.993792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1396 00000100:00100000:0.0:1785774786.993805:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:2416:x1872519648467200:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:0.0:1785774786.993828:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774786.993859:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149b000/0x7b7109e1d09e3e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcd0 expref: 26 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.993888:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605dfd700) 00010000:00010000:0.0:1785774786.993903:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774786.993979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:2416:x1872519648467200:12345-192.168.202.31@tcp:103:rm.0 Request processed in 176us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.993987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1396 00000100:00100000:3.0:1785774786.995139:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648467456 00000100:00100000:3.0:1785774786.995147:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648467456 00000100:00100000:3.0:1785774786.995540:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23734 00000100:00100000:3.0:1785774786.995556:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:17768:x1872519648467456:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774786.995624:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774786.995648:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09e402 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1505:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcde expref: 49 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.995666:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605fcc300) 00010000:00010000:3.0:1785774786.995676:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774786.995735:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.995745:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774786.995757:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774786.995782:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207424:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774786.995840:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774786.995903:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77012edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.996008:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671207424 00000100:00100000:0.0:1785774786.996013:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671207424 00000100:00100000:0.0:1785774786.996053:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618 00000100:00100000:0.0:1785774786.996062:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+20:8627:x1872519671207424:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774786.996076:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.996092:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e8af lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e8a8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.996118:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e8af lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e8a8 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.996137:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e8af lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8a8 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.996145:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfd600) 00010000:00010000:0.0:1785774786.996148:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.996151:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3400, rc 0) 00000100:00100000:0.0:1785774786.996235:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+21:8627:x1872519671207424:12345-0@lo:101:mdt00_004.0 Request processed in 174us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.996242:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618 00000100:00100000:1.0:1785774786.996440:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207424:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.996459:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.996470:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774786.996494:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1785774786.996517:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.996524:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.996532:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.996544:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207552:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1785774786.996572:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.996605:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c780 going to sleep for 11 seconds 00000100:00100000:0.0:1785774786.996754:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671207552 00000100:00100000:0.0:1785774786.996759:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671207552 00000100:00100000:0.0:1785774786.996792:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619 00000100:00100000:0.0:1785774786.996799:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+21:8627:x1872519671207552:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774786.996808:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774786.996821:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e8bd lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e8b6 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.996837:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e8bd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e8b6 expref: 22 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.996848:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e8bd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8b6 expref: 22 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774786.996856:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x60a2d708 (ffff9b7605dfdb00) 00010000:00010000:0.0:1785774786.996858:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774786.996861:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774786.996896:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+22:8627:x1872519671207552:12345-0@lo:101:mdt00_004.0 Request processed in 98us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774786.996903:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619 00000100:00100000:1.0:1785774786.996956:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207552:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.996978:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.996988:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774786.997001:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1785774786.997033:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207680:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774786.997060:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.997082:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774786.997204:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671207680 00000100:00100000:2.0:1785774786.997209:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671207680 00000100:00100000:2.0:1785774786.997240:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620 00000100:00100000:2.0:1785774786.997248:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:8627:x1872519671207680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774786.997314:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:8627:x1872519671207680:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774786.997335:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620 00000100:00100000:1.0:1785774786.997604:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207680:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774786.997646:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207808:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774786.997667:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.997686:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.997698:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671207808 00000100:00100000:1.0:1785774786.997701:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671207808 00000100:00100000:1.0:1785774786.997728:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621 00000100:00100000:1.0:1785774786.997733:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+22:8627:x1872519671207808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774786.997829:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+22:8627:x1872519671207808:12345-0@lo:1000:mdt00_004.0 Request processed in 96us (161us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774786.997835:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621 00000100:00100000:1.0:1785774786.997854:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207808:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1785774786.997889:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.997896:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.997904:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774786.997912:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207936:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1785774786.997929:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774786.997937:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c780 going to sleep for 11 seconds 00000100:00100000:1.0:1785774786.997947:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671207936 00000100:00100000:1.0:1785774786.997950:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671207936 00000100:00100000:1.0:1785774786.997963:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622 00000100:00100000:1.0:1785774786.998072:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+22:8627:x1872519671207936:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774786.998082:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774786.998094:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e8cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e8c4 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.998111:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e8cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e8c4 expref: 23 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.998123:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e8cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8c4 expref: 23 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774786.998131:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605fcc200) 00010000:00010000:1.0:1785774786.998134:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774786.998136:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce800, rc 0) 00000100:00100000:1.0:1785774787.001325:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+23:8627:x1872519671207936:12345-0@lo:101:mdt00_004.0 Request processed in 3239us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.001337:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622 00000100:00100000:0.0:1785774787.011177:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671207936:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774787.011438:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011458:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011515:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011527:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011539:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011564:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011578:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 48 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011588:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011634:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 48 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.011658:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 48 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.011675:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671208064:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774787.011829:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.026582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.026713:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648467584 00000100:00100000:3.0:1785774787.026726:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648467584 00010000:00010000:3.0:1785774787.026777:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 49 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.026828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1621 00000100:00100000:3.0:1785774787.026839:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:2417:x1872519648467584:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.026859:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.026867:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 49 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.026882:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 49 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.026912:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbd:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774787.026918:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.026929:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.026938:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.026960:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.027019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:2417:x1872519648467584:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 182us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.027027:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1621 00010000:00010000:2.0:1785774787.028521:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d09e410 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bce5 expref: 48 pid: 6530 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.028547:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671208064:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774787.028575:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.028586:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.028593:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.028649:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.028658:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.028671:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.028694:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671208192:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774787.028743:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.028783:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.030108:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671208192 00000100:00100000:0.0:1785774787.030119:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671208192 00000100:00100000:0.0:1785774787.030217:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3623 00000100:00100000:0.0:1785774787.030228:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+23:8627:x1872519671208192:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774787.030250:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774787.030272:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e8e0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.030305:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.030327:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.030361:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.030377:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 24 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.030392:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671208320:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774787.030472:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.043667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.044016:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671208320:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774787.044065:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.044083:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbd:0x0].0x0 (ffff9b7605fccc00) 00010000:00010000:2.0:1785774787.044086:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774787.044092:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.044104:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.044112:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2800, rc 0) 00000100:00100000:2.0:1785774787.044233:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+24:8627:x1872519671208192:12345-0@lo:101:mdt00_004.0 Request processed in 14006us (15487us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.044244:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3623 00000100:00100000:0.0:1785774787.044445:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671208192:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774787.044468:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.044482:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.046309:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648467712 00000100:00100000:3.0:1785774787.046333:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648467712 00010000:00010000:3.0:1785774787.046385:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 25 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.046432:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1622 00000100:00100000:3.0:1785774787.046443:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:2416:x1872519648467712:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.046460:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.046468:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 25 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.046482:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 25 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.046507:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09e41e lrc: 0/0,0 mode: --/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcec expref: 25 pid: 6531 timeout: 1128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.046525:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbd:0x0].0x0 (ffff9b7605fccc00) 00010000:00010000:3.0:1785774787.046531:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.046543:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.046553:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.046593:0:19895:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.046610:0:19895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:19895:1872519671208448:0@lo:105: 00000100:00100000:3.0:1785774787.046697:0:19895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.046755:0:19895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77012edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.049331:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671208448 00000100:00100000:1.0:1785774787.049347:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671208448 00000100:00100000:1.0:1785774787.049421:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1785774787.049432:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:19895:x1872519671208448:12345-0@lo:105: 00010000:00010000:1.0:1785774787.049451:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.049465:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.049481:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.049492:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.049501:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.049511:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.049541:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35a800) 00000100:00100000:1.0:1785774787.049630:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:19895:x1872519671208448:12345-0@lo:105: Request processed in 199us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.049639:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00010000:00010000:0.0:1785774787.051424:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.051440:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.052187:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671208576:0@lo:403:mdt00_004.0 00000100:00100000:0.0:1785774787.052260:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.052291:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.055445:0:19895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:19895:1872519671208448:0@lo:105: 00010000:00010000:3.0:1785774787.055478:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.055554:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:2416:x1872519648467712:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 9110us (11898us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.055566:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1622 00000100:00100000:3.0:1785774787.055622:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671208576 00000100:00100000:3.0:1785774787.055630:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671208576 00000100:00100000:3.0:1785774787.055674:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624 00000100:00100000:3.0:1785774787.055683:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+24:8627:x1872519671208576:12345-0@lo:403:mdt00_004.0 00000100:00100000:3.0:1785774787.057739:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+24:8627:x1872519671208576:12345-0@lo:403:mdt00_004.0 Request processed in 2051us (5473us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.057754:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624 00000100:00100000:0.0:1785774787.062769:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671208576:0@lo:403:mdt00_004.0 00000040:00080000:1.0:1785774787.086752:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].389, 952 off586392 00000040:00080000:1.0:1785774787.087006:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].389, 1032 off640792 00000004:00080000:1.0:1785774787.087016:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf8000 with version 735 00000004:00080000:2.0:1785774787.087456:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 735 rpc_version 735 00000020:00100000:2.0:1785774787.087504:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774787.087519:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb9d500 x1872519671208832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774787.087549:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671208832:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774787.087639:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.087685:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076780 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.087753:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671208832 00000100:00100000:0.0:1785774787.087763:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671208832 00000100:00100000:0.0:1785774787.087829:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625 00000100:00100000:0.0:1785774787.087839:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+24:7689:x1872519671208832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774787.088543:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+25:7689:x1872519671208832:12345-0@lo:1000:osp_up1-0.0 Request processed in 704us (903us total) trans 4294968448 rc 0/0 00000100:00100000:0.0:1785774787.088553:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625 00000100:00100000:2.0:1785774787.088655:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671208832:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1785774787.088903:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1505:0x0]: returning size 4096 00010000:00010000:1.0:1785774787.088929:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.088941:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.088950:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.088971:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774787.088977:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.088986:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089006:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbd:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:1.0:1785774787.089009:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774787.089014:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089021:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09e8d9 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089045:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089055:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089063:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089093:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774787.089103:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xbd:0x0] 00010000:00010000:1.0:1785774787.089113:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089119:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089126:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089132:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774787.089135:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089148:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089156:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605dfd900) 00010000:00010000:2.0:1785774787.089382:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774787.089390:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.089399:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774787.089404:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774787.089413:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.089444:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.089452:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774787.089482:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.089491:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8e0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8e7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.089509:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774787.089512:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774787.089514:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774787.089566:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671208960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774787.089609:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.089689:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671208960 00000100:00100000:2.0:1785774787.089697:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671208960 00000100:00100000:2.0:1785774787.089741:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1785774787.089748:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+25:3655:x1872519671208960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.089761:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.089780:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e8e7 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e8e0 expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.089793:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbd:0x0].0x0 (ffff9b7605fccc00) 00010000:00010000:2.0:1785774787.089801:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774787.089833:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671208960:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.089840:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1785774787.089863:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671208960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774787.089941:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774787.089947:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089954:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09e8d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089979:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089988:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.089996:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.090016:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774787.090027:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1785774787.090032:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.090041:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.090048:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.090064:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1785774787.090068:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1785774787.090073:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.090080:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090296:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774787.090303:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090311:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774787.090327:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774787.090336:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090358:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090365:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774787.090375:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090383:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfc00/0x7b7109e1d09e8c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090397:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774787.090400:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090406:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774787.090410:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774787.090418:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090432:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090443:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774787.090457:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090464:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09e8a8 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8af expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090477:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774787.090479:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774787.090481:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774787.090590:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774787.090601:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671209216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774787.090631:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.090654:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774787.090661:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671209088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774787.090679:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785774787.090696:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774787.090736:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209216 00000100:00100000:3.0:1785774787.090741:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209216 00000100:00100000:3.0:1785774787.090778:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209088 00000100:00100000:3.0:1785774787.090781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209088 00000100:00100000:3.0:1785774787.090797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1785774787.090804:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+25:3654:x1872519671209216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.090813:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.090827:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e8af lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e8a8 expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090839:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfd600) 00010000:00010000:3.0:1785774787.090846:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.090872:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+24:3654:x1872519671209216:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.090880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1785774787.090892:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1785774787.090898:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+23:3655:x1872519671209088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.090908:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.090918:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09e8cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1505:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e8c4 expref: 23 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.090929:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1505:0x0].0x0 (ffff9b7605fcc200) 00010000:00010000:3.0:1785774787.090935:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.090954:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671209088:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.090960:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1785774787.091085:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648467456:12345-192.168.202.31@tcp:36:rm.0 Request processed in 95533us (97578us total) trans 4294983542 rc 0/0 00000100:00100000:1.0:1785774787.091094:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23734 00000100:00100000:2.0:1785774787.092547:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671209216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774787.092585:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671209088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.118655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.118769:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648467968 00000100:00100000:2.0:1785774787.118782:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648467968 00000100:00100000:2.0:1785774787.118856:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23735 00000100:00100000:2.0:1785774787.118867:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:17768:x1872519648467968:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774787.118901:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.118927:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e8ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdda expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774787.119129:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13e5:0x0]: returning size 4096 00010000:00010000:2.0:1785774787.119506:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e8ee lrc: 1/0,0 mode: --/CR res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdda expref: 50 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.119524:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:2.0:1785774787.119528:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774787.119534:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e8ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdda expref: 50 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.119551:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a800, rc 0) 00000100:00100000:2.0:1785774787.119619:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:17768:x1872519648467968:12345-192.168.202.31@tcp:101:rm.0 Request processed in 753us (977us total) trans 4294983543 rc 301/301 00000100:00100000:2.0:1785774787.119628:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23735 00000100:00100000:3.0:1785774787.165312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774787.165512:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648468224 00000100:00100000:1.0:1785774787.165524:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648468224 00000100:00100000:1.0:1785774787.165599:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5070 00000100:00100000:1.0:1785774787.165611:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:17768:x1872519648468224:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1785774787.165907:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:17768:x1872519648468224:12345-192.168.202.31@tcp:35:rm.0 Request processed in 298us (608us total) trans 4294983544 rc 0/0 00000100:00100000:1.0:1785774787.165915:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5070 00000100:00100000:0.0:1785774787.184806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774787.184872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.185031:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648468352 00000100:00100000:3.0:1785774787.185044:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648468352 00000100:00100000:3.0:1785774787.185133:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1400 00000100:00100000:3.0:1785774787.185154:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734580850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:2417:x1872519648468352:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:3.0:1785774787.185432:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.185468:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e4fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd40 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.185494:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7605fcc600) 00010000:00010000:3.0:1785774787.185509:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.185673:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734580850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:2417:x1872519648468352:12345-192.168.202.31@tcp:103:rm.0 Request processed in 521us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.185682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1400 00000100:00100000:2.0:1785774787.187637:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648468608 00000100:00100000:2.0:1785774787.187648:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648468608 00000100:00100000:2.0:1785774787.187703:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23736 00000100:00100000:2.0:1785774787.187712:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:17768:x1872519648468608:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774787.187774:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.187798:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09e528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13e5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd55 expref: 50 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.187821:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:2.0:1785774787.187830:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774787.187891:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.187900:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.187911:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.187934:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209344:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1785774787.188001:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.188054:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.189522:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209344 00000100:00100000:3.0:1785774787.189531:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209344 00000100:00100000:3.0:1785774787.190845:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3626 00000100:00100000:3.0:1785774787.190858:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+22:8469:x1872519671209344:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774787.190885:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.190911:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e903 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e8fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.190946:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e903 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e8fc expref: 23 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.190972:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e903 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e8fc expref: 23 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.190982:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774787.190985:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774787.190989:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774787.191068:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+23:8469:x1872519671209344:12345-0@lo:101:mdt00_003.0 Request processed in 213us (3066us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.191076:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3626 00000100:00100000:2.0:1785774787.191183:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209344:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774787.191206:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.191218:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774787.191244:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1785774787.191279:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.191287:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.191296:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.191326:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209472:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1785774787.191359:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.213602:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076780 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.221392:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209472 00000100:00100000:1.0:1785774787.223619:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209472 00000100:00100000:1.0:1785774787.227749:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627 00000100:00100000:1.0:1785774787.227766:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+23:8469:x1872519671209472:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774787.227795:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774787.227830:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e911 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e90a expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.227872:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e911 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e90a expref: 24 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.227889:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e911 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e90a expref: 24 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.227899:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x61b4f7ef (ffff9b7605fcc100) 00010000:00010000:1.0:1785774787.227903:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774787.227907:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774787.228019:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+24:8469:x1872519671209472:12345-0@lo:101:mdt00_003.0 Request processed in 256us (36657us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.228027:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627 00000100:00100000:2.0:1785774787.228308:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209472:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774787.228345:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.228358:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774787.228392:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1785774787.228473:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209600:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774787.228528:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.228748:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.231380:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209600 00000100:00100000:3.0:1785774787.231394:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209600 00000100:00100000:3.0:1785774787.231487:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628 00000100:00100000:3.0:1785774787.231499:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+24:8469:x1872519671209600:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774787.231781:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+24:8469:x1872519671209600:12345-0@lo:1000:mdt00_003.0 Request processed in 283us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.231789:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628 00000100:00100000:2.0:1785774787.231878:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209600:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774787.231956:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209728:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774787.232005:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.232040:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.232156:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209728 00000100:00100000:1.0:1785774787.232208:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209728 00000100:00100000:1.0:1785774787.232236:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3629 00000100:00100000:1.0:1785774787.232242:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+24:8469:x1872519671209728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774787.232365:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+24:8469:x1872519671209728:12345-0@lo:1000:mdt00_003.0 Request processed in 122us (359us total) trans 0 rc 1/1 00000100:00100000:1.0:1785774787.232371:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3629 00000100:00100000:2.0:1785774787.232595:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209728:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1785774787.232657:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.232667:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.232678:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.232690:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209856:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1785774787.232712:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.232739:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.232834:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209856 00000100:00100000:3.0:1785774787.232839:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209856 00000100:00100000:3.0:1785774787.232868:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630 00000100:00100000:3.0:1785774787.232874:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+24:8469:x1872519671209856:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774787.232889:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.232906:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e91f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e918 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.232934:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e91f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e918 expref: 25 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.232949:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e91f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e918 expref: 25 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.232958:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774787.232973:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774787.232978:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774787.233008:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+25:8469:x1872519671209856:12345-0@lo:101:mdt00_003.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.233014:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630 00000100:00100000:2.0:1785774787.234327:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209856:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774787.234347:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.234359:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.234391:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.234400:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.234409:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.234453:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 3/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.234460:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 3/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.234468:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 3/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.234482:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209984:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1785774787.234518:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.234638:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.234700:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671209984 00000100:00100000:3.0:1785774787.234706:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671209984 00000100:00100000:3.0:1785774787.234741:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631 00000100:00100000:3.0:1785774787.234748:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+25:8469:x1872519671209984:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774787.234759:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.234771:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e92d expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.234793:0:20645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 22 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.234804:0:20645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e92d expref: 26 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.234831:0:20645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 22 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.234846:0:20645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 22 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.234858:0:20645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20645:1872519671210112:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774787.234927:0:20645:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77012edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.238909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.239505:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648468736 00000100:00100000:2.0:1785774787.239516:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648468736 00010000:00010000:2.0:1785774787.239709:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 23 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.239758:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1623 00000100:00100000:2.0:1785774787.239768:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:2416:x1872519648468736:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.239786:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.239794:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 23 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.239809:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 23 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.239835:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2d:0x0].0x0 (ffff9b7602507800) 00010000:00010000:2.0:1785774787.239842:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e92d expref: 26 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.239856:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e92d expref: 26 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.239867:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e92d expref: 26 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.239905:0:19895:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e92d expref: 26 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.239926:0:19895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:19895:1872519671210240:0@lo:105: 00000100:00100000:2.0:1785774787.240079:0:19895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785774787.240243:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ca1800/0x7b7109e1d09e51a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd4e expref: 23 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.240264:0:20645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20645:1872519671210112:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774787.240294:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 5/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e92d expref: 26 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.240303:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2d:0x0].0x0 (ffff9b7602507800) 00010000:00010000:3.0:1785774787.240306:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774787.240309:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774787.240369:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+26:8469:x1872519671209984:12345-0@lo:101:mdt00_003.0 Request processed in 5621us (5850us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.240378:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631 00000100:00100000:2.0:1785774787.241533:0:19895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.241744:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671209984:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774787.241764:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 4/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.241778:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 4/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.252481:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671210240 00000100:00100000:1.0:1785774787.252504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671210240 00000100:00100000:0.0:1785774787.253343:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1785774787.253362:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:19895:x1872519671210240:12345-0@lo:105: 00010000:00010000:0.0:1785774787.253386:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 5/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.253402:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 5/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.253423:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 5/0,1 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.253436:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.253447:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.253460:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.253494:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35be00) 00000100:00100000:0.0:1785774787.253696:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:19895:x1872519671210240:12345-0@lo:105: Request processed in 341us (13615us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.253705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1785774787.253814:0:19895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:19895:1872519671210240:0@lo:105: 00010000:00010000:3.0:1785774787.253843:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.253922:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2416:x1872519648468736:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 14152us (15020us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.253937:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1623 00010000:00010000:2.0:1785774787.254116:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.254130:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.264719:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671210368:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1785774787.264834:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.264892:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77012edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.265357:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671210368 00000100:00100000:1.0:1785774787.265370:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671210368 00000100:00100000:1.0:1785774787.265461:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3632 00000100:00100000:1.0:1785774787.265473:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+26:8469:x1872519671210368:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1785774787.267576:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+26:8469:x1872519671210368:12345-0@lo:403:mdt00_003.0 Request processed in 2099us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.267590:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3632 00000100:00100000:0.0:1785774787.268042:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671210368:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1785774787.269237:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].390, 808 off587200 00000040:00080000:0.0:1785774787.269460:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].390, 888 off641680 00000004:00080000:0.0:1785774787.269468:0:8469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf83c0 with version 736 00000004:00080000:1.0:1785774787.278541:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 736 rpc_version 736 00000020:00100000:1.0:1785774787.279142:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774787.280049:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760307ea00 x1872519671210624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2208/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774787.280145:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671210624:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774787.280755:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.280804:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.281642:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671210624 00000100:00100000:3.0:1785774787.281654:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671210624 00000100:00100000:3.0:1785774787.281731:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633 00000100:00100000:3.0:1785774787.281742:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+26:7689:x1872519671210624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774787.286701:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+27:7689:x1872519671210624:12345-0@lo:1000:osp_up1-0.0 Request processed in 4948us (5934us total) trans 4294968449 rc 0/0 00000100:00100000:3.0:1785774787.286720:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633 00000100:00100000:1.0:1785774787.287120:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671210624:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1785774787.287402:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x13e5:0x0]: returning size 4096 00010000:00010000:0.0:1785774787.287488:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287501:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287510:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287648:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774787.287661:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x2d:0x0] 00010000:00010000:0.0:1785774787.287674:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287682:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287689:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287695:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774787.287700:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287709:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287727:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7604f39300) 00010000:00010000:0.0:1785774787.287730:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774787.287735:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287741:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09e926 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287764:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287770:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.287777:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300076:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774787.300098:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300115:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774787.300124:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774787.300136:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300378:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 2/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300387:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774787.300448:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 1/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300458:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09e92d lrc: 0/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e934 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300488:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774787.300492:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300499:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774787.300503:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774787.300510:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300529:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.300534:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1785774787.300691:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774787.300719:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671210752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.300814:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785774787.300953:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.301039:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774787.301049:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671210880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.301078:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.301151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671210752 00000100:00100000:3.0:1785774787.301210:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671210752 00000100:00100000:3.0:1785774787.301268:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671210880 00000100:00100000:3.0:1785774787.301272:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671210880 00000100:00100000:3.0:1785774787.301296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1785774787.301307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+28:3653:x1872519671210752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.301334:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.301358:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e934 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e92d expref: 28 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.301374:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2d:0x0].0x0 (ffff9b7602507800) 00010000:00010000:3.0:1785774787.301386:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.301440:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+27:3653:x1872519671210752:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.301448:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1785774787.301467:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1785774787.301473:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+26:3656:x1872519671210880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.301481:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.301493:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09e91f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e918 expref: 26 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.301504:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13e5:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774787.301510:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.301530:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+25:3656:x1872519671210880:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.301537:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1785774787.301809:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671210880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.301835:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671210752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.301902:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774787.301904:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774787.301907:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774787.302084:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1785774787.302095:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e918 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e91f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774787.302132:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1785774787.302470:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.302481:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.302489:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.302513:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774787.302520:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1785774787.302527:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.302535:0:8469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.302623:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774787.302631:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.302639:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774787.302644:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774787.302652:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.302682:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.302690:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774787.302717:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.302724:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09e8fc lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e903 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.302738:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774787.302740:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774787.302742:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774787.302748:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774787.302758:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671211008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.302794:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.302825:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671211008 00000100:00100000:1.0:1785774787.302830:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671211008 00000100:00100000:1.0:1785774787.302862:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1785774787.302869:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+25:3655:x1872519671211008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774787.302879:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.302893:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e903 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e8fc expref: 25 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.302903:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7602507500) 00010000:00010000:1.0:1785774787.302911:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774787.302938:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671211008:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.302945:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1785774787.302985:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671211008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774787.303479:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:17768:x1872519648468608:12345-192.168.202.31@tcp:36:rm.0 Request processed in 115764us (118682us total) trans 4294983545 rc 0/0 00000100:00100000:3.0:1785774787.303489:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23736 00010000:00010000:2.0:1785774787.305116:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774787.310698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774787.323719:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648468992 00000100:00100000:0.0:1785774787.323741:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648468992 00000100:00100000:0.0:1785774787.323820:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23737 00000100:00100000:0.0:1785774787.323831:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:17768:x1872519648468992:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1785774787.323863:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774787.323892:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e93b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1463:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bde1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774787.325296:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1463:0x0]: returning size 4096 00010000:00010000:0.0:1785774787.325608:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e93b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bde1 expref: 52 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.325629:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7605dfda00) 00010000:00010000:0.0:1785774787.325632:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774787.325638:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e93b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bde1 expref: 52 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.325656:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774787.325784:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:17768:x1872519648468992:12345-192.168.202.31@tcp:101:rm.0 Request processed in 1954us (15099us total) trans 4294983546 rc 301/301 00000100:00100000:0.0:1785774787.325794:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23737 00000100:00100000:1.0:1785774787.362032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774787.362220:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648469248 00000100:00100000:0.0:1785774787.362232:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648469248 00000100:00100000:0.0:1785774787.362295:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5071 00000100:00100000:0.0:1785774787.362305:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:17768:x1872519648469248:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:0.0:1785774787.362738:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648469248:12345-192.168.202.31@tcp:35:rm.0 Request processed in 432us (717us total) trans 4294983547 rc 0/0 00000100:00100000:0.0:1785774787.362747:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5071 00010000:00010000:2.0:1785774787.371522:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774787.389745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774787.389811:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.389921:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648469632 00000100:00100000:3.0:1785774787.389934:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648469632 00000100:00100000:3.0:1785774787.390022:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23738 00000100:00100000:3.0:1785774787.390035:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648469632:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774787.390115:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.390151:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09e154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb1 expref: 52 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.390204:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7605dfda00) 00010000:00010000:3.0:1785774787.390219:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774787.390279:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.390290:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.390302:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.390338:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211136:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1785774787.390395:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.390464:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77012edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.393624:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671211136 00000100:00100000:0.0:1785774787.393640:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671211136 00000100:00100000:0.0:1785774787.393728:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634 00000100:00100000:0.0:1785774787.393740:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+24:6529:x1872519671211136:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774787.393774:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774787.393804:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e950 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e949 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.393842:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e950 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e949 expref: 25 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.393861:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e950 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e949 expref: 25 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.393871:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfd700) 00010000:00010000:0.0:1785774787.393875:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774787.393878:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774787.394158:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+25:6529:x1872519671211136:12345-0@lo:101:mdt00_000.0 Request processed in 420us (3760us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.394203:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634 00000100:00100000:0.0:1785774787.394267:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211136:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774787.394291:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.394303:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774787.394343:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774787.394382:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.394390:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.394399:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.394436:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211264:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1785774787.394476:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.394507:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.394726:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671211264 00000100:00100000:2.0:1785774787.394732:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671211264 00000100:00100000:2.0:1785774787.394769:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3635 00000100:00100000:2.0:1785774787.394777:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+25:6529:x1872519671211264:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774787.394788:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.394804:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e95e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e957 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.394823:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e95e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e957 expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.394834:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e95e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e957 expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.394842:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x74437f5b (ffff9b7604f39b00) 00010000:00010000:2.0:1785774787.394845:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774787.394848:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35be00, rc 0) 00000100:00100000:2.0:1785774787.394882:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+26:6529:x1872519671211264:12345-0@lo:101:mdt00_000.0 Request processed in 106us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.394888:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3635 00000100:00100000:0.0:1785774787.395832:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211264:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774787.395850:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.395863:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774787.395887:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1785774787.395937:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211392:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785774787.401674:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.401748:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.403076:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671211392 00000100:00100000:2.0:1785774787.403098:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671211392 00000100:00100000:2.0:1785774787.403209:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636 00000100:00100000:2.0:1785774787.403221:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:6529:x1872519671211392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774787.403375:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:6529:x1872519671211392:12345-0@lo:1000:mdt00_000.0 Request processed in 156us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.403384:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636 00000100:00100000:3.0:1785774787.403707:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211392:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774787.403808:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211520:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774787.403852:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.403889:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.406099:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671211520 00000100:00100000:2.0:1785774787.406117:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671211520 00000100:00100000:2.0:1785774787.406234:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637 00000100:00100000:2.0:1785774787.406246:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+26:6529:x1872519671211520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774787.407500:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+26:6529:x1872519671211520:12345-0@lo:1000:mdt00_000.0 Request processed in 1253us (3644us total) trans 0 rc 1/1 00000100:00100000:2.0:1785774787.407510:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637 00000100:00100000:2.0:1785774787.407576:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211520:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1785774787.407672:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.407684:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.407695:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.407714:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211648:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774787.407754:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.407792:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.407904:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671211648 00000100:00100000:3.0:1785774787.407911:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671211648 00000100:00100000:3.0:1785774787.407948:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3638 00000100:00100000:3.0:1785774787.407956:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:6529:x1872519671211648:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774787.407968:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.407987:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e965 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.408018:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.408030:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 4/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e965 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.408057:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.408072:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 21 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.408084:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671211776:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774787.408172:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.411100:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648469376 00000100:00100000:1.0:1785774787.411117:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648469376 00010000:00010000:1.0:1785774787.411215:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 22 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.411259:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1624 00000100:00100000:1.0:1785774787.411272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2417:x1872519648469376:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:1.0:1785774787.411291:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.411298:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 22 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.411325:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 22 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.411353:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7712d15000) 00010000:00010000:1.0:1785774787.411362:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 3/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e965 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.411376:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e965 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.411386:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09e965 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.411635:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e965 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.411653:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f712a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671211904:0@lo:105: 00000100:00100000:1.0:1785774787.411728:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.411778:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.411842:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671211904 00000100:00100000:0.0:1785774787.411847:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671211904 00000100:00100000:0.0:1785774787.411888:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1785774787.411896:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671211904:12345-0@lo:105: 00010000:00010000:0.0:1785774787.411908:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.411919:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.411928:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.411943:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.411952:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.411961:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.411989:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35ae00) 00000100:00100000:0.0:1785774787.412032:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671211904:12345-0@lo:105: Request processed in 136us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.412040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1785774787.413514:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f712a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671211904:0@lo:105: 00010000:00010000:1.0:1785774787.413719:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774787.413793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2417:x1872519648469376:12345-192.168.202.31@tcp:103:rm.0 Request processed in 2522us (23978us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.413803:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1624 00010000:00010000:3.0:1785774787.417208:0:6534:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000fd7ed414 x1872519671211776) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 21 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.417247:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1400/0x7b7109e1d09e138 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bba3 expref: 21 pid: 8627 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.417267:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6534:1872519671211776:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774787.417294:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7712d15000) 00010000:00010000:3.0:1785774787.417322:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e965 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.417333:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7712d15000) 00010000:00010000:3.0:1785774787.417336:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774787.417338:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774787.417405:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+27:6529:x1872519671211648:12345-0@lo:101:mdt00_000.0 Request processed in 9449us (9649us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.417423:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3638 00000100:00100000:2.0:1785774787.418577:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671211648:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774787.418603:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418658:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418673:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418686:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418708:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418720:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09e162 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb8 expref: 51 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418729:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 4/0,1 mode: --/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418769:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09e162 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb8 expref: 51 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.418785:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09e162 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb8 expref: 51 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.418802:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6529:1872519671212032:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774787.418888:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.429918:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6529:1872519671212032:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774787.429958:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.434397:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774787.435525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648469760 00000100:00100000:1.0:1785774787.435538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648469760 00010000:00010000:1.0:1785774787.435600:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09e162 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb8 expref: 52 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.435653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1625 00000100:00100000:1.0:1785774787.435663:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:2417:x1872519648469760:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774787.435687:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.435695:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09e162 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb8 expref: 52 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.435710:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09e162 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb8 expref: 52 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.435737:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09e162 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbb8 expref: 52 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.435757:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6c:0x0].0x0 (ffff9b7604f39a00) 00010000:00010000:1.0:1785774787.435763:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.435774:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.435783:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.435822:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774787.435889:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:2417:x1872519648469760:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 227us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.435897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1625 00010000:00010000:2.0:1785774787.436119:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.436134:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.436235:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.436244:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.436256:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.436282:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671212160:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774787.436351:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.436392:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.436567:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671212160 00000100:00100000:3.0:1785774787.436573:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671212160 00000100:00100000:3.0:1785774787.436610:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3639 00000100:00100000:3.0:1785774787.436617:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+27:6529:x1872519671212160:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774787.436635:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.436653:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e981 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.436679:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.436688:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.436712:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.436725:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 20 pid: 6531 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.436736:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671212288:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774787.436783:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.459739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.460389:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671212288:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774787.460462:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.460478:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6c:0x0].0x0 (ffff9b7712d15100) 00010000:00010000:3.0:1785774787.460482:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774787.460486:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.460497:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.460510:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774787.460602:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+28:6529:x1872519671212160:12345-0@lo:101:mdt00_000.0 Request processed in 23984us (24251us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.460613:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3639 00000100:00100000:2.0:1785774787.460825:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671212160:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774787.460849:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.460861:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.461817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648469888 00000100:00100000:1.0:1785774787.461829:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648469888 00010000:00010000:1.0:1785774787.461875:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 21 pid: 6531 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.461925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1626 00000100:00100000:1.0:1785774787.461935:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734583850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:2416:x1872519648469888:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774787.461953:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.461969:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 21 pid: 6531 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.461982:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 21 pid: 6531 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.462007:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef1000/0x7b7109e1d09e170 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bbbf expref: 21 pid: 6531 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.462021:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6c:0x0].0x0 (ffff9b7712d15100) 00010000:00010000:1.0:1785774787.462026:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.462036:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.462044:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.462079:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.462092:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f712a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6515:1872519671212416:0@lo:105: 00000100:00100000:1.0:1785774787.462146:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.462217:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.462351:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671212416 00000100:00100000:0.0:1785774787.462355:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671212416 00000100:00100000:0.0:1785774787.462401:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1785774787.462409:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6515:x1872519671212416:12345-0@lo:105: 00010000:00010000:0.0:1785774787.462421:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.462430:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.462438:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.462450:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.462457:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.462466:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.462486:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35b600) 00000100:00100000:0.0:1785774787.462530:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6515:x1872519671212416:12345-0@lo:105: Request processed in 122us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.462538:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1785774787.462588:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f712a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6515:1872519671212416:0@lo:105: 00010000:00010000:0.0:1785774787.462605:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774787.462648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734583850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648469888:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 715us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.462656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1626 00010000:00010000:2.0:1785774787.463201:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.463213:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.463930:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671212544:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1785774787.463995:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.464028:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076d80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.464453:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671212544 00000100:00100000:0.0:1785774787.464460:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671212544 00000100:00100000:0.0:1785774787.464515:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3640 00000100:00100000:0.0:1785774787.464525:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+28:6529:x1872519671212544:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1785774787.473150:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+28:6529:x1872519671212544:12345-0@lo:403:mdt00_000.0 Request processed in 8613us (9140us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.473333:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3640 00000100:00100000:0.0:1785774787.473518:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671212544:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1785774787.480943:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].391, 952 off588152 00000040:00080000:0.0:1785774787.482089:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].391, 1032 off642712 00000004:00080000:0.0:1785774787.482101:0:6529:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7715f796c0 with version 737 00000004:00080000:1.0:1785774787.496515:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 737 rpc_version 737 00000020:00100000:2.0:1785774787.499571:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774787.499595:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b7a680 x1872519671212800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774787.499631:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671212800:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774787.499746:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.499816:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671212800 00000100:00100000:2.0:1785774787.499827:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671212800 00000100:00100000:2.0:1785774787.499893:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3641 00000100:00100000:2.0:1785774787.499904:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+28:7689:x1872519671212800:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774787.500465:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+29:7689:x1872519671212800:12345-0@lo:1000:osp_up1-0.0 Request processed in 560us (718us total) trans 4294968450 rc 0/0 00000100:00100000:2.0:1785774787.500474:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3641 00000100:00100000:2.0:1785774787.500504:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076600 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.500555:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671212800:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1785774787.501287:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1463:0x0]: returning size 4096 00010000:00010000:0.0:1785774787.501327:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501339:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501349:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501357:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774787.501362:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501371:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501389:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6c:0x0].0x0 (ffff9b7604f39a00) 00010000:00010000:0.0:1785774787.501392:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774787.501398:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 2/0,0 mode: --/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501405:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09e97a lrc: 0/0,0 mode: --/EX res: [0x200000400:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501437:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501447:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501461:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501486:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774787.501497:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x6c:0x0] 00010000:00010000:0.0:1785774787.501507:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501513:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501520:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501525:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774787.501528:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501534:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501550:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7604f39300) 00010000:00010000:0.0:1785774787.501552:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774787.501556:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501563:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09e973 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501576:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501584:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501592:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501606:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1785774787.501617:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774787.501622:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501629:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501637:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501653:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1785774787.501656:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1785774787.501665:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785774787.501671:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501678:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774787.501683:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774787.501692:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501726:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501733:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774787.501755:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501763:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35b600/0x7b7109e1d09e981 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e988 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501776:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774787.501780:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501786:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774787.501789:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774787.501797:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501813:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501819:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774787.501824:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501838:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e965 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e96c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501850:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774787.501853:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501859:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774787.501862:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774787.501871:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501884:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501890:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774787.501904:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501912:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0e00/0x7b7109e1d09e949 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e950 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.501924:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774787.501926:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774787.501928:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774787.501941:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671213056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774787.502223:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.502256:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774787.502262:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671212928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774787.502284:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.502322:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671213184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774787.502346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.502386:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671213056 00000100:00100000:0.0:1785774787.502393:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671213056 00000100:00100000:0.0:1785774787.502444:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671212928 00000100:00100000:0.0:1785774787.502447:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671212928 00000100:00100000:0.0:1785774787.502463:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671213184 00000100:00100000:0.0:1785774787.502466:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671213184 00000100:00100000:0.0:1785774787.502478:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1785774787.502486:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+31:3654:x1872519671213056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774787.502500:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774787.502520:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09e96c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1463:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e965 expref: 31 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.502534:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1463:0x0].0x0 (ffff9b7712d15000) 00010000:00010000:0.0:1785774787.502712:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774787.502748:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+30:3654:x1872519671213056:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.502757:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1785774787.502775:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1785774787.502781:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+29:3654:x1872519671212928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774787.502789:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774787.502800:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09e988 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e981 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.502811:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6c:0x0].0x0 (ffff9b7712d15100) 00010000:00010000:0.0:1785774787.502818:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774787.502836:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671212928:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.502842:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1785774787.502855:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1785774787.502860:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+27:3655:x1872519671213184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774787.502867:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774787.502876:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e950 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e949 expref: 27 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.502886:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605dfd700) 00010000:00010000:0.0:1785774787.502893:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774787.502913:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+26:3655:x1872519671213184:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.502919:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00010000:00010000:1.0:1785774787.503087:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774787.503468:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671212928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.503478:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671213056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.504389:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774787.505394:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671213184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.505579:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.505594:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774787.505712:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:17768:x1872519648469632:12345-192.168.202.31@tcp:36:rm.0 Request processed in 115677us (115977us total) trans 4294983548 rc 0/0 00000100:00100000:3.0:1785774787.505721:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23738 00000100:00100000:2.0:1785774787.545362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.545552:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648470144 00000100:00100000:3.0:1785774787.545566:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648470144 00000100:00100000:3.0:1785774787.545657:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23739 00000100:00100000:3.0:1785774787.545669:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:17768:x1872519648470144:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1785774787.545704:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.545732:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e98f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1511:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bde8 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774787.545946:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1511:0x0]: returning size 4096 00010000:00010000:3.0:1785774787.546079:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e98f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bde8 expref: 53 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.546097:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774787.546102:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774787.546108:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e98f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bde8 expref: 53 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.546125:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:2.0:1785774787.555905:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648470144:12345-192.168.202.31@tcp:101:rm.0 Request processed in 10219us (10539us total) trans 4294983549 rc 301/301 00000100:00100000:2.0:1785774787.555928:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23739 00000100:00100000:0.0:1785774787.585251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774787.585730:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648470400 00000100:00100000:1.0:1785774787.585743:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648470400 00000100:00100000:1.0:1785774787.585819:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5072 00000100:00100000:1.0:1785774787.585832:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732246c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648470400:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1785774787.586145:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732246c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:17768:x1872519648470400:12345-192.168.202.31@tcp:35:rm.0 Request processed in 315us (906us total) trans 4294983550 rc 0/0 00000100:00100000:1.0:1785774787.586154:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5072 00000100:00100000:0.0:1785774787.606476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774787.606529:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.606675:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648470528 00000100:00100000:3.0:1785774787.606689:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648470528 00000100:00100000:3.0:1785774787.606769:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1407 00000100:00100000:3.0:1785774787.606781:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648470528:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:3.0:1785774787.606803:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774787.606836:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf000/0x7b7109e1d09e43a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcf3 expref: 20 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.606860:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605fcc700) 00010000:00010000:3.0:1785774787.606875:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774787.606987:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648470528:12345-192.168.202.31@tcp:103:rm.0 Request processed in 206us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.606997:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1407 00000100:00100000:1.0:1785774787.609090:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648470784 00000100:00100000:1.0:1785774787.609100:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648470784 00000100:00100000:1.0:1785774787.609154:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23740 00000100:00100000:1.0:1785774787.609233:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:17768:x1872519648470784:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774787.609323:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.609351:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d09e456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1511:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd01 expref: 53 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.609372:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774787.609380:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774787.609442:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.609457:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.609468:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.609495:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213312:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1785774787.609559:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.609617:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.613865:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671213312 00000100:00100000:2.0:1785774787.613882:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671213312 00000100:00100000:2.0:1785774787.613970:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3642 00000100:00100000:2.0:1785774787.613983:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:8627:x1872519671213312:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774787.614016:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.614052:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9a4 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e99d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.614092:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9a4 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e99d expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.614114:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9a4 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e99d expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.614124:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7604f39e00) 00010000:00010000:2.0:1785774787.614128:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774787.614132:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774787.614267:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+27:8627:x1872519671213312:12345-0@lo:101:mdt00_004.0 Request processed in 286us (4705us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.614275:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3642 00000100:00100000:1.0:1785774787.615331:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213312:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774787.615359:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.615374:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774787.615408:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1785774787.615459:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.615468:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.615479:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.615505:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213440:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1785774787.615554:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.615601:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.615714:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671213440 00000100:00100000:3.0:1785774787.615722:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671213440 00000100:00100000:3.0:1785774787.615773:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3643 00000100:00100000:3.0:1785774787.615783:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+27:8627:x1872519671213440:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774787.615794:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.615811:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e9b2 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e9ab expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.615832:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e9ab expref: 28 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.615846:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e9b2 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e9ab expref: 28 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.615855:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xcefb0e88 (ffff9b7602507800) 00010000:00010000:3.0:1785774787.615858:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774787.615861:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774787.615905:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+28:8627:x1872519671213440:12345-0@lo:101:mdt00_004.0 Request processed in 124us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.615912:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3643 00000100:00100000:1.0:1785774787.621554:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213440:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774787.621617:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.621641:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774787.621682:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1785774787.621779:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735946a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213568:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774787.621883:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.621939:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.622380:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671213568 00000100:00100000:2.0:1785774787.622392:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671213568 00000100:00100000:2.0:1785774787.622479:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3644 00000100:00100000:2.0:1785774787.622493:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+28:8627:x1872519671213568:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774787.622632:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+28:8627:x1872519671213568:12345-0@lo:1000:mdt00_004.0 Request processed in 142us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.622645:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3644 00000100:00100000:3.0:1785774787.622781:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213568:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774787.622845:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213696:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774787.622878:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.622911:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77011ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.622966:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671213696 00000100:00100000:0.0:1785774787.622971:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671213696 00000100:00100000:0.0:1785774787.623010:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3645 00000100:00100000:0.0:1785774787.623019:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+28:8627:x1872519671213696:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774787.623126:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+28:8627:x1872519671213696:12345-0@lo:1000:mdt00_004.0 Request processed in 108us (246us total) trans 0 rc 1/1 00000100:00100000:0.0:1785774787.623134:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3645 00000100:00100000:0.0:1785774787.623198:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213696:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1785774787.623280:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623290:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623302:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.623325:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213824:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1785774787.623350:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.623366:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.623377:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671213824 00000100:00100000:0.0:1785774787.623381:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671213824 00000100:00100000:0.0:1785774787.623397:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3646 00000100:00100000:0.0:1785774787.623402:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+28:8627:x1872519671213824:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774787.623425:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774787.623443:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e9c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e9b9 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623472:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e9b9 expref: 29 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623489:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e9b9 expref: 29 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623506:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605dfd300) 00010000:00010000:0.0:1785774787.623510:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774787.623514:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774787.623713:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+29:8627:x1872519671213824:12345-0@lo:101:mdt00_004.0 Request processed in 137us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.623722:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3646 00000100:00100000:0.0:1785774787.623749:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671213824:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774787.623760:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623772:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623798:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623808:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623817:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623836:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623850:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 52 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623867:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 4/0,1 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623891:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 52 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.623907:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 52 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.623918:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671213952:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774787.623998:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.633825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774787.633936:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648470912 00000100:00100000:1.0:1785774787.633948:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648470912 00010000:00010000:1.0:1785774787.634017:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 53 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.634067:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1627 00000100:00100000:1.0:1785774787.634078:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:2416:x1872519648470912:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774787.634097:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.634106:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 53 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.634123:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 53 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.634152:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc2:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774787.634157:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.634225:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.634234:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.634258:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774787.634332:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:2416:x1872519648470912:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 255us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.634341:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1627 00010000:00010000:2.0:1785774787.634554:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d09e464 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd08 expref: 52 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.634574:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671213952:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774787.634600:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.634611:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.634617:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.634671:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.634678:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.634689:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.634710:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671214080:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774787.634756:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.634795:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076600 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.634984:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671214080 00000100:00100000:1.0:1785774787.634989:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671214080 00000100:00100000:1.0:1785774787.635029:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3647 00000100:00100000:1.0:1785774787.635037:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+29:8627:x1872519671214080:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774787.635056:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774787.635073:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09e9d5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.635098:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.635109:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.635135:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.635149:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 18 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.635198:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671214208:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774787.635535:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c840 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.658593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774787.661479:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6535:1872519671214208:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774787.661538:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.661568:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:1.0:1785774787.661572:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774787.661577:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.661589:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.661598:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:1.0:1785774787.661709:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+30:8627:x1872519671214080:12345-0@lo:101:mdt00_004.0 Request processed in 26671us (26950us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.661721:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3647 00000100:00100000:2.0:1785774787.662380:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648471040 00000100:00100000:2.0:1785774787.662391:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648471040 00010000:00010000:2.0:1785774787.662446:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 19 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.662489:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1628 00000100:00100000:2.0:1785774787.662498:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648471040:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.662516:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.662524:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 19 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.662538:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 19 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.662574:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b770149a000/0x7b7109e1d09e472 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bd0f expref: 19 pid: 6529 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.662595:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:2.0:1785774787.662601:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.662613:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.662623:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.662662:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.662677:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671214336:0@lo:105: 00000100:00100000:2.0:1785774787.662736:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.662779:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77110760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.663654:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1785774787.663670:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671214336 00000100:00100000:1.0:1785774787.663676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671214336 00000100:00100000:1.0:1785774787.663719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1785774787.663727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671214336:12345-0@lo:105: 00010000:00010000:1.0:1785774787.663741:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.663758:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.663768:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.663777:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.663785:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.663795:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.663810:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35ae00) 00000100:00100000:1.0:1785774787.663850:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6516:x1872519671214336:12345-0@lo:105: Request processed in 124us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.663858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1785774787.664664:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671214080:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774787.664686:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.666661:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671214464:0@lo:403:mdt00_004.0 00000100:00100000:0.0:1785774787.666734:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.666764:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.666866:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671214464 00000100:00100000:1.0:1785774787.666873:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671214464 00000100:00100000:1.0:1785774787.666930:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3648 00000100:00100000:1.0:1785774787.666939:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+30:8627:x1872519671214464:12345-0@lo:403:mdt00_004.0 00000100:00100000:1.0:1785774787.668913:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+30:8627:x1872519671214464:12345-0@lo:403:mdt00_004.0 Request processed in 1967us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.668929:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3648 00000100:00100000:2.0:1785774787.670510:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6516:1872519671214336:0@lo:105: 00010000:00010000:2.0:1785774787.670558:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774787.670638:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648471040:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 8137us (12057us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.670651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1628 00000100:00100000:2.0:1785774787.677694:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671214464:0@lo:403:mdt00_004.0 00000040:00080000:2.0:1785774787.686152:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].392, 952 off589104 00000040:00080000:2.0:1785774787.689913:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].392, 1032 off643744 00000004:00080000:2.0:1785774787.689924:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b77110760c0 with version 738 00000004:00080000:3.0:1785774787.691529:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 738 rpc_version 738 00000020:00100000:3.0:1785774787.691594:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774787.691609:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c16300 x1872519671214720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774787.691640:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671214720:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774787.691728:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.691783:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77011ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.691903:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671214720 00000100:00100000:1.0:1785774787.691912:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671214720 00000100:00100000:1.0:1785774787.691986:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3649 00000100:00100000:1.0:1785774787.691997:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+30:7689:x1872519671214720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774787.692650:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+31:7689:x1872519671214720:12345-0@lo:1000:osp_up1-0.0 Request processed in 653us (920us total) trans 4294968451 rc 0/0 00000100:00100000:1.0:1785774787.692659:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3649 00000100:00100000:3.0:1785774787.694375:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671214720:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1785774787.694500:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1511:0x0]: returning size 4096 00010000:00010000:2.0:1785774787.694527:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.695992:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696006:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696014:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774787.696019:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696028:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696048:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc2:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:2.0:1785774787.696052:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774787.696057:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696063:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09e9ce lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696090:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696099:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696107:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.696139:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774787.696149:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xc2:0x0] 00010000:00010000:1.0:1785774787.696295:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774787.696303:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.696320:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774787.696325:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774787.696334:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.696376:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.696383:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1785774787.697227:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671214848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774787.697302:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785774787.697520:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697529:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697536:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697618:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774787.697621:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697629:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697641:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605dfd100) 00010000:00010000:2.0:1785774787.697643:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774787.697647:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697653:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09e9c7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697671:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697679:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697685:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697710:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774787.697726:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1785774787.697731:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697739:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697747:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697764:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1785774787.697769:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1785774787.697775:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.697783:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.697863:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648470784:12345-192.168.202.31@tcp:36:rm.0 Request processed in 88698us (91329us total) trans 4294983551 rc 0/0 00000100:00100000:2.0:1785774787.697873:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23740 00000100:00100000:0.0:1785774787.698023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671214848 00000100:00100000:0.0:1785774787.698037:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671214848 00000100:00100000:0.0:1785774787.698119:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1785774787.698129:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734582850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+31:3656:x1872519671214848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774787.698144:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774787.698198:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09e9dc lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e9d5 expref: 31 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.698216:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:0.0:1785774787.698226:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774787.698282:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734582850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+30:3656:x1872519671214848:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.698289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00010000:00010000:1.0:1785774787.699052:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699066:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ae00/0x7b7109e1d09e9d5 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9dc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699089:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774787.699094:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699102:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774787.699107:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774787.699116:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699144:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699150:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774787.699303:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699322:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2000/0x7b7109e1d09e9b9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9c0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699340:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774787.699343:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699349:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774787.699353:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774787.699360:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699378:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699385:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774787.699391:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.699397:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf600/0x7b7109e1d09e99d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9a4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.700369:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774787.700373:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774787.700375:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774787.700386:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774787.700400:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671214976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774787.700716:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671214848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.700745:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774787.701335:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.701366:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774787.701372:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671215104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.701391:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.701514:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671214976 00000100:00100000:2.0:1785774787.701522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671214976 00000100:00100000:2.0:1785774787.703557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671215104 00000100:00100000:2.0:1785774787.703564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671215104 00000100:00100000:2.0:1785774787.703600:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1785774787.703610:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+31:3653:x1872519671214976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.703628:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.703655:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09e9c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1511:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e9b9 expref: 31 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.703675:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1511:0x0].0x0 (ffff9b7605dfd300) 00010000:00010000:2.0:1785774787.703688:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774787.703736:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+30:3653:x1872519671214976:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.703743:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1785774787.703760:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1785774787.703766:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+29:3653:x1872519671215104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.703773:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.703785:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9a4 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e99d expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.703796:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7604f39e00) 00010000:00010000:2.0:1785774787.703803:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774787.703821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+28:3653:x1872519671215104:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.703828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1785774787.704556:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671215104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.704567:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671214976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774787.731649:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.731797:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648471168 00000100:00100000:3.0:1785774787.731810:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648471168 00000100:00100000:3.0:1785774787.731884:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23741 00000100:00100000:3.0:1785774787.731895:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471168:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1785774787.731929:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.731956:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e9e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.732103:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.732122:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.732135:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.732147:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.732154:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.733508:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.733517:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774787.733522:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.733535:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.734305:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:3.0:1785774787.734319:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774787.734327:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.734335:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09e9ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.734392:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e9e3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdef expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.734404:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:3.0:1785774787.734598:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774787.734605:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09e9e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdef expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.734618:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:2.0:1785774787.745643:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471168:12345-192.168.202.31@tcp:101:rm.0 Request processed in 13731us (13989us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774787.745661:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23741 00000100:00100000:1.0:1785774787.748536:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774787.748573:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671215232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774787.748653:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.748974:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671215232 00000100:00100000:2.0:1785774787.748984:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671215232 00000100:00100000:2.0:1785774787.749046:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3650 00000100:00100000:2.0:1785774787.749056:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:3656:x1872519671215232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774787.749106:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444057088 avail 1297817600 00000100:00100000:1.0:1785774787.749548:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671215232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774787.749711:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:3656:x1872519671215232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 655us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.749720:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3650 00000100:00100000:3.0:1785774787.751585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.751738:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648471296 00000100:00100000:2.0:1785774787.751746:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648471296 00000100:00100000:2.0:1785774787.751798:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23742 00000100:00100000:2.0:1785774787.751807:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471296:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774787.751827:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.751853:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdf6 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752013:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752030:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752044:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752056:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752063:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752070:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752075:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774787.752080:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752087:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752100:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:2.0:1785774787.752103:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774787.752108:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752114:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09e9f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752149:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9f1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdf6 expref: 53 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752379:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:2.0:1785774787.752383:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774787.752388:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdf6 expref: 53 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.752398:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774787.752468:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471296:12345-192.168.202.31@tcp:101:rm.0 Request processed in 661us (888us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774787.752475:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23742 00000100:00100000:0.0:1785774787.767628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.767790:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648471552 00000100:00100000:2.0:1785774787.767803:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648471552 00000100:00100000:2.0:1785774787.767878:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23743 00000100:00100000:2.0:1785774787.767889:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:17768:x1872519648471552:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774787.767922:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.767948:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9ff lrc: 2/0,0 mode: --/CR res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bdfd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774787.768144:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x14e:0x0]: returning size 4096 00010000:00010000:2.0:1785774787.768382:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9ff lrc: 1/0,0 mode: --/CR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdfd expref: 20 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.768400:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:2.0:1785774787.768404:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774787.769357:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09e9ff lrc: 0/0,0 mode: --/CR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bdfd expref: 20 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.769377:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774787.770389:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:17768:x1872519648471552:12345-192.168.202.31@tcp:101:rm.0 Request processed in 2497us (2772us total) trans 4294968452 rc 301/301 00000100:00100000:2.0:1785774787.770401:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23743 00000100:00100000:0.0:1785774787.781615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.781788:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648471680 00000100:00100000:2.0:1785774787.781801:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648471680 00000100:00100000:2.0:1785774787.781874:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23744 00000100:00100000:2.0:1785774787.781885:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471680:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774787.781912:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.781938:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be04 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782294:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782324:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782341:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782353:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782361:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782367:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782376:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774787.782381:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782390:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.782404:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:2.0:1785774787.785294:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774787.785304:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.785325:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.785380:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea0d lrc: 1/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be04 expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.785395:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:2.0:1785774787.785397:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774787.785401:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be04 expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.785424:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774787.785506:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471680:12345-192.168.202.31@tcp:101:rm.0 Request processed in 3622us (3905us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774787.785514:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23744 00000100:00100000:3.0:1785774787.806649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.807736:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648471808 00000100:00100000:2.0:1785774787.807753:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648471808 00000100:00100000:2.0:1785774787.807847:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23745 00000100:00100000:2.0:1785774787.807858:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471808:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774787.807885:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.807913:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be0b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808077:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808097:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808113:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808126:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808133:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808140:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808148:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774787.808153:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808689:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808711:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:2.0:1785774787.808714:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774787.808720:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808727:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ea22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808767:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea1b lrc: 1/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be0b expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808778:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:2.0:1785774787.808781:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774787.808785:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be0b expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.808795:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774787.808871:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471808:12345-192.168.202.31@tcp:101:rm.0 Request processed in 1016us (2232us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774787.808880:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23745 00000100:00100000:0.0:1785774787.831290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774787.831447:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648471936 00000100:00100000:1.0:1785774787.831457:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648471936 00000100:00100000:1.0:1785774787.831515:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5073 00000100:00100000:1.0:1785774787.831527:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471936:12345-192.168.202.31@tcp:37:rm.0 00000100:00100000:1.0:1785774787.831682:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:17768:x1872519648471936:12345-192.168.202.31@tcp:37:rm.0 Request processed in 157us (400us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774787.831689:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5073 00000100:00100000:1.0:1785774787.842242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.842337:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648472192 00000100:00100000:3.0:1785774787.842347:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648472192 00000100:00100000:3.0:1785774787.842412:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5074 00000100:00100000:3.0:1785774787.842422:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:17768:x1872519648472192:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:3.0:1785774787.842667:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17768:x1872519648472192:12345-192.168.202.31@tcp:35:rm.0 Request processed in 246us (433us total) trans 4294968453 rc 0/0 00000100:00100000:3.0:1785774787.842679:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5074 00000100:00100000:3.0:1785774787.854577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774787.854630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774787.854766:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648472320 00000100:00100000:1.0:1785774787.854778:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648472320 00000100:00100000:1.0:1785774787.854866:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1411 00000100:00100000:1.0:1785774787.854878:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:2416:x1872519648472320:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:1.0:1785774787.854899:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.854932:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09e361 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc91 expref: 52 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.855018:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7712d15a00) 00010000:00010000:1.0:1785774787.855033:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774787.855093:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:2416:x1872519648472320:12345-192.168.202.31@tcp:103:rm.0 Request processed in 219us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.855101:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1411 00000100:00100000:2.0:1785774787.855784:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648472576 00000100:00100000:2.0:1785774787.855800:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648472576 00000100:00100000:2.0:1785774787.855879:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23746 00000100:00100000:2.0:1785774787.855890:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:17768:x1872519648472576:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774787.855948:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.855976:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09e399 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x14e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcad expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.856002:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:2.0:1785774787.856013:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774787.856063:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.856071:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.856082:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.856102:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215360:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774787.856198:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.856249:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774787.857449:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671215360 00000100:00100000:1.0:1785774787.857460:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671215360 00000100:00100000:1.0:1785774787.857570:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3651 00000100:00100000:1.0:1785774787.857580:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:8627:x1872519671215360:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774787.857600:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774787.857626:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09ea30 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ea29 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.857657:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09ea30 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ea29 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.857672:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09ea30 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea29 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.857681:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:1.0:1785774787.857684:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774787.857687:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce800, rc 0) 00000100:00100000:1.0:1785774787.857757:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:8627:x1872519671215360:12345-0@lo:101:mdt00_004.0 Request processed in 179us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.857764:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3651 00000100:00100000:2.0:1785774787.857849:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215360:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774787.857871:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.857883:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774787.857911:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1785774787.857944:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.857952:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.857975:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.857995:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215488:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774787.858029:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.863648:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.865058:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671215488 00000100:00100000:3.0:1785774787.865073:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671215488 00000100:00100000:3.0:1785774787.865234:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3652 00000100:00100000:3.0:1785774787.865247:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:8627:x1872519671215488:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774787.865274:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774787.865609:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ea3e lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ea37 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.865649:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ea3e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ea37 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.865666:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ea3e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea37 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.865675:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x51102365 (ffff9b7602507b00) 00010000:00010000:3.0:1785774787.865678:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774787.865683:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774787.865775:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:8627:x1872519671215488:12345-0@lo:101:mdt00_004.0 Request processed in 531us (7744us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774787.865782:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3652 00000100:00100000:2.0:1785774787.867492:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215488:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774787.867520:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.867534:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774787.867561:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1785774787.867622:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215616:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774787.867674:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.867710:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076600 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.867729:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671215616 00000100:00100000:2.0:1785774787.867735:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671215616 00000100:00100000:2.0:1785774787.867766:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3653 00000100:00100000:2.0:1785774787.867774:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:8627:x1872519671215616:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774787.867847:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:8627:x1872519671215616:12345-0@lo:1000:mdt00_004.0 Request processed in 74us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.867855:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3653 00000100:00100000:2.0:1785774787.867879:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215616:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774787.867916:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215744:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774787.867936:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.867944:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.867954:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671215744 00000100:00100000:2.0:1785774787.867970:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671215744 00000100:00100000:2.0:1785774787.867986:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3654 00000100:00100000:2.0:1785774787.867992:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:8627:x1872519671215744:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774787.868072:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:8627:x1872519671215744:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (134us total) trans 0 rc 1/1 00000100:00100000:2.0:1785774787.868078:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3654 00000100:00100000:2.0:1785774787.868096:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215744:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1785774787.868147:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.868156:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870088:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.870116:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215872:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774787.870272:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.870319:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.870353:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671215872 00000100:00100000:2.0:1785774787.870361:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671215872 00000100:00100000:2.0:1785774787.870402:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3655 00000100:00100000:2.0:1785774787.870409:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:8627:x1872519671215872:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774787.870428:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774787.870452:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea4c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ea45 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870482:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea4c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ea45 expref: 22 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870498:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea4c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea45 expref: 22 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870507:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7604f39000) 00010000:00010000:2.0:1785774787.870510:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774787.870514:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b800, rc 0) 00000100:00100000:2.0:1785774787.870556:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:8627:x1872519671215872:12345-0@lo:101:mdt00_004.0 Request processed in 146us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.870563:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3655 00000100:00100000:2.0:1785774787.870599:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671215872:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774787.870614:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870627:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870663:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870672:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870681:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870703:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870722:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870732:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 4/0,1 mode: --/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870759:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.870775:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 19 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.870787:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671216000:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774787.870855:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.883336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.883762:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671216000:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774787.883803:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.886799:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648472704 00000100:00100000:0.0:1785774787.886813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648472704 00010000:00010000:0.0:1785774787.886859:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 20 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.886902:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1629 00000100:00100000:0.0:1785774787.886913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648472704:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774787.886928:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774787.886935:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 20 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.886949:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 20 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.886980:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09e37d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xab:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bc9f expref: 20 pid: 6530 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.887002:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xab:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:0.0:1785774787.887008:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.887017:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.887025:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.887057:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774787.887121:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648472704:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 209us (3794us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.887150:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1629 00010000:00010000:2.0:1785774787.888648:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.888664:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.888727:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.888733:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.888746:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.888770:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671216128:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774787.888836:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.890493:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.892076:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671216128 00000100:00100000:3.0:1785774787.892089:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671216128 00000100:00100000:0.0:1785774787.892283:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3656 00000100:00100000:0.0:1785774787.892329:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:8627:x1872519671216128:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774787.892382:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774787.892478:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ea61 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.892512:0:7692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 50 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.892522:0:7692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 23 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.892557:0:7692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 50 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.892584:0:7692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 50 pid: 8469 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.892598:0:7692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671216256:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774787.892692:0:7692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.896853:0:7692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7692:1872519671216256:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774787.896890:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 23 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.896903:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:0.0:1785774787.896905:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774787.896909:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 23 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.896917:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 23 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.896924:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3600, rc 0) 00000100:00100000:0.0:1785774787.897014:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:8627:x1872519671216128:12345-0@lo:101:mdt00_004.0 Request processed in 4718us (8177us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.897023:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3656 00000100:00100000:3.0:1785774787.897636:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671216128:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774787.897659:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.897669:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.903868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774787.903976:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648472832 00000100:00100000:0.0:1785774787.903988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648472832 00010000:00010000:0.0:1785774787.904036:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 51 pid: 8469 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.904087:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1630 00000100:00100000:0.0:1785774787.904096:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:2417:x1872519648472832:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774787.904114:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774787.904121:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 51 pid: 8469 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.904134:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 51 pid: 8469 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.904197:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09e3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bcc9 expref: 51 pid: 8469 timeout: 1129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.904216:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:0.0:1785774787.904224:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 22 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.904236:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 22 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.904245:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 22 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.904290:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 22 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774787.904317:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671216384:0@lo:105: 00000100:00100000:0.0:1785774787.904373:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.904412:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f39cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.904534:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671216384 00000100:00100000:2.0:1785774787.904539:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671216384 00000100:00100000:2.0:1785774787.904580:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1785774787.904587:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671216384:12345-0@lo:105: 00010000:00010000:2.0:1785774787.904598:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.904607:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.904614:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.904620:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.904627:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.904633:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.904661:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35ae00) 00000100:00100000:2.0:1785774787.904702:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671216384:12345-0@lo:105: Request processed in 116us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.904709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1785774787.904748:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671216384:0@lo:105: 00010000:00010000:2.0:1785774787.904766:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774787.904803:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:2417:x1872519648472832:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 709us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.904809:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1630 00010000:00010000:3.0:1785774787.904894:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.904905:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774787.905427:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].402, 888 off602440 00000040:00080000:3.0:1785774787.905611:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].401, 968 off648696 00000004:00080000:3.0:1785774787.905617:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b77011caf00 with version 764 00000004:00080000:2.0:1785774787.905850:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 764 rpc_version 764 00000020:00100000:2.0:1785774787.905880:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774787.905888:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b39f80 x1872519671216640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2208/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774787.905905:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671216640:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774787.905946:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.905979:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7711076600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774787.906598:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671216640 00000100:00100000:3.0:1785774787.906606:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671216640 00000100:00100000:3.0:1785774787.906645:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3657 00000100:00100000:3.0:1785774787.906652:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:7474:x1872519671216640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774787.906929:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:7474:x1872519671216640:12345-0@lo:1000:osp_up0-1.0 Request processed in 277us (981us total) trans 4294983552 rc 0/0 00000100:00100000:3.0:1785774787.906937:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3657 00000100:00100000:2.0:1785774787.908588:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671216640:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1785774787.910128:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x14e:0x0]: returning size 4096 00010000:00010000:3.0:1785774787.910224:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.910238:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.910263:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.910270:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774787.910275:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.910983:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911008:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xab:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:3.0:1785774787.911011:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774787.911017:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 2/0,0 mode: --/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911025:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09ea5a lrc: 0/0,0 mode: --/EX res: [0x240000400:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911057:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911066:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911074:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911221:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774787.911234:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xab:0x0] 00010000:00010000:3.0:1785774787.911244:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911252:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911259:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911265:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774787.911268:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911275:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911358:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7604f39d00) 00010000:00010000:3.0:1785774787.911361:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774787.911366:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911372:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ea53 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911389:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911397:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.911404:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.914107:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774787.914123:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.914135:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774787.914143:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774787.914170:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.914227:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.914235:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774787.914278:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.916065:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671216768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.916149:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774787.916335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671216768 00000100:00100000:0.0:1785774787.916346:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671216768 00000100:00100000:0.0:1785774787.916410:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1785774787.916420:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+24:3656:x1872519671216768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774787.916436:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774787.916462:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ea68 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ea61 expref: 24 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774787.916481:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xab:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:0.0:1785774787.916494:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774787.916530:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3656:x1872519671216768:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774787.916537:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1785774787.916669:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671216768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.916769:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35ae00/0x7b7109e1d09ea61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea68 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.916786:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774787.916791:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.916797:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774787.916803:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774787.916809:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.916834:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 4/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.916840:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774787.916869:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 3/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.916877:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774787.916879:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774787.916882:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774787.916931:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671216896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.916968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774787.917126:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671216896 00000100:00100000:2.0:1785774787.917131:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671216896 00000100:00100000:2.0:1785774787.917188:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1785774787.917196:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734580450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+23:3653:x1872519671216896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774787.917205:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774787.917217:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea4c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ea45 expref: 23 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.917228:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x14e:0x0].0x0 (ffff9b7604f39000) 00010000:00010000:2.0:1785774787.917234:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774787.917275:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734580450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+22:3653:x1872519671216896:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.917378:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1785774787.917439:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671216896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774787.919149:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785774787.919179:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09ea45 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x14e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea4c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774787.919217:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774787.919225:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.919234:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.919241:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.922728:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774787.922743:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.922756:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774787.922763:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774787.922774:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.922823:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.922828:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774787.922859:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.922869:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774787.922871:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774787.922873:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774787.922950:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774787.922995:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671217024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774787.923067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.923270:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671217024 00000100:00100000:1.0:1785774787.923280:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671217024 00000100:00100000:1.0:1785774787.923444:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1785774787.923453:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3653:x1872519671217024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774787.923470:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774787.923492:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09ea30 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ea29 expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.923509:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:1.0:1785774787.923520:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774787.923633:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3653:x1872519671217024:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.923640:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00010000:00010000:3.0:1785774787.923721:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785774787.923729:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09ea29 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea30 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774787.923752:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1785774787.923760:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774787.923768:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.923899:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774787.923941:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:17768:x1872519648472576:12345-192.168.202.31@tcp:36:rm.0 Request processed in 68052us (69376us total) trans 4294968454 rc 0/0 00000100:00100000:3.0:1785774787.923952:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23746 00000100:00100000:2.0:1785774787.925072:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671217024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774787.939780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774787.939856:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648473088 00000100:00100000:0.0:1785774787.939870:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648473088 00000100:00100000:0.0:1785774787.939932:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5075 00000100:00100000:0.0:1785774787.939942:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:17768:x1872519648473088:12345-192.168.202.31@tcp:35:rm.0 00000040:00080000:0.0:1785774787.940562:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].393, 344 off589448 00000040:00080000:0.0:1785774787.940633:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].393, 424 off644168 00000004:00080000:0.0:1785774787.940640:0:6532:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7603f39a80 with version 739 00000004:00080000:1.0:1785774787.940770:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 739 rpc_version 739 00000020:00100000:1.0:1785774787.940805:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774787.940816:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7735945180 x1872519671217280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774787.940841:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735945180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671217280:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774787.940910:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.940944:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774787.942880:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671217280 00000100:00100000:0.0:1785774787.942894:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671217280 00000100:00100000:0.0:1785774787.942972:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3658 00000100:00100000:0.0:1785774787.942984:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+28:7689:x1872519671217280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774787.944124:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+29:7689:x1872519671217280:12345-0@lo:1000:osp_up1-0.0 Request processed in 1141us (3210us total) trans 4294968455 rc 0/0 00000100:00100000:0.0:1785774787.944135:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3658 00000100:00100000:1.0:1785774787.944813:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735945180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671217280:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774787.945536:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:17768:x1872519648473088:12345-192.168.202.31@tcp:35:rm.0 Request processed in 5592us (5767us total) trans 4294983553 rc 0/0 00000100:00100000:0.0:1785774787.945546:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5075 00000100:00100000:0.0:1785774787.957707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774787.957824:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648473344 00000100:00100000:2.0:1785774787.957838:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648473344 00000100:00100000:2.0:1785774787.957912:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23747 00000100:00100000:2.0:1785774787.957925:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:17768:x1872519648473344:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774787.958018:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1785774787.958053:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d089918 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x138f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea022597bd1 expref: 51 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958082:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d08959f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea022597b06 expref: 50 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958098:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d089560 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea022597aea expref: 49 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958111:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138f:0x0].0x0 (ffff9b7605d21e00) 00010000:00010000:2.0:1785774787.958130:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d089544 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea022597ae3 expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958140:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774787.958144:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774787.958244:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958261:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958273:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958532:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958542:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958551:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958650:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958658:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958665:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958688:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958696:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958703:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958744:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958751:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.958764:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774787.958790:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671217408:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774787.959039:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.959127:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671217408 00000100:00100000:1.0:1785774787.959135:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671217408 00000100:00100000:1.0:1785774787.959215:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3659 00000100:00100000:1.0:1785774787.959225:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+29:6529:x1872519671217408:12345-0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774787.959234:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77110769c0 going to sleep for 11 seconds 00010000:00010000:1.0:1785774787.959242:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774787.959261:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09ea92 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ea8b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.959294:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09ea92 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ea8b expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.959315:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09ea92 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ea8b expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774787.959325:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:1.0:1785774787.959328:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774787.959331:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cea00, rc 0) 00000100:00100000:1.0:1785774787.959391:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+30:6529:x1872519671217408:12345-0@lo:101:mdt00_000.0 Request processed in 167us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774787.959399:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3659 00000100:00100000:2.0:1785774787.959535:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671217408:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774787.959562:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774787.959578:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774787.969471:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671217536:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1785774787.969572:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774787.970417:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c600 going to sleep for 11 seconds 00000100:00100000:2.0:1785774787.973077:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671217536 00000100:00100000:2.0:1785774787.973092:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671217536 00000100:00100000:2.0:1785774787.973157:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3660 00000100:00100000:2.0:1785774787.973398:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+30:6529:x1872519671217536:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1785774787.978698:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+30:6529:x1872519671217536:12345-0@lo:403:mdt00_000.0 Request processed in 5292us (9113us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774787.979442:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660 00000100:00100000:1.0:1785774787.982420:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6529:1872519671217536:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1785774787.984908:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].395, 936 off590760 00000040:00080000:1.0:1785774787.988745:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].394, 1016 off645184 00000004:00080000:1.0:1785774787.988760:0:6529:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b760368c600 with version 740 00000004:00080000:3.0:1785774787.992131:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 740 rpc_version 740 00000020:00100000:3.0:1785774787.992396:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774787.992408:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c14e00 x1872519671217792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774787.992437:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671217792:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774787.993026:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774787.993186:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774788.004104:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671217792 00000100:00100000:1.0:1785774788.004124:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671217792 00000100:00100000:1.0:1785774788.004232:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3661 00000100:00100000:1.0:1785774788.004253:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+30:7689:x1872519671217792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774788.004630:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+31:7689:x1872519671217792:12345-0@lo:1000:osp_up1-0.0 Request processed in 388us (11604us total) trans 4294968456 rc 0/0 00000100:00100000:1.0:1785774788.004639:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3661 00000100:00100000:3.0:1785774788.004895:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671217792:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1785774788.005063:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x138f:0x0]: returning size 4096 00010000:00010000:1.0:1785774788.005089:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005100:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005108:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005113:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774788.005118:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005129:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005146:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9b7604f39e00) 00010000:00010000:1.0:1785774788.005149:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774788.005153:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005396:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09ea84 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005426:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005434:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.005439:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006385:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774788.006397:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1785774788.006405:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006411:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006416:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006425:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774788.006429:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006434:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006443:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138f:0x0].0x0 (ffff9b7604f39200) 00010000:00010000:1.0:1785774788.006446:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774788.006448:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006453:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ea7d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006473:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006478:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006484:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006488:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006492:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774788.006494:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006503:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006509:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774788.006511:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774788.006513:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006517:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ea6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774788.006525:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea3d29e5 reply state 0000000028c6e326 transno 4294983554 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006536:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774788.006542:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xca5a1f93 (ffff9b7604f39000) 00010000:00010000:1.0:1785774788.006544:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774788.006546:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774788.006626:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:17768:x1872519648473344:12345-192.168.202.31@tcp:36:rm.0 Request processed in 48703us (48931us total) trans 4294983554 rc 0/0 00000100:00100000:1.0:1785774788.006634:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23747 00010000:00010000:3.0:1785774788.014700:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774788.014718:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774788.014732:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774788.014741:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774788.014751:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774788.014807:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774788.014812:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774788.014849:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774788.014862:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ea8b lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea92 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774788.014884:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774788.014886:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774788.014887:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774788.014974:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671217920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774788.015054:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774788.015516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671217920 00000100:00100000:0.0:1785774788.015525:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671217920 00000100:00100000:0.0:1785774788.015588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1785774788.015597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+31:3655:x1872519671217920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774788.015611:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774788.015633:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cea00/0x7b7109e1d09ea92 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ea8b expref: 31 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774788.015648:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9b7605fcc800) 00010000:00010000:0.0:1785774788.015658:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774788.015701:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+30:3655:x1872519671217920:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774788.015708:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1785774788.015835:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671217920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774788.229064:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774788.229112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774788.229150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774788.229234:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774788.229403:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648473984 00000100:00100000:3.0:1785774788.229417:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648473984 00000100:00100000:3.0:1785774788.229508:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 586 00000100:00100000:3.0:1785774788.229520:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648473984:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774788.229608:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648473984:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774788.229616:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 586 00000100:00080000:3.0:1785774788.229660:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774788.229733:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648473472 00000100:00100000:2.0:1785774788.229738:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648473472 00000100:00100000:2.0:1785774788.229778:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 544 00000100:00100000:2.0:1785774788.229786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648473472:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774788.229814:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648473472:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774788.229820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 544 00000100:00100000:1.0:1785774788.229950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774788.230048:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648473856 00000100:00100000:2.0:1785774788.230052:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648473856 00000100:00100000:2.0:1785774788.230089:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 587 00000100:00100000:2.0:1785774788.230097:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648473856:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774788.230127:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648473856:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774788.230133:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 587 00000100:00100000:2.0:1785774788.230154:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648473728 00000100:00100000:2.0:1785774788.230157:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648473728 00000100:00100000:2.0:1785774788.230207:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648473600 00000100:00100000:2.0:1785774788.230210:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648473600 00000100:00100000:2.0:1785774788.230237:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 978 00000100:00100000:2.0:1785774788.230255:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648473728:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774788.230423:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648473728:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 178us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774788.230429:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 978 00000100:00100000:2.0:1785774788.230444:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 979 00000100:00100000:2.0:1785774788.230449:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:2418:x1872519648473600:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774788.230474:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:2418:x1872519648473600:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774788.230480:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 979 00000100:00080000:1.0:1785774788.230635:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774788.230639:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774788.230641:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785774788.388472:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774788.772375:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774788.772406:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671218048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774788.772507:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774788.772552:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218048 00000100:00100000:3.0:1785774788.772562:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218048 00000100:00100000:3.0:1785774788.772639:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1785774788.772650:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671218048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774788.772689:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1785774788.772727:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774788.772740:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671218048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774788.772748:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1785774788.772756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785774788.772797:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774788.772831:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218176 00000100:00100000:1.0:1785774788.772835:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218176 00000100:00080000:0.0:1785774788.772874:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774788.772879:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1785774788.772886:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671218176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774788.772897:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774788.772929:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671218176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774788.772935:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1785774788.772938:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671218048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774788.772962:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671218176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785774789.413497:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774789.798690:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671218432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774789.798761:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774789.798828:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218432 00000100:00100000:0.0:1785774789.798835:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218432 00000100:00100000:1.0:1785774789.798849:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774789.798859:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671218304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774789.798874:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3662 00000100:00100000:0.0:1785774789.798882:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+30:3655:x1872519671218432:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774789.798890:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1785774789.798918:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445122048 avail 1298882560 00000100:00100000:1.0:1785774789.798949:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218304 00000100:00100000:0.0:1785774789.798958:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+30:3655:x1872519671218432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.798965:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218304 00000100:00100000:0.0:1785774789.798966:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3662 00000100:00080000:0.0:1785774789.798989:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774789.799000:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1785774789.799005:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671218304:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774789.799017:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671218432:0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1785774789.799022:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774789.799052:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671218304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.799059:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1785774789.799087:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671218304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774789.805459:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671218560:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.805525:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774789.805615:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774789.805622:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671218944:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.805648:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774789.805686:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671219072:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.805708:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774789.805759:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774789.805765:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671219456:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.805788:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774789.805820:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671219584:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.805842:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774789.808097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218560 00000100:00100000:2.0:1785774789.808105:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218560 00000100:00100000:2.0:1785774789.808175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1785774789.808184:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671218560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.808208:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671218688:0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808245:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671218560:12345-0@lo:400:kworker.0 Request processed in 63us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774789.808252:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1785774789.808278:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774789.808284:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218944 00000100:00100000:2.0:1785774789.808287:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218944 00000100:00100000:1.0:1785774789.808307:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671219200:0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808321:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219072 00000100:00100000:2.0:1785774789.808324:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219072 00000100:00100000:1.0:1785774789.808329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774789.808339:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671219712:0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808345:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219584 00000100:00100000:2.0:1785774789.808347:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219584 00000100:00100000:2.0:1785774789.808358:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218688 00000100:00100000:1.0:1785774789.808358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774789.808360:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218688 00000100:00100000:2.0:1785774789.808370:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219200 00000100:00100000:1.0:1785774789.808370:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1785774789.808372:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219200 00000100:00100000:1.0:1785774789.808376:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671218816:0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808382:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219712 00000100:00100000:2.0:1785774789.808384:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219712 00000100:00100000:2.0:1785774789.808396:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1785774789.808397:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774789.808401:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671218944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.808413:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671219328:0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808432:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671218944:12345-0@lo:400:kworker.0 Request processed in 30us (2783us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.808434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774789.808438:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1785774789.808449:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671219840:0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808450:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1785774789.808455:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671219072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808478:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671219072:12345-0@lo:400:kworker.0 Request processed in 23us (2769us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.808480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774789.808484:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1785774789.808495:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1785774789.808501:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731e17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671219584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.808506:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1785774789.808512:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671218688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774789.808525:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731e17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671219584:12345-0@lo:400:kworker.0 Request processed in 25us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774789.808532:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1785774789.808540:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671218688:12345-0@lo:400:kworker.0 Request processed in 29us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.808545:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1785774789.808682:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671219584:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.808693:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671219072:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.808703:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671218944:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.808711:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671218560:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.808741:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1785774789.808749:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671219200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.808779:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671219200:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774789.808785:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1785774789.809021:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1785774789.809028:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671219712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809055:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671219712:12345-0@lo:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.809060:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1785774789.809078:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219456 00000100:00100000:1.0:1785774789.809081:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219456 00000100:00100000:1.0:1785774789.809118:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219328 00000100:00100000:1.0:1785774789.809121:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219328 00000100:00100000:1.0:1785774789.809136:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219840 00000100:00100000:1.0:1785774789.809138:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219840 00000100:00100000:1.0:1785774789.809319:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1785774789.809325:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671219456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809356:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671219456:12345-0@lo:400:kworker.0 Request processed in 32us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.809362:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1785774789.809372:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1785774789.809377:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671219328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809397:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671219328:12345-0@lo:400:kworker.0 Request processed in 21us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.809401:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1785774789.809410:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1785774789.809415:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671219840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809435:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671219840:12345-0@lo:400:kworker.0 Request processed in 20us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.809440:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1785774789.809457:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671218816 00000100:00100000:1.0:1785774789.809460:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671218816 00000100:00100000:1.0:1785774789.809543:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3663 00000100:00100000:1.0:1785774789.809549:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:3653:x1872519671218816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1785774789.809572:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774789.809576:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774789.809578:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774789.809690:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:3653:x1872519671218816:12345-0@lo:400:kworker.0 Request processed in 141us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774789.809697:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663 00000100:00100000:1.0:1785774789.809730:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671218816:0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809740:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671219328:0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809748:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671219840:0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809756:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671218688:0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809765:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671219200:0@lo:400:kworker.0 00000100:00100000:1.0:1785774789.809773:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671219712:0@lo:400:kworker.0 00000100:00100000:3.0:1785774789.813300:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671219456:0@lo:400:kworker.0 00000100:00100000:3.0:1785774790.310044:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774790.310068:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671219968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774790.310135:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774790.310348:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671219968 00000100:00100000:0.0:1785774790.310356:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671219968 00000100:00100000:0.0:1785774790.310399:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1785774790.310408:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671219968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774790.310429:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774790.311382:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671219968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 972us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774790.311391:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1785774790.313481:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671219968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774790.323697:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774790.323718:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323764:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323771:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774790.323809:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ea37 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ea3e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323836:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774790.323844:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323859:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323864:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774790.323882:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1e00/0x7b7109e1d09e7b3 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e7ba expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323895:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774790.323902:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323914:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.323919:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774790.323924:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3c00/0x7b7109e1d09e727 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e72e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774790.324084:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671220096:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1785774790.324150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774790.324241:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671220096 00000100:00100000:3.0:1785774790.324249:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671220096 00000100:00100000:3.0:1785774790.324305:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1785774790.324313:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+21:3656:x1872519671220096:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1785774790.324324:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774790.324343:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ea3e lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x51102365 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ea37 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774790.324356:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x51102365 (ffff9b7602507b00) 00010000:00010000:3.0:1785774790.324364:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774790.324393:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+20:3656:x1872519671220096:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774790.324399:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1785774790.324434:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671220096:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1785774790.324619:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e632 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774790.324633:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e632 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.324658:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e632 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774790.324664:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774790.324679:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec3200/0x7b7109e1d09e62b lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e632 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774790.324690:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968456 is committed 00000001:00080000:0.0:1785774790.324700:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968454 is committed 00000020:00080000:0.0:1785774790.324743:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 399 batchid updated 00000100:00100000:3.0:1785774790.324822:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774790.324830:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671220480:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1785774790.324851:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774790.325057:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671220352:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1785774790.325082:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774790.325107:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774790.325113:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671220224:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1785774790.325131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774790.325152:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671220480 00000100:00100000:2.0:1785774790.325155:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671220480 00000100:00100000:2.0:1785774790.325194:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671220352 00000100:00100000:2.0:1785774790.325197:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671220352 00000100:00100000:2.0:1785774790.325212:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671220224 00000100:00100000:2.0:1785774790.325215:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671220224 00000100:00100000:2.0:1785774790.325338:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1785774790.325347:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+22:3656:x1872519671220480:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1785774790.325355:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774790.325367:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09e632 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x2ad0e892 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e62b expref: 22 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774790.325379:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x2ad0e892 (ffff9b7605fccd00) 00010000:00010000:2.0:1785774790.325388:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774790.325416:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+21:3656:x1872519671220480:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 71us (563us total) trans 0 rc 0/0 00000020:00080000:1.0:1785774790.325515:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 399 00000004:00080000:1.0:1785774790.325582:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b760368c000 with version 765 00000020:00080000:1.0:1785774790.325593:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 398 cancel update log [0x200000401:0x3:0x0].396: rc = 0 00000020:00080000:1.0:1785774790.325672:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 398 cancel update log [0x240000400:0x3:0x0].397: rc = 0 00000004:00080000:1.0:1785774790.325690:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b760368c6c0 with version 766 00000020:00080000:1.0:1785774790.325692:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 399 cancel update log [0x200000401:0x3:0x0].397: rc = 0 00000020:00080000:1.0:1785774790.325708:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 399 cancel update log [0x240000400:0x3:0x0].398: rc = 0 00000020:00080000:1.0:1785774790.325713:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 399 00000004:00080000:1.0:1785774790.325721:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 765 rpc_version 765 00000020:00100000:1.0:1785774790.325739:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774790.325746:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb9e680 x1872519671220736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774790.325761:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671220736:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774790.325792:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774790.325807:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774790.334106:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671220736 00000100:00100000:1.0:1785774790.334123:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671220736 00000100:00100000:1.0:1785774790.334208:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3664 00000100:00100000:1.0:1785774790.334218:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:7474:x1872519671220736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774790.334854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1785774790.334864:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+22:3654:x1872519671220352:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1785774790.334881:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774790.334905:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09e72e lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x43f6259d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e727 expref: 22 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774790.334929:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x43f6259d (ffff9b7605dfdd00) 00010000:00010000:3.0:1785774790.335704:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774790.335783:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+21:3654:x1872519671220352:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 920us (10698us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774790.335792:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1785774790.335818:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1785774790.335825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+20:3654:x1872519671220224:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1785774790.335835:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774790.335847:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09e7ba lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x276a6cf1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e7b3 expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774790.335860:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x276a6cf1 (ffff9b7605dfd800) 00010000:00010000:3.0:1785774790.335868:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774790.335890:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+19:3654:x1872519671220224:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 67us (10758us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774790.335897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1785774790.336194:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:7474:x1872519671220736:12345-0@lo:1000:osp_up0-1.0 Request processed in 1978us (10401us total) trans 4294983555 rc 0/0 00000100:00100000:1.0:1785774790.336203:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664 00000100:00100000:2.0:1785774790.336329:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1785774790.337076:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671220224:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1785774790.337093:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671220352:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1785774790.337145:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671220480:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1785774790.338048:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671220736:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1785774790.338063:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 766 rpc_version 766 00000020:00100000:1.0:1785774790.338090:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774790.338098:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb9ce00 x1872519671220992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774790.338119:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671220992:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774790.338199:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774790.338735:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671220992 00000100:00100000:0.0:1785774790.338742:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671220992 00000100:00100000:0.0:1785774790.338790:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3665 00000100:00100000:0.0:1785774790.338800:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:7474:x1872519671220992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774790.338931:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:7474:x1872519671220992:12345-0@lo:1000:osp_up0-1.0 Request processed in 133us (732us total) trans 4294983556 rc 0/0 00000100:00100000:1.0:1785774790.339559:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774790.339598:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671220992:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774790.339760:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3665 00010000:00010000:1.0:1785774790.445313:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774791.334622:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.334648:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.334692:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.334699:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1785774791.334768:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1785774791.336415:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09e9ab lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e9b2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336445:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.336454:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336482:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336489:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774791.336517:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2200/0x7b7109e1d09e957 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e95e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336533:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.336541:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336563:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336568:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774791.336573:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a600/0x7b7109e1d09e90a lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e911 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336587:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.336654:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336671:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.336677:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1785774791.336732:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671221376:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1785774791.336792:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774791.336845:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774791.336849:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671221248:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1785774791.336869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774791.336896:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671221376 00000100:00100000:3.0:1785774791.336902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671221376 00000100:00100000:3.0:1785774791.336944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671221248 00000100:00100000:3.0:1785774791.336947:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671221248 00000100:00100000:3.0:1785774791.336965:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1785774791.336972:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734580c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+14:3654:x1872519671221376:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1785774791.336983:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774791.337001:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09e911 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x61b4f7ef bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e90a expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774791.337013:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x61b4f7ef (ffff9b7605fcc100) 00010000:00010000:3.0:1785774791.337021:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774791.337049:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734580c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+13:3654:x1872519671221376:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 77us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774791.337055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1785774791.337090:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1785774791.337095:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3654:x1872519671221248:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1785774791.337101:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774791.337110:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09e95e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x74437f5b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e957 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774791.337118:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x74437f5b (ffff9b7604f39b00) 00010000:00010000:3.0:1785774791.337123:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774791.337140:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3654:x1872519671221248:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774791.337146:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1785774791.337215:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671221248:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1785774791.337239:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671221376:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.340128:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671221504:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.340213:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774791.340430:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671221120:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.340453:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774791.340539:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671221504 00000100:00100000:3.0:1785774791.340547:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671221504 00000100:00100000:3.0:1785774791.340610:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671221120 00000100:00100000:3.0:1785774791.340613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671221120 00000100:00100000:3.0:1785774791.340639:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1785774791.340646:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3655:x1872519671221504:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1785774791.340659:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774791.340694:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09e8bd lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e8b6 expref: 12 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774791.340712:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x60a2d708 (ffff9b7605dfdb00) 00010000:00010000:3.0:1785774791.340724:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774791.340759:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3655:x1872519671221504:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 113us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774791.340765:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1785774791.340782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1785774791.340788:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3655:x1872519671221120:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1785774791.340796:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774791.340808:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09e9b2 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xcefb0e88 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e9ab expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774791.340818:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xcefb0e88 (ffff9b7602507800) 00010000:00010000:3.0:1785774791.340825:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774791.340846:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3655:x1872519671221120:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 59us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774791.340853:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1785774791.343324:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671221504:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.343339:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671221120:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1785774791.345808:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09e8b6 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x60a2d708 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e8bd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.345840:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.345850:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.345888:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.345898:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1785774791.345953:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671221632:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1785774791.346009:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774791.346087:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671221632 00000100:00100000:1.0:1785774791.346094:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671221632 00000100:00100000:1.0:1785774791.346154:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1785774791.346181:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3656:x1872519671221632:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1785774791.346193:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774791.346211:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09e80e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e807 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774791.346236:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xf404c279 (ffff9b7602507700) 00010000:00010000:1.0:1785774791.346245:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774791.346429:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec2600/0x7b7109e1d09e807 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xf404c279 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e80e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346447:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.346456:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346471:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346476:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774791.346490:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35aa00/0x7b7109e1d09e6d3 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e6da expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346505:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.346513:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346525:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346531:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774791.346535:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7711744200/0x7b7109e1d09e67f lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e686 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346551:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ba00/0x7b7109e1d09e583 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09e58a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774791.346557:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ba00/0x7b7109e1d09e583 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09e58a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346567:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ba00/0x7b7109e1d09e583 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e58a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774791.346571:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1785774791.346621:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671222016:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.346648:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774791.346690:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671221760:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.346709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774791.346724:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774791.346728:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671221888:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.346744:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774791.346761:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222016 00000100:00100000:0.0:1785774791.346764:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222016 00000100:00100000:0.0:1785774791.346782:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671221760 00000100:00100000:0.0:1785774791.346784:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671221760 00000100:00100000:0.0:1785774791.346792:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671221888 00000100:00100000:0.0:1785774791.346794:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671221888 00000100:00100000:0.0:1785774791.346804:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1785774791.346808:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3655:x1872519671222016:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1785774791.346815:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774791.346825:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ef0c00/0x7b7109e1d09e58a lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e583 expref: 11 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.346834:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x2f36419c (ffff9b7605fcce00) 00010000:00010000:0.0:1785774791.346840:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774791.346861:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3655:x1872519671222016:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774791.346868:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1785774791.346881:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1785774791.346886:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3653:x1872519671221760:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1785774791.346892:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774791.346901:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09e6da lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x41f29468 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e6d3 expref: 9 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.346910:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x41f29468 (ffff9b7605dfd200) 00010000:00010000:0.0:1785774791.346916:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774791.346949:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3653:x1872519671221760:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774791.346955:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1785774791.346966:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:0.0:1785774791.346971:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734581050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1872519671221888:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1785774791.346977:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774791.346986:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d09e686 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xad49086a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09e67f expref: 7 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.346994:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xad49086a (ffff9b7602507d00) 00010000:00010000:0.0:1785774791.346999:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774791.347015:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734581050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1872519671221888:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774791.347020:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:0.0:1785774791.347045:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671221888:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.347053:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671221760:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1785774791.347076:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671222016:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1785774791.353766:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671221632:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 7578us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774791.353782:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1785774791.355125:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671221632:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1785774791.355360:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35ba00/0x7b7109e1d09e583 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2f36419c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09e58a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774791.355386:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983556 is committed 00000001:00080000:2.0:1785774791.355451:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983554 is committed 00010000:00010000:0.0:1785774791.364081:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364103:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364112:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364118:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774791.364122:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364130:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364340:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xa20ac6a2 (ffff9b7605fcc500) 00010000:00010000:0.0:1785774791.364345:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774791.364351:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364357:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d09e5ec lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xa20ac6a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364395:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364402:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364409:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364414:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774791.364418:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364424:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364432:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9b7604f39800) 00010000:00010000:0.0:1785774791.364434:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774791.364437:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364443:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09e854 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364457:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364463:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364469:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364473:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774791.364476:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364482:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364488:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x4fa399f7 (ffff9b7605dfd000) 00010000:00010000:0.0:1785774791.364490:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774791.364493:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364499:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09e877 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x4fa399f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364513:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364519:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364524:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364529:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774791.364532:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364538:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364544:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xca5a1f93 (ffff9b7604f39000) 00010000:00010000:0.0:1785774791.364546:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774791.364548:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774791.364554:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ea76 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774791.463685:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774792.484428:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774792.875788:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774792.875818:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671222144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774792.875903:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774792.875992:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222144 00000100:00100000:1.0:1785774792.876003:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222144 00000100:00100000:1.0:1785774792.876062:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666 00000100:00100000:1.0:1785774792.876073:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671222144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774792.876123:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444081664 avail 1297842176 00000100:00100000:1.0:1785774792.876191:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671222144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774792.876199:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666 00000100:00100000:3.0:1785774792.892626:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983556 gen 2 00000004:00080000:3.0:1785774792.892643:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983522 committed transno 4294983556 00000020:00080000:3.0:1785774792.892651:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605cec780 refcount 2 committed 0 result 0 batchid 400 00000020:00080000:3.0:1785774792.892657:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fcb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cec6c0 00000020:00080000:3.0:1785774792.892661:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].398 00000020:00080000:3.0:1785774792.892664:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fc200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604c4f000 00000020:00080000:3.0:1785774792.892667:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].399 00000004:00080000:3.0:1785774792.892733:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983529 committed transno 4294983556 00000020:00080000:3.0:1785774792.892738:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605e4d9c0 refcount 2 committed 0 result 0 batchid 401 00000020:00080000:3.0:1785774792.892742:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347c200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605e4d780 00000020:00080000:3.0:1785774792.892745:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].399 00000020:00080000:3.0:1785774792.892748:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347c900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7715c37400 00000020:00080000:3.0:1785774792.892751:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].400 00000004:00080000:3.0:1785774792.892764:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983530 committed transno 4294983556 00000020:00080000:3.0:1785774792.892768:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605cec900 refcount 2 committed 0 result 0 batchid 402 00000020:00080000:3.0:1785774792.892771:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347c800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cecd80 00000020:00080000:3.0:1785774792.892775:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].400 00000020:00080000:3.0:1785774792.892778:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347c100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7602585000 00000020:00080000:3.0:1785774792.892781:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].401 00000004:00080000:3.0:1785774792.892792:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983552 committed transno 4294983556 00000020:00080000:3.0:1785774792.892796:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b77011ca480 refcount 2 committed 0 result 0 batchid 403 00000020:00080000:3.0:1785774792.892799:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347cd00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77011caf00 00000020:00080000:3.0:1785774792.892802:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].401 00000020:00080000:3.0:1785774792.892804:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347c000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603cd1400 00000020:00080000:3.0:1785774792.892807:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].402 00000004:00080000:3.0:1785774792.892826:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983555 committed transno 4294983556 00000004:00080000:3.0:1785774792.892840:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983556 committed transno 4294983556 00000100:00100000:3.0:1785774792.892867:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671222144:0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1785774792.892901:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 403 committed batchid 399 00000020:00080000:3.0:1785774792.892982:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 399 00000100:00100000:0.0:1785774793.349390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774793.349444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774793.349474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774793.349503:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774793.349526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774793.349554:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648474112 00000100:00100000:0.0:1785774793.349566:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648474112 00000100:00100000:0.0:1785774793.349621:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 546 00000100:00100000:0.0:1785774793.349633:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648474112:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774793.349716:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648474112:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774793.349723:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 546 00000100:00100000:0.0:1785774793.349759:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648474368 00000100:00100000:0.0:1785774793.349763:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648474368 00000100:00100000:0.0:1785774793.349797:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648474240 00000100:00100000:0.0:1785774793.349799:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648474240 00000100:00100000:0.0:1785774793.349819:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 986 00000100:00100000:0.0:1785774793.349825:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648474368:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774793.349855:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648474368:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774793.349860:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 986 00000100:00100000:0.0:1785774793.349871:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 987 00000100:00100000:0.0:1785774793.349876:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648474240:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774793.349894:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648474240:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 19us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774793.349899:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 987 00000100:00100000:3.0:1785774793.351377:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648474624 00000100:00100000:3.0:1785774793.351389:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648474624 00000100:00100000:3.0:1785774793.351446:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648474496 00000100:00100000:3.0:1785774793.351460:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648474496 00000100:00100000:3.0:1785774793.351494:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 591 00000100:00100000:3.0:1785774793.351503:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648474624:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774793.351565:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648474624:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 64us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774793.351573:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 591 00000100:00100000:3.0:1785774793.351590:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 592 00000100:00100000:3.0:1785774793.351596:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648474496:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774793.351712:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648474496:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 114us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774793.351719:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 592 00000100:00080000:3.0:1785774793.355557:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785774793.355569:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774793.355573:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774793.355576:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1785774793.514495:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774793.892677:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774793.892708:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671222272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774793.892801:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774793.893302:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774793.893313:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671222400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774793.893351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774793.893439:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222272 00000100:00100000:3.0:1785774793.893450:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222272 00000100:00100000:3.0:1785774793.893530:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222400 00000100:00100000:3.0:1785774793.893533:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222400 00000100:00100000:3.0:1785774793.893556:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1785774793.893566:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671222272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785774793.893603:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1785774793.893659:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671222272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774793.893667:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1785774793.893687:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1785774793.893694:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671222400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774793.893705:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1785774793.893734:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671222400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774793.893740:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1785774793.893789:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671222400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774793.893822:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671222272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785774793.893884:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785774794.533294:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774794.916555:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671222528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774794.916696:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.916800:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222528 00000100:00100000:1.0:1785774794.916810:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222528 00000100:00100000:1.0:1785774794.916882:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1785774794.916896:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671222528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774794.916944:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774794.917001:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671222528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774794.917009:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1785774794.917070:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671222528:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1785774794.917210:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774794.924369:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774794.924404:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671222656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774794.924497:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774794.924565:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222656 00000100:00100000:2.0:1785774794.924574:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222656 00000100:00100000:2.0:1785774794.924647:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3667 00000100:00100000:2.0:1785774794.924657:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671222656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774794.924701:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445122048 avail 1298882560 00000100:00100000:2.0:1785774794.924750:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671222656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774794.924758:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3667 00000100:00100000:2.0:1785774794.924802:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968456 gen 2 00000004:00080000:2.0:1785774794.924809:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968428 committed transno 4294968456 00000004:00080000:2.0:1785774794.924829:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968429 committed transno 4294968456 00000004:00080000:2.0:1785774794.924840:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968430 committed transno 4294968456 00000004:00080000:2.0:1785774794.924852:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968431 committed transno 4294968456 00000004:00080000:2.0:1785774794.924863:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968432 committed transno 4294968456 00000020:00080000:2.0:1785774794.924869:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605ce46c0 refcount 2 committed 0 result 0 batchid 395 00000020:00080000:2.0:1785774794.924874:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ce4300 00000020:00080000:2.0:1785774794.924878:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].382 00000020:00080000:2.0:1785774794.924881:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7719898400 00000020:00080000:2.0:1785774794.924885:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].382 00000004:00080000:2.0:1785774794.924902:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968433 committed transno 4294968456 00000020:00080000:2.0:1785774794.924905:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605ce4840 refcount 2 committed 0 result 0 batchid 396 00000020:00080000:2.0:1785774794.924908:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ce4000 00000020:00080000:2.0:1785774794.924910:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].383 00000020:00080000:2.0:1785774794.924912:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7709026000 00000020:00080000:2.0:1785774794.924914:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].383 00000004:00080000:2.0:1785774794.924924:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968434 committed transno 4294968456 00000020:00080000:2.0:1785774794.924927:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b77346ff780 refcount 2 committed 0 result 0 batchid 397 00000020:00080000:2.0:1785774794.924930:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77346ffe40 00000020:00080000:2.0:1785774794.924933:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].384 00000020:00080000:2.0:1785774794.924935:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604616400 00000020:00080000:2.0:1785774794.924938:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].384 00000004:00080000:2.0:1785774794.924977:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968438 committed transno 4294968456 00000020:00080000:2.0:1785774794.924983:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605e4d540 refcount 2 committed 0 result 0 batchid 398 00000020:00080000:2.0:1785774794.924986:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347c400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605e4de40 00000020:00080000:2.0:1785774794.924989:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].385 00000020:00080000:2.0:1785774794.924992:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b760347cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603f8f200 00000020:00080000:2.0:1785774794.924994:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].385 00000004:00080000:2.0:1785774794.925020:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968439 committed transno 4294968456 00000020:00080000:2.0:1785774794.925024:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605cec480 refcount 2 committed 0 result 0 batchid 399 00000020:00080000:2.0:1785774794.925027:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fca00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ceca80 00000020:00080000:2.0:1785774794.925030:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].386 00000020:00080000:2.0:1785774794.925033:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fc400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604c4e800 00000020:00080000:2.0:1785774794.925036:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].386 00000004:00080000:2.0:1785774794.925046:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968446 committed transno 4294968456 00000020:00080000:2.0:1785774794.925050:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b77093adc00 refcount 2 committed 0 result 0 batchid 400 00000020:00080000:2.0:1785774794.925052:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fc300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77093ad240 00000020:00080000:2.0:1785774794.925055:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].387 00000020:00080000:2.0:1785774794.925057:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fc500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604c4e200 00000020:00080000:2.0:1785774794.925060:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].387 00000004:00080000:2.0:1785774794.925079:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968447 committed transno 4294968456 00000020:00080000:2.0:1785774794.925083:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605cf8240 refcount 2 committed 0 result 0 batchid 401 00000020:00080000:2.0:1785774794.925086:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cf80c0 00000020:00080000:2.0:1785774794.925089:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].388 00000020:00080000:2.0:1785774794.925091:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b760608d800 00000020:00080000:2.0:1785774794.925094:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].388 00000004:00080000:2.0:1785774794.925114:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968448 committed transno 4294968456 00000020:00080000:2.0:1785774794.925117:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605cf8f00 refcount 2 committed 0 result 0 batchid 402 00000020:00080000:2.0:1785774794.925120:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cf8000 00000020:00080000:2.0:1785774794.925122:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].389 00000020:00080000:2.0:1785774794.925125:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ece400 00000020:00080000:2.0:1785774794.925127:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].389 00000004:00080000:2.0:1785774794.925138:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968449 committed transno 4294968456 00000020:00080000:2.0:1785774794.925141:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605cf8300 refcount 2 committed 0 result 0 batchid 403 00000020:00080000:2.0:1785774794.925144:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cf83c0 00000020:00080000:2.0:1785774794.925146:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].390 00000020:00080000:2.0:1785774794.925148:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604c71700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76061eb600 00000020:00080000:2.0:1785774794.925151:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].390 00000004:00080000:2.0:1785774794.925191:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968450 committed transno 4294968456 00000020:00080000:2.0:1785774794.925195:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605fde300 refcount 2 committed 0 result 0 batchid 404 00000020:00080000:2.0:1785774794.925198:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0ce00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7715f796c0 00000020:00080000:2.0:1785774794.925201:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].391 00000020:00080000:2.0:1785774794.925203:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76061eac00 00000020:00080000:2.0:1785774794.925206:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].391 00000004:00080000:2.0:1785774794.925217:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968451 committed transno 4294968456 00000020:00080000:2.0:1785774794.925220:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7711076d80 refcount 2 committed 0 result 0 batchid 405 00000020:00080000:2.0:1785774794.925222:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7602557c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77110760c0 00000020:00080000:2.0:1785774794.925225:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].392 00000020:00080000:2.0:1785774794.925226:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76060fcc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604760c00 00000020:00080000:2.0:1785774794.925229:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].392 00000004:00080000:2.0:1785774794.925260:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968455 committed transno 4294968456 00000020:00080000:2.0:1785774794.925265:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7603f39900 refcount 2 committed 0 result 0 batchid 406 00000020:00080000:2.0:1785774794.925268:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603f39a80 00000020:00080000:2.0:1785774794.925271:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].393 00000020:00080000:2.0:1785774794.925273:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b760602b400 00000020:00080000:2.0:1785774794.925276:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].393 00000004:00080000:2.0:1785774794.925290:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968456 committed transno 4294968456 00000020:00080000:2.0:1785774794.925294:0:3655:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b760368c9c0 refcount 2 committed 0 result 0 batchid 407 00000020:00080000:2.0:1785774794.925296:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760368c600 00000020:00080000:2.0:1785774794.925299:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].394 00000020:00080000:2.0:1785774794.925301:0:3655:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604ca4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604616a00 00000020:00080000:2.0:1785774794.925304:0:3655:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].395 00000100:00100000:2.0:1785774794.925333:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671222656:0@lo:41:osp-pre-1-0.0 00000020:00080000:2.0:1785774794.925354:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 407 committed batchid 394 00000020:00080000:2.0:1785774794.925438:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 394 00000100:00100000:1.0:1785774794.929470:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774794.929500:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671222784:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.929581:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.929640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222784 00000100:00100000:1.0:1785774794.929650:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222784 00000100:00100000:1.0:1785774794.929700:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1785774794.929709:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671222784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.929758:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671222784:12345-0@lo:400:kworker.0 Request processed in 50us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774794.929765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1785774794.929812:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671222784:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.929840:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671222912:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.929863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.929904:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671222912 00000100:00100000:1.0:1785774794.929907:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671222912 00000100:00100000:1.0:1785774794.929934:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1785774794.929939:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671222912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.929971:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671222912:12345-0@lo:400:kworker.0 Request processed in 32us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774794.929977:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1785774794.930001:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671222912:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930039:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774794.930044:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671223296:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930064:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.930093:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671223424:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930111:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.930148:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774794.930153:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671223808:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930210:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.930258:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671223936:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930282:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.930304:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223296 00000100:00100000:1.0:1785774794.930307:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223296 00000100:00100000:1.0:1785774794.930333:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223424 00000100:00100000:1.0:1785774794.930336:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223424 00000100:00100000:1.0:1785774794.930349:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223808 00000100:00100000:1.0:1785774794.930352:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223808 00000100:00100000:1.0:1785774794.930364:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223936 00000100:00100000:1.0:1785774794.930366:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223936 00000100:00100000:1.0:1785774794.930380:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1785774794.930385:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671223296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930415:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671223296:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774794.930421:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1785774794.930433:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1785774794.930439:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671223424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930443:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1785774794.930452:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671223808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930463:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671223424:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774794.930469:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1785774794.930480:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1785774794.930483:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671223808:12345-0@lo:400:kworker.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774794.930485:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671223936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930490:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1785774794.930510:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671223936:12345-0@lo:400:kworker.0 Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774794.930515:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671223168:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930516:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1785774794.930537:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671223936:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930542:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774794.930547:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671223808:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930556:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671223680:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930557:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671223424:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.930565:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671223296:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930579:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774794.930596:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1785774794.930600:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671223040:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930641:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774794.930666:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671223552:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930688:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774794.930706:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671224064:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930726:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774794.930749:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223168 00000100:00100000:0.0:1785774794.930752:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223168 00000100:00100000:0.0:1785774794.930776:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1785774794.930782:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671223168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930813:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671223168:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774794.930819:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1785774794.930840:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223680 00000100:00100000:0.0:1785774794.930844:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223680 00000100:00100000:0.0:1785774794.930868:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223552 00000100:00100000:0.0:1785774794.930872:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223552 00000100:00100000:0.0:1785774794.930890:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671224064 00000100:00100000:0.0:1785774794.930893:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671224064 00000100:00100000:0.0:1785774794.930918:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1785774794.930924:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671223680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.930957:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671223680:12345-0@lo:400:kworker.0 Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774794.930964:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1785774794.930975:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1785774794.930980:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671223552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.931005:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671223552:12345-0@lo:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774794.931011:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1785774794.931022:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1785774794.931027:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671224064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.931049:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671224064:12345-0@lo:400:kworker.0 Request processed in 22us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774794.931055:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1785774794.931090:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671223552:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.931098:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671224064:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.931106:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671223168:0@lo:400:kworker.0 00000100:00100000:0.0:1785774794.931114:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671223680:0@lo:400:kworker.0 00000100:00080000:2.0:1785774794.931329:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774794.931336:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774794.931338:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774794.933002:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671223040 00000100:00100000:1.0:1785774794.933012:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671223040 00000100:00100000:1.0:1785774794.933078:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3668 00000100:00100000:1.0:1785774794.933087:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671223040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.933180:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671223040:12345-0@lo:400:kworker.0 Request processed in 72us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774794.933745:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671223040:0@lo:400:kworker.0 00000100:00100000:1.0:1785774794.934303:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3668 00000100:00100000:0.0:1785774795.431036:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671224192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774795.431143:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774795.431279:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671224192 00000100:00100000:0.0:1785774795.431289:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671224192 00000100:00100000:0.0:1785774795.431522:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1785774795.431533:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671224192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774795.431564:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774795.431611:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671224192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774795.431618:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1785774795.431687:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671224192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785774795.575925:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1785774795.944895:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 403 batchid updated 00000020:00080000:3.0:1785774795.944956:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 403 00000004:00080000:3.0:1785774795.945053:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b77110760c0 with version 767 00000020:00080000:3.0:1785774795.945072:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 400 cancel update log [0x200000401:0x3:0x0].398: rc = 0 00000020:00080000:3.0:1785774795.945207:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 400 cancel update log [0x240000400:0x3:0x0].399: rc = 0 00000004:00080000:3.0:1785774795.945241:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7711076780 with version 768 00000020:00080000:3.0:1785774795.945245:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 401 cancel update log [0x200000401:0x3:0x0].399: rc = 0 00000020:00080000:3.0:1785774795.945263:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 401 cancel update log [0x240000400:0x3:0x0].400: rc = 0 00000004:00080000:3.0:1785774795.945279:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7711076540 with version 769 00000020:00080000:3.0:1785774795.945282:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 402 cancel update log [0x200000401:0x3:0x0].400: rc = 0 00000020:00080000:3.0:1785774795.945295:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 402 cancel update log [0x240000400:0x3:0x0].401: rc = 0 00000004:00080000:3.0:1785774795.945308:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605e4d9c0 with version 770 00000020:00080000:3.0:1785774795.945310:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 403 cancel update log [0x200000401:0x3:0x0].401: rc = 0 00000020:00080000:3.0:1785774795.945323:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 403 cancel update log [0x240000400:0x3:0x0].402: rc = 0 00000020:00080000:3.0:1785774795.945327:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 403 00000004:00080000:1.0:1785774795.945500:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 767 rpc_version 767 00000020:00100000:1.0:1785774795.945542:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774795.945555:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603d79500 x1872519671224448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774795.945584:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671224448:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774795.945674:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774795.945745:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774795.945814:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671224448 00000100:00100000:2.0:1785774795.945825:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671224448 00000100:00100000:2.0:1785774795.945897:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669 00000100:00100000:2.0:1785774795.945909:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7474:x1872519671224448:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774795.946087:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671224448:12345-0@lo:1000:osp_up0-1.0 Request processed in 179us (411us total) trans 4294983557 rc 0/0 00000100:00100000:2.0:1785774795.946108:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669 00000100:00100000:2.0:1785774795.946198:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671224448:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1785774795.946211:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 768 rpc_version 768 00000020:00100000:2.0:1785774795.946224:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774795.946238:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b38380 x1872519671224704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774795.946253:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671224704:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774795.946284:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774795.946300:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0240 going to sleep for 11 seconds 00000100:00100000:2.0:1785774795.946315:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671224704 00000100:00100000:2.0:1785774795.946319:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671224704 00000100:00100000:2.0:1785774795.946347:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:2.0:1785774795.946354:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671224704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774795.946433:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:7474:x1872519671224704:12345-0@lo:1000:osp_up0-1.0 Request processed in 80us (149us total) trans 4294983558 rc 0/0 00000100:00100000:2.0:1785774795.946440:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00100000:2.0:1785774795.946473:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671224704:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1785774795.946480:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 769 rpc_version 769 00000020:00100000:2.0:1785774795.946489:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774795.946494:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b39180 x1872519671224960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774795.946506:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671224960:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774795.946532:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774795.946545:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0240 going to sleep for 11 seconds 00000100:00100000:2.0:1785774795.946556:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671224960 00000100:00100000:2.0:1785774795.946559:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671224960 00000100:00100000:2.0:1785774795.946579:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:2.0:1785774795.946585:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:7474:x1872519671224960:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774795.946653:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:7474:x1872519671224960:12345-0@lo:1000:osp_up0-1.0 Request processed in 67us (119us total) trans 4294983559 rc 0/0 00000100:00100000:2.0:1785774795.946660:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00100000:2.0:1785774795.946689:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671224960:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1785774795.946696:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 770 rpc_version 770 00000020:00100000:2.0:1785774795.946707:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774795.946712:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b39500 x1872519671225216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774795.946724:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671225216:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774795.946748:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774795.946760:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0240 going to sleep for 11 seconds 00000100:00100000:2.0:1785774795.946770:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671225216 00000100:00100000:2.0:1785774795.946773:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671225216 00000100:00100000:2.0:1785774795.946793:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672 00000100:00100000:2.0:1785774795.946797:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:7474:x1872519671225216:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774795.946860:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:7474:x1872519671225216:12345-0@lo:1000:osp_up0-1.0 Request processed in 62us (110us total) trans 4294983560 rc 0/0 00000100:00100000:2.0:1785774795.946866:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672 00000100:00100000:2.0:1785774795.946890:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671225216:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1785774796.580468:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774797.607212:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774797.988444:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774797.988467:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671225344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774797.988533:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774797.990430:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671225344 00000100:00100000:2.0:1785774797.990442:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671225344 00000100:00100000:2.0:1785774797.991429:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673 00000100:00100000:2.0:1785774797.991441:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:3654:x1872519671225344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774797.991479:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444081664 avail 1297842176 00000100:00100000:2.0:1785774797.991541:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:3654:x1872519671225344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774797.991551:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673 00000100:00100000:1.0:1785774797.991637:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671225344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774798.475876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774798.475926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774798.475958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774798.475980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774798.476003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774798.476044:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648475136 00000100:00100000:3.0:1785774798.476056:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648475136 00000100:00100000:3.0:1785774798.476127:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648475264 00000100:00100000:3.0:1785774798.476131:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648475264 00000100:00100000:3.0:1785774798.476205:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 596 00000100:00100000:3.0:1785774798.476226:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648475136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774798.476324:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648475136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 102us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774798.476333:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 596 00000100:00100000:3.0:1785774798.476353:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 597 00000100:00100000:3.0:1785774798.476360:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648475264:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774798.476388:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648475264:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774798.476394:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 597 00000100:00080000:3.0:1785774798.476413:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774798.476418:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774798.476510:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648474880 00000100:00100000:1.0:1785774798.476515:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648474880 00000100:00100000:1.0:1785774798.476564:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648475008 00000100:00100000:1.0:1785774798.476568:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648475008 00000100:00100000:1.0:1785774798.476604:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 994 00000100:00100000:1.0:1785774798.476612:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648474880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774798.476647:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648474880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774798.476654:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 994 00000100:00100000:1.0:1785774798.476667:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 995 00000100:00100000:1.0:1785774798.476674:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648475008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774798.476700:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648475008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774798.476705:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 995 00000100:00080000:3.0:1785774798.477154:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1785774798.477175:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774798.477330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648474752 00000100:00100000:2.0:1785774798.477344:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648474752 00000100:00100000:2.0:1785774798.477408:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 548 00000100:00100000:2.0:1785774798.477418:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648474752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774798.477499:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648474752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 83us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774798.477506:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 548 00000001:02000400:2.0:1785774798.623103:0:20946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 12:33:15 (1785774795) 00010000:00010000:1.0:1785774798.630368:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774799.012598:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774799.012641:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671225472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774799.012733:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774799.012820:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671225472 00000100:00100000:3.0:1785774799.012830:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671225472 00000100:00100000:3.0:1785774799.012893:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1785774799.012902:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671225472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774799.012942:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1785774799.013229:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671225472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 327us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774799.013238:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00080000:3.0:1785774799.013262:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774799.013304:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671225472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774799.013486:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774799.013498:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671225600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774799.013546:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774799.013582:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671225600 00000100:00100000:2.0:1785774799.013587:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671225600 00000100:00100000:2.0:1785774799.013617:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1785774799.013623:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671225600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774799.013648:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1785774799.013679:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671225600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774799.013685:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1785774799.013713:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671225600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785774799.014710:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785774799.656935:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774800.036538:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671225728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774800.036621:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774800.036928:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671225728 00000100:00100000:2.0:1785774800.036937:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671225728 00000100:00100000:2.0:1785774800.037007:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00000100:00100000:2.0:1785774800.037016:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671225728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774800.037049:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445122048 avail 1298882560 00000100:00100000:2.0:1785774800.037099:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671225728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774800.037107:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00100000:3.0:1785774800.037222:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671225728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774800.044064:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774800.044086:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671225856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774800.044151:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774800.056073:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671225856 00000100:00100000:3.0:1785774800.056089:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671225856 00000100:00100000:3.0:1785774800.056186:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1785774800.056210:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671225856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1785774800.056242:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774800.056323:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671225856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (12172us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.056330:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1785774800.056408:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671225856:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1785774800.056515:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774800.063935:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671225984:0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.064013:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774800.064080:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671225984 00000100:00100000:3.0:1785774800.064087:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671225984 00000100:00100000:3.0:1785774800.064132:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1785774800.064140:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671225984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.064216:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671225984:12345-0@lo:400:kworker.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.064224:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1785774800.064265:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671225984:0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.068607:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671226112:0@lo:400:kworker.0 00000100:00100000:2.0:1785774800.068630:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671226368:0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.071640:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.071690:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671226624:0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.071727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.071757:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671227136:0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.071778:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.071795:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1785774800.071906:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671226240:0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.071936:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.071956:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671226752:0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.071978:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.071997:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671227264:0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.072018:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.072055:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671226112 00000100:00100000:0.0:1785774800.072063:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671226112 00000100:00100000:0.0:1785774800.072105:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671226624 00000100:00100000:0.0:1785774800.072108:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671226624 00000100:00100000:0.0:1785774800.072132:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671227136 00000100:00100000:0.0:1785774800.072135:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671227136 00000100:00100000:0.0:1785774800.072153:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1785774800.072178:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671226112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.072243:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671226112:12345-0@lo:400:kworker.0 Request processed in 83us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.072251:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1785774800.072270:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1785774800.072275:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671226624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.072302:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671226624:12345-0@lo:400:kworker.0 Request processed in 26us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.072307:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1785774800.072318:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1785774800.072323:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671227136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.072348:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671227136:12345-0@lo:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.072354:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1785774800.072373:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671226240 00000100:00100000:0.0:1785774800.072376:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671226240 00000100:00100000:0.0:1785774800.072400:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:0.0:1785774800.072406:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:3655:x1872519671226240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774800.072435:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:3655:x1872519671226240:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.072440:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:0.0:1785774800.074964:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671226752 00000100:00100000:0.0:1785774800.074975:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671226752 00000100:00100000:0.0:1785774800.077001:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671227264 00000100:00100000:0.0:1785774800.077009:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671227264 00000100:00100000:3.0:1785774800.078619:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671226496:0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.078688:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774800.078719:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671227008:0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.078740:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774800.078782:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671226496 00000100:00100000:3.0:1785774800.078787:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671226496 00000100:00100000:3.0:1785774800.078952:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671227008 00000100:00100000:3.0:1785774800.078956:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671227008 00000100:00100000:3.0:1785774800.078974:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1785774800.078982:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671226496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.079028:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671226496:12345-0@lo:400:kworker.0 Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.079034:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1785774800.079047:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1785774800.079053:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671227008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.079076:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671227008:12345-0@lo:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.079081:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1785774800.079116:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671226496:0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.079126:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671227008:0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.079684:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1785774800.079694:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671226752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.079729:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671226752:12345-0@lo:400:kworker.0 Request processed in 39us (7750us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774800.079735:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1785774800.079747:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1785774800.079753:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671227264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.079775:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671227264:12345-0@lo:400:kworker.0 Request processed in 22us (7756us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774800.079780:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00080000:1.0:1785774800.081975:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774800.081984:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774800.081987:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774800.082028:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671226240:0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.082044:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671226752:0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.082056:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671227264:0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.082067:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671227136:0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.082078:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671226112:0@lo:400:kworker.0 00000100:00100000:1.0:1785774800.082088:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671226624:0@lo:400:kworker.0 00000100:00100000:2.0:1785774800.082341:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774800.082381:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671226880:0@lo:400:kworker.0 00000100:00100000:2.0:1785774800.082420:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774800.082458:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671226880 00000100:00100000:2.0:1785774800.082464:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671226880 00000100:00100000:2.0:1785774800.082507:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1785774800.082515:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671226880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.082533:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671226368 00000100:00100000:3.0:1785774800.082536:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671226368 00000100:00100000:2.0:1785774800.082561:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671226880:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.082562:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1785774800.082567:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671226368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774800.082568:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1785774800.082604:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671226880:0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.082614:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671226368:12345-0@lo:400:kworker.0 Request processed in 47us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774800.082617:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671226368:0@lo:400:kworker.0 00000100:00100000:3.0:1785774800.082620:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1785774800.456533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774800.456604:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648475392 00000100:00100000:1.0:1785774800.456614:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648475392 00000100:00100000:1.0:1785774800.456679:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23748 00000100:00100000:1.0:1785774800.456688:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18360:x1872519648475392:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774800.456709:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774800.456727:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09ea99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.456788:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09eaa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.456803:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09eaa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.456815:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09eaa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774800.456871:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:1.0:1785774800.456876:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1785774800.456897:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09eaa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.456922:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09ea99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be12 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.456940:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09eaa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be12 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.456948:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774800.456951:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774800.456954:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce200, rc 0) 00000100:00100000:1.0:1785774800.457008:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18360:x1872519648475392:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 321us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774800.457015:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23748 00000100:00080000:2.0:1785774800.458012:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774800.461068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.461140:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648475520 00000100:00100000:3.0:1785774800.461149:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648475520 00000100:00100000:3.0:1785774800.461245:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23749 00000100:00100000:3.0:1785774800.461254:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18360:x1872519648475520:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774800.461274:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774800.461293:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eaa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be19 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461349:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461362:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461373:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461387:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461394:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461401:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461454:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461460:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461471:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461478:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461485:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.461490:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461497:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461509:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774800.461512:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.461516:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461523:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461541:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461547:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461554:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461559:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.461563:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461569:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461576:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7602507b00) 00010000:00010000:3.0:1785774800.461578:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.461581:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461587:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461613:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eaa7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be19 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461623:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774800.461625:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.461629:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eaa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be19 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.461638:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1c00, rc 0) 00000100:00100000:3.0:1785774800.461689:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18360:x1872519648475520:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 436us (628us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774800.461697:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23749 00000100:00100000:1.0:1785774800.476475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.476543:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648475776 00000100:00100000:3.0:1785774800.476553:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648475776 00000100:00100000:3.0:1785774800.476607:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23750 00000100:00100000:3.0:1785774800.476616:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18360:x1872519648475776:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1785774800.476674:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774800.476702:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09eaa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be12 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.476717:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774800.476722:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774800.476786:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.476799:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.476810:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.476825:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.476831:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.476929:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:02000000:3.0:1785774800.477887:0:8627:0:(lod_object.c:4389:lod_xattr_set_lmv()) *** cfs_fail_loc=188, val=0*** 00000040:00080000:3.0:1785774800.479733:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].396, 1760 off592520 00000040:00080000:3.0:1785774800.479827:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].395, 1928 off647112 00000004:00080000:3.0:1785774800.479835:0:8627:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605d0e0c0 with version 741 00000004:00080000:3.0:1785774800.479858:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 741 rpc_version 741 00000020:00100000:3.0:1785774800.479890:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774800.479898:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760605f480 x1872519671227520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774800.479922:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671227520:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774800.479983:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774800.480033:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.482353:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671227520 00000100:00100000:0.0:1785774800.482365:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671227520 00000100:00100000:0.0:1785774800.482420:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:0.0:1785774800.482429:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7689:x1872519671227520:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.482635:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671227520:12345-0@lo:1000:osp_up1-0.0 Request processed in 206us (2650us total) trans 4294968457 rc 0/0 00000100:00100000:0.0:1785774800.482643:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:0.0:1785774800.482704:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671227520:0@lo:1000:osp_up1-0.0 00000001:00080000:1.0:1785774800.487616:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983561 is committed 00000001:00080000:1.0:1785774800.487632:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983560 is committed 00000020:00080000:1.0:1785774800.487641:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 407 batchid updated 00000020:00080000:0.0:1785774800.487689:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 407 00000004:00080000:0.0:1785774800.487748:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf8480 with version 742 00000020:00080000:0.0:1785774800.487767:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 395 cancel update log [0x240000401:0x3:0x0].382: rc = 0 00000020:00080000:0.0:1785774800.487850:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 395 cancel update log [0x200000400:0x3:0x0].382: rc = 0 00000004:00080000:0.0:1785774800.487874:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf83c0 with version 743 00000020:00080000:0.0:1785774800.487877:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 396 cancel update log [0x240000401:0x3:0x0].383: rc = 0 00000020:00080000:0.0:1785774800.487897:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 396 cancel update log [0x200000400:0x3:0x0].383: rc = 0 00000004:00080000:0.0:1785774800.487915:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf8900 with version 744 00000020:00080000:0.0:1785774800.487918:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 397 cancel update log [0x240000401:0x3:0x0].384: rc = 0 00000020:00080000:0.0:1785774800.487936:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 397 cancel update log [0x200000400:0x3:0x0].384: rc = 0 00000004:00080000:0.0:1785774800.487955:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf8d80 with version 745 00000020:00080000:0.0:1785774800.487959:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 398 cancel update log [0x240000401:0x3:0x0].385: rc = 0 00000020:00080000:0.0:1785774800.487979:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 398 cancel update log [0x200000400:0x3:0x0].385: rc = 0 00000004:00080000:0.0:1785774800.487998:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b77012edc00 with version 746 00000020:00080000:0.0:1785774800.488001:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 399 cancel update log [0x240000401:0x3:0x0].386: rc = 0 00000020:00080000:0.0:1785774800.488019:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 399 cancel update log [0x200000400:0x3:0x0].386: rc = 0 00000004:00080000:0.0:1785774800.488036:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7606095f00 with version 747 00000020:00080000:0.0:1785774800.488038:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 400 cancel update log [0x240000401:0x3:0x0].387: rc = 0 00000020:00080000:0.0:1785774800.488054:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 400 cancel update log [0x200000400:0x3:0x0].387: rc = 0 00000004:00080000:0.0:1785774800.488071:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7606095180 with version 748 00000020:00080000:0.0:1785774800.488075:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 401 cancel update log [0x240000401:0x3:0x0].388: rc = 0 00000020:00080000:0.0:1785774800.488091:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 401 cancel update log [0x200000400:0x3:0x0].388: rc = 0 00000004:00080000:0.0:1785774800.488108:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7606095000 with version 749 00000020:00080000:0.0:1785774800.488110:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 402 cancel update log [0x240000401:0x3:0x0].389: rc = 0 00000020:00080000:0.0:1785774800.488126:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 402 cancel update log [0x200000400:0x3:0x0].389: rc = 0 00000004:00080000:0.0:1785774800.488144:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7606095e40 with version 750 00000020:00080000:0.0:1785774800.488147:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 403 cancel update log [0x240000401:0x3:0x0].390: rc = 0 00000020:00080000:0.0:1785774800.488200:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 403 cancel update log [0x200000400:0x3:0x0].390: rc = 0 00000004:00080000:0.0:1785774800.488220:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7606095d80 with version 751 00000020:00080000:0.0:1785774800.488223:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 404 cancel update log [0x240000401:0x3:0x0].391: rc = 0 00000020:00080000:0.0:1785774800.488237:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 404 cancel update log [0x200000400:0x3:0x0].391: rc = 0 00000004:00080000:0.0:1785774800.488251:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cf8f00 with version 752 00000020:00080000:0.0:1785774800.488254:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 405 cancel update log [0x240000401:0x3:0x0].392: rc = 0 00000020:00080000:0.0:1785774800.488268:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 405 cancel update log [0x200000400:0x3:0x0].392: rc = 0 00000004:00080000:0.0:1785774800.488295:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605e4d540 with version 753 00000020:00080000:0.0:1785774800.488297:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 406 cancel update log [0x240000401:0x3:0x0].393: rc = 0 00000020:00080000:0.0:1785774800.488314:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 406 cancel update log [0x200000400:0x3:0x0].393: rc = 0 00000004:00080000:0.0:1785774800.488328:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605e4d000 with version 754 00000020:00080000:0.0:1785774800.488331:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 407 cancel update log [0x240000401:0x3:0x0].394: rc = 0 00000020:00080000:0.0:1785774800.488344:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 407 cancel update log [0x200000400:0x3:0x0].395: rc = 0 00000020:00080000:0.0:1785774800.488349:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 407 00000004:00080000:1.0:1785774800.488436:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 742 rpc_version 742 00000020:00100000:1.0:1785774800.488469:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774800.488479:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603d7b480 x1872519671227776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774800.488503:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671227776:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774800.488567:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774800.488616:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.488664:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671227776 00000100:00100000:0.0:1785774800.488671:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671227776 00000100:00100000:0.0:1785774800.488725:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3677 00000100:00100000:0.0:1785774800.488735:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671227776:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.488866:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671227776:12345-0@lo:1000:osp_up1-0.0 Request processed in 132us (297us total) trans 4294968458 rc 0/0 00000100:00100000:0.0:1785774800.488873:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3677 00000100:00100000:0.0:1785774800.488922:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671227776:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.488932:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 743 rpc_version 743 00000020:00100000:0.0:1785774800.488944:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.488949:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d7100 x1872519671228032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.488962:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228032:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.488989:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.489004:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e4d180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.489016:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671228032 00000100:00100000:0.0:1785774800.489019:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671228032 00000100:00100000:0.0:1785774800.489042:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678 00000100:00100000:0.0:1785774800.489048:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671228032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.489120:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671228032:12345-0@lo:1000:osp_up1-0.0 Request processed in 71us (130us total) trans 4294968459 rc 0/0 00000100:00100000:0.0:1785774800.489128:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678 00000100:00100000:0.0:1785774800.489157:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228032:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.489485:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 744 rpc_version 744 00000020:00100000:0.0:1785774800.489498:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.489503:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d5880 x1872519671228288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.489516:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228288:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.489540:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.489566:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:1.0:1785774800.489601:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671228288 00000100:00100000:1.0:1785774800.489606:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671228288 00000100:00100000:1.0:1785774800.489635:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679 00000100:00100000:1.0:1785774800.489642:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671228288:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774800.489725:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671228288:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (183us total) trans 4294968460 rc 0/0 00000100:00100000:1.0:1785774800.489732:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679 00010000:00010000:3.0:1785774800.490497:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490514:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490525:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490543:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490549:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490555:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490581:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490588:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.490596:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774800.490608:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671228416:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774800.490637:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774800.490652:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.491944:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671228416 00000100:00100000:0.0:1785774800.491951:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671228416 00000100:00100000:0.0:1785774800.491993:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3680 00000100:00100000:0.0:1785774800.492002:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8627:x1872519671228416:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774800.492016:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774800.492034:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eadf lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ead8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.492056:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eadf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ead8 expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.492072:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eadf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ead8 expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.492081:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd1:0x0].0x0 (ffff9b7706383100) 00010000:00010000:0.0:1785774800.492085:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774800.492088:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3000, rc 0) 00000100:00100000:0.0:1785774800.492132:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:8627:x1872519671228416:12345-0@lo:101:mdt00_004.0 Request processed in 132us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.492139:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000100:00100000:0.0:1785774800.492218:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228288:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.492231:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 745 rpc_version 745 00000020:00100000:0.0:1785774800.492263:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.492270:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d5180 x1872519671228672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.492287:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228672:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.492316:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.492342:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.492356:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671228672 00000100:00100000:0.0:1785774800.492360:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671228672 00000100:00100000:0.0:1785774800.492383:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:0.0:1785774800.492390:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671228672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.492497:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7689:x1872519671228672:12345-0@lo:1000:osp_up1-0.0 Request processed in 107us (180us total) trans 4294968461 rc 0/0 00000100:00100000:0.0:1785774800.492504:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00000100:00100000:0.0:1785774800.492535:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228672:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.492542:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 746 rpc_version 746 00000020:00100000:0.0:1785774800.492552:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.492558:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d5500 x1872519671228928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.492569:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228928:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.492592:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.492604:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.492615:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671228928 00000100:00100000:0.0:1785774800.492618:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671228928 00000100:00100000:0.0:1785774800.492656:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:0.0:1785774800.492662:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7689:x1872519671228928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.492735:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:7689:x1872519671228928:12345-0@lo:1000:osp_up1-0.0 Request processed in 73us (142us total) trans 4294968462 rc 0/0 00000100:00100000:0.0:1785774800.492741:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00000100:00100000:0.0:1785774800.493937:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671228928:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.493948:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 747 rpc_version 747 00000020:00100000:0.0:1785774800.493964:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.493970:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d7800 x1872519671229184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.493984:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229184:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.494018:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.494045:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.494062:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671229184 00000100:00100000:0.0:1785774800.494067:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671229184 00000100:00100000:0.0:1785774800.494098:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:0.0:1785774800.494104:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7689:x1872519671229184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.494226:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7689:x1872519671229184:12345-0@lo:1000:osp_up1-0.0 Request processed in 121us (207us total) trans 4294968463 rc 0/0 00000100:00100000:0.0:1785774800.494234:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:0.0:1785774800.494270:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229184:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.494277:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 748 rpc_version 748 00000020:00100000:0.0:1785774800.494289:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.494294:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d6d80 x1872519671229440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.494306:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229440:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.494331:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.494350:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.494362:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671229440 00000100:00100000:0.0:1785774800.494366:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671229440 00000100:00100000:0.0:1785774800.494388:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:0.0:1785774800.494394:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7689:x1872519671229440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.494462:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:7689:x1872519671229440:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (130us total) trans 4294968464 rc 0/0 00000100:00100000:0.0:1785774800.494469:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:0.0:1785774800.494500:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229440:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.494506:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 749 rpc_version 749 00000020:00100000:0.0:1785774800.494517:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.494521:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d7480 x1872519671229696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.494533:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229696:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.494559:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.494572:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.494582:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671229696 00000100:00100000:0.0:1785774800.494585:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671229696 00000100:00100000:0.0:1785774800.494605:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:0.0:1785774800.494610:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:7689:x1872519671229696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.494676:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:7689:x1872519671229696:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (115us total) trans 4294968465 rc 0/0 00000100:00100000:0.0:1785774800.494682:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:00100000:0.0:1785774800.494712:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229696:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1785774800.494718:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 750 rpc_version 750 00000020:00100000:0.0:1785774800.494730:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774800.494735:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c1880 x1872519671229952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774800.494747:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229952:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.494770:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.494784:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774800.494795:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671229952 00000100:00100000:0.0:1785774800.494798:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671229952 00000100:00100000:0.0:1785774800.494819:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:0.0:1785774800.494825:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7689:x1872519671229952:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774800.495094:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671228416:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1785774800.495126:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495141:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774800.495183:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b9dd541 reply state 00000000b87a4270 transno 4294983561 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495208:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495217:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507100) 00010000:00010000:3.0:1785774800.495220:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774800.495224:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774800.495231:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495239:0:8627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774800.495250:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xd1:0x0] 00000004:00010000:3.0:1785774800.495256:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b9dd541 reply state 00000000b87a4270 transno 4294983561 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495264:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495274:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9b7602507e00) 00010000:00010000:3.0:1785774800.495277:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774800.495278:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1785774800.495285:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1533:0x0]: returning size 4096 00010000:00010000:3.0:1785774800.495294:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495300:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495305:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495310:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495316:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.495321:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495328:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495338:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774800.495340:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.495344:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495350:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eabc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774800.495366:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b9dd541 reply state 00000000b87a4270 transno 4294983561 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495375:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.495381:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7602507b00) 00010000:00010000:3.0:1785774800.495383:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774800.495385:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00080000:3.0:1785774800.495451:0:8627:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1785774800.495463:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18360:x1872519648475776:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 18847us (18998us total) trans 4294983561 rc 0/0 00000100:00100000:3.0:1785774800.495470:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23750 00010000:00010000:3.0:1785774800.497061:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497073:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497080:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497087:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.497091:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497098:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497109:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7602507b00) 00010000:00010000:3.0:1785774800.497112:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.497116:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497127:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eac3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497147:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497154:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497177:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497182:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.497197:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497204:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497212:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9b7602507e00) 00010000:00010000:3.0:1785774800.497215:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.497218:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497225:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eaca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497236:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497243:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497250:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497256:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.497259:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497265:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497271:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507100) 00010000:00010000:3.0:1785774800.497273:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.497276:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.497282:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ead1 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774800.497752:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:7689:x1872519671229952:12345-0@lo:1000:osp_up1-0.0 Request processed in 2924us (2978us total) trans 4294968466 rc 0/0 00000100:00100000:0.0:1785774800.497762:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00100000:1.0:1785774800.504431:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671229952:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1785774800.504451:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 751 rpc_version 751 00000020:00100000:1.0:1785774800.504478:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774800.504486:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603d78a80 x1872519671230208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774800.504509:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d78a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230208:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774800.504573:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774800.508572:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774800.509096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774800.509954:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648475904 00000100:00100000:1.0:1785774800.509965:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648475904 00000100:00100000:1.0:1785774800.510019:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23751 00000100:00100000:1.0:1785774800.510029:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18204:x1872519648475904:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774800.510064:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774800.510085:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09eae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be20 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.510148:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09eaed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.510182:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09eaed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.510214:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09eaed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774800.510257:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:1.0:1785774800.510261:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1785774800.510280:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09eaed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.510313:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09eae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be20 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.510329:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09eaed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be20 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.510338:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774800.510342:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774800.510345:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfe00, rc 0) 00000100:00100000:1.0:1785774800.510399:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18204:x1872519648475904:12345-192.168.202.31@tcp:101:bash.0 Request processed in 372us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774800.510407:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23751 00000100:00100000:0.0:1785774800.517261:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671230208 00000100:00100000:0.0:1785774800.517275:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671230208 00000100:00100000:0.0:1785774800.517333:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1785774800.517342:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7689:x1872519671230208:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774800.517541:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7689:x1872519671230208:12345-0@lo:1000:osp_up1-0.0 Request processed in 199us (12966us total) trans 4294968467 rc 0/0 00000100:00100000:0.0:1785774800.517549:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:2.0:1785774800.517715:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d78a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230208:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1785774800.517729:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 752 rpc_version 752 00000020:00100000:2.0:1785774800.517751:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774800.517759:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760471c700 x1872519671230464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774800.517780:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230464:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774800.517817:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774800.517870:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774800.517885:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671230464 00000100:00100000:2.0:1785774800.517888:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671230464 00000100:00100000:2.0:1785774800.517913:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1785774800.517919:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7689:x1872519671230464:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774800.517998:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:7689:x1872519671230464:12345-0@lo:1000:osp_up1-0.0 Request processed in 78us (179us total) trans 4294968468 rc 0/0 00000100:00100000:2.0:1785774800.518005:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1785774800.518032:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230464:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1785774800.518038:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 753 rpc_version 753 00000020:00100000:2.0:1785774800.518048:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774800.518053:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760471c380 x1872519671230720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774800.518065:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230720:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774800.518089:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774800.518103:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774800.518112:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671230720 00000100:00100000:2.0:1785774800.518115:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671230720 00000100:00100000:2.0:1785774800.518133:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:2.0:1785774800.518139:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:7689:x1872519671230720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774800.518232:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:7689:x1872519671230720:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (142us total) trans 4294968469 rc 0/0 00000100:00100000:2.0:1785774800.518238:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:2.0:1785774800.518264:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230720:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1785774800.518270:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 754 rpc_version 754 00000020:00100000:2.0:1785774800.518281:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774800.518285:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760471d880 x1872519671230976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774800.518295:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230976:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774800.518314:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774800.518330:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774800.518338:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671230976 00000100:00100000:2.0:1785774800.518341:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671230976 00000100:00100000:2.0:1785774800.518358:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:2.0:1785774800.518363:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+19:7689:x1872519671230976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774800.518426:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+20:7689:x1872519671230976:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (109us total) trans 4294968470 rc 0/0 00000100:00100000:2.0:1785774800.518432:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:2.0:1785774800.518461:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671230976:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774800.520652:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.522955:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648476032 00000100:00100000:3.0:1785774800.522965:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648476032 00000100:00100000:3.0:1785774800.523015:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23752 00000100:00100000:3.0:1785774800.523024:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18204:x1872519648476032:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774800.523042:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774800.523061:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eaf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be27 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523122:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523137:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523149:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523177:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523184:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523202:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523269:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eb09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523277:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523284:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774800.523344:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1533:0x0]: returning size 4096 00000004:00200000:3.0:1785774800.523350:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1785774800.523369:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523381:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523388:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523398:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523404:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523409:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.523413:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523420:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523431:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774800.523892:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.523899:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523906:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eafb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523922:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523927:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523933:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523938:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.523941:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523947:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523955:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7602507b00) 00010000:00010000:3.0:1785774800.523957:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.523960:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523965:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.523993:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eaf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be27 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.524005:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eb09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be27 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.524012:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774800.524015:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1785774800.524017:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0800, rc 0) 00000100:00100000:3.0:1785774800.524110:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18204:x1872519648476032:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1087us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.524117:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23752 00000100:00100000:0.0:1785774800.537866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.539344:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648476160 00000100:00100000:3.0:1785774800.539356:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648476160 00000100:00100000:3.0:1785774800.539420:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23753 00000100:00100000:3.0:1785774800.539430:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18204:x1872519648476160:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774800.539451:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774800.539472:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eb10 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be2e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.539532:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb17 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.539547:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.539560:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774800.539611:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd1:0x0]: returning size 4096 00000004:00200000:3.0:1785774800.539616:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774800.539651:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eb10 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be2e expref: 13 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.539671:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb17 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be2e expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.539680:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:3.0:1785774800.539683:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774800.539687:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774800.539786:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18204:x1872519648476160:12345-192.168.202.31@tcp:101:bash.0 Request processed in 358us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.539794:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23753 00000100:00100000:0.0:1785774800.548343:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671231104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774800.548415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774800.548489:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671231104 00000100:00100000:0.0:1785774800.548497:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671231104 00000100:00100000:0.0:1785774800.548544:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1785774800.548553:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671231104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774800.548576:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774800.548620:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671231104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.548628:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1785774800.548677:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671231104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774800.557526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774800.557790:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648476416 00000100:00100000:1.0:1785774800.557802:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648476416 00000100:00100000:1.0:1785774800.557900:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23754 00000100:00100000:1.0:1785774800.557910:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18204:x1872519648476416:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774800.557930:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774800.557933:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785774800.557957:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09eb17 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be2e expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.557978:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:1.0:1785774800.557987:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774800.558002:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09eb1e lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be35 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558405:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558420:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558431:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558444:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558452:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558459:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774800.558784:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c8:0x0], index 0: 0 00010000:00010000:1.0:1785774800.558939:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09eb33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558949:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09eb33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558962:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09eb33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.558994:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.559001:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.559007:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.559013:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.559020:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774800.559024:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.559031:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.559039:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:1.0:1785774800.559042:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774800.559045:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.560372:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb25 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774800.560396:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5e369f1 reply state 000000001159f941 transno 4294983562 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.560409:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.560417:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774800.560420:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774800.560424:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774800.560460:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09eb1e lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be35 expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.560479:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09eb33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be35 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.560488:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774800.560491:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774800.560493:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774800.560609:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18204:x1872519648476416:12345-192.168.202.31@tcp:101:bash.0 Request processed in 2699us (3092us total) trans 4294983562 rc 0/0 00000100:00100000:1.0:1785774800.560617:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23754 00000100:00100000:3.0:1785774800.580402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774800.580492:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648476544 00000100:00100000:0.0:1785774800.580502:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648476544 00000100:00100000:0.0:1785774800.580570:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5189 00000100:00100000:0.0:1785774800.580579:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18204:x1872519648476544:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774800.580597:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774800.580617:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be3c expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774800.580639:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774800.580660:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=1042s v=(0 0) 00010000:00010000:0.0:1785774800.580665:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774800.580673:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.580689:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.580701:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3400, rc 0) 00000100:00100000:0.0:1785774800.580755:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18204:x1872519648476544:12345-192.168.202.31@tcp:101:bash.0 Request processed in 177us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.580762:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5189 00000100:00080000:1.0:1785774800.580930:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774800.594332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.594558:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648476800 00000100:00100000:3.0:1785774800.594567:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648476800 00000100:00100000:3.0:1785774800.594617:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5076 00000100:00100000:3.0:1785774800.594627:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18204:x1872519648476800:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774800.594887:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18204:x1872519648476800:12345-192.168.202.31@tcp:35:bash.0 Request processed in 260us (561us total) trans 4294983563 rc 0/0 00000100:00100000:3.0:1785774800.594895:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5076 00000100:00100000:0.0:1785774800.616783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.616847:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648477056 00000100:00100000:3.0:1785774800.616857:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648477056 00000100:00100000:3.0:1785774800.616915:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23755 00000100:00100000:3.0:1785774800.616925:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18204:x1872519648477056:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774800.616949:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774800.616970:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eb48 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be43 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617071:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617085:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617096:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617108:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617116:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617126:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774800.617477:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c8:0x0], index 1: 0 00010000:00010000:3.0:1785774800.617605:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eb5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617614:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617621:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617650:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617657:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617663:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617669:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617674:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.617679:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617686:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617701:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507800) 00010000:00010000:3.0:1785774800.617704:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.617708:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617713:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09eb4f lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774800.617732:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df43f2b9 reply state 00000000aff03421 transno 4294983564 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617743:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617749:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7602507300) 00010000:00010000:3.0:1785774800.617752:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774800.617754:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774800.617777:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09eb48 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be43 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617796:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eb5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be43 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.617804:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9b7602507100) 00010000:00010000:3.0:1785774800.617806:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774800.617808:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774800.617875:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18204:x1872519648477056:12345-192.168.202.31@tcp:101:bash.0 Request processed in 951us (1099us total) trans 4294983564 rc 0/0 00000100:00100000:3.0:1785774800.617883:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23755 00000100:00100000:2.0:1785774800.627356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.627469:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648477184 00000100:00100000:3.0:1785774800.627478:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648477184 00000100:00100000:3.0:1785774800.627549:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5190 00000100:00100000:3.0:1785774800.627560:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:18204:x1872519648477184:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774800.627578:0:14719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774800.627600:0:14719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be4a expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774800.627625:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774800.627647:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=1042s v=(0 0) 00010000:00010000:3.0:1785774800.627651:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774800.627661:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 7 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.627679:0:14719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 7 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.627692:0:14719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:3.0:1785774800.627745:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18204:x1872519648477184:12345-192.168.202.31@tcp:101:bash.0 Request processed in 186us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.627752:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5190 00000100:00080000:2.0:1785774800.628075:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774800.636894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774800.637006:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648477440 00000100:00100000:1.0:1785774800.637016:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648477440 00000100:00100000:1.0:1785774800.637081:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5077 00000100:00100000:1.0:1785774800.637091:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18204:x1872519648477440:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774800.637404:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18204:x1872519648477440:12345-192.168.202.31@tcp:35:bash.0 Request processed in 314us (521us total) trans 4294983565 rc 0/0 00000100:00100000:1.0:1785774800.637413:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5077 00000100:00100000:0.0:1785774800.680826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774800.680869:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648477696 00000100:00100000:0.0:1785774800.680877:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648477696 00000100:00100000:0.0:1785774800.680926:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23756 00000100:00100000:0.0:1785774800.680935:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18204:x1872519648477696:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774800.680960:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774800.680981:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09eb72 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be51 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682208:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682227:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682240:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682256:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682263:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682270:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774800.682581:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c9:0x0], index 0: 0 00010000:00010000:0.0:1785774800.682726:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09eb87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682739:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09eb87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682746:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09eb87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682778:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682785:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682791:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682798:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682804:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774800.682808:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682815:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.682826:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774800.682828:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774800.682833:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.683218:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774800.684734:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09eb79 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774800.684752:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d3e8b6e reply state 00000000150cafa7 transno 4294983566 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.684766:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.684775:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7702bc0700) 00010000:00010000:0.0:1785774800.684777:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774800.684781:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774800.684823:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09eb72 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be51 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.684858:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09eb87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be51 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.684868:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774800.684871:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774800.684873:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2000, rc 0) 00000100:00100000:0.0:1785774800.684941:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18204:x1872519648477696:12345-192.168.202.31@tcp:101:bash.0 Request processed in 4007us (4123us total) trans 4294983566 rc 0/0 00000100:00100000:0.0:1785774800.684951:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23756 00000100:00100000:2.0:1785774800.718043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774800.718377:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648477824 00000100:00100000:0.0:1785774800.718387:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648477824 00000100:00100000:0.0:1785774800.718433:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5191 00000100:00100000:0.0:1785774800.718442:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18204:x1872519648477824:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774800.718462:0:14730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774800.718482:0:14730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be58 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774800.718508:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774800.718529:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=1042s v=(0 0) 00010000:00010000:0.0:1785774800.718534:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774800.718542:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 9 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.718559:0:14730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 9 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774800.718572:0:14730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2400, rc 0) 00000100:00100000:0.0:1785774800.718621:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18204:x1872519648477824:12345-192.168.202.31@tcp:101:bash.0 Request processed in 179us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774800.718628:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5191 00000100:00100000:0.0:1785774800.728834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.728903:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648478080 00000100:00100000:2.0:1785774800.728915:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648478080 00000100:00100000:2.0:1785774800.728972:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5078 00000100:00100000:2.0:1785774800.728982:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732247450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18204:x1872519648478080:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774800.729322:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732247450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18204:x1872519648478080:12345-192.168.202.31@tcp:35:bash.0 Request processed in 340us (495us total) trans 4294983567 rc 0/0 00000100:00100000:2.0:1785774800.729332:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5078 00000100:00100000:0.0:1785774800.740384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774800.740567:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648478336 00000100:00100000:1.0:1785774800.740577:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648478336 00000100:00100000:1.0:1785774800.740637:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23757 00000100:00100000:1.0:1785774800.740647:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18204:x1872519648478336:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774800.740671:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774800.740693:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb9c lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be5f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.740796:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.740809:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.740819:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.740831:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.740849:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.740856:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774800.741196:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c9:0x0], index 1: 0 00010000:00010000:1.0:1785774800.741329:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09ebb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741339:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09ebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741347:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09ebb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741383:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741391:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741397:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741403:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741410:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774800.741415:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741422:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741433:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:1.0:1785774800.741436:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774800.741440:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741447:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09eba3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774800.741459:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042ca5390 reply state 0000000063182c32 transno 4294983568 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741472:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741478:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7605fd8e00) 00010000:00010000:1.0:1785774800.741480:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774800.741482:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774800.741507:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09eb9c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be5f expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741526:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09ebb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be5f expref: 25 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.741533:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:1.0:1785774800.741535:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774800.741538:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cee00, rc 0) 00000100:00100000:1.0:1785774800.741596:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:18204:x1872519648478336:12345-192.168.202.31@tcp:101:bash.0 Request processed in 950us (1221us total) trans 4294983568 rc 0/0 00000100:00100000:1.0:1785774800.741603:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23757 00000100:00100000:3.0:1785774800.749364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.749620:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648478464 00000100:00100000:2.0:1785774800.749632:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648478464 00000100:00100000:2.0:1785774800.749694:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5192 00000100:00100000:2.0:1785774800.749703:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18204:x1872519648478464:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774800.749723:0:14712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774800.749745:0:14712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be66 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774800.749770:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774800.749793:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=1042s v=(0 0) 00010000:00010000:2.0:1785774800.749798:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774800.749808:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 8 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.749825:0:14712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 8 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.749849:0:14712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b200, rc 0) 00000100:00100000:2.0:1785774800.749909:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18204:x1872519648478464:12345-192.168.202.31@tcp:101:bash.0 Request processed in 206us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774800.749917:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5192 00000100:00100000:0.0:1785774800.763862:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.763914:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648478720 00000100:00100000:3.0:1785774800.763924:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648478720 00000100:00100000:3.0:1785774800.763983:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5079 00000100:00100000:3.0:1785774800.763993:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:18204:x1872519648478720:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774800.764338:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18204:x1872519648478720:12345-192.168.202.31@tcp:35:bash.0 Request processed in 346us (484us total) trans 4294983569 rc 0/0 00000100:00100000:3.0:1785774800.764346:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5079 00000100:00100000:0.0:1785774800.783436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.783553:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648478976 00000100:00100000:3.0:1785774800.783563:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648478976 00000100:00100000:3.0:1785774800.783619:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23758 00000100:00100000:3.0:1785774800.783629:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18204:x1872519648478976:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774800.783652:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774800.783673:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09ebc6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be6d expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.783766:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.783780:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.783792:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.783805:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.783812:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.783818:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774800.784107:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ca:0x0], index 0: 0 00010000:00010000:3.0:1785774800.784293:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ebdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784303:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784311:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784339:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784346:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784352:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784371:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784376:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774800.784380:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784387:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784399:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507800) 00010000:00010000:3.0:1785774800.784402:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774800.784406:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784417:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09ebcd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774800.784434:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e0c840f reply state 00000000dadd9350 transno 4294983570 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784445:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784452:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7602507f00) 00010000:00010000:3.0:1785774800.784454:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774800.784457:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774800.784479:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09ebc6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be6d expref: 30 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784496:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be6d expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.784504:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9b7602507200) 00010000:00010000:3.0:1785774800.784507:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774800.784509:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774800.784558:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648478976:12345-192.168.202.31@tcp:101:bash.0 Request processed in 931us (1133us total) trans 4294983570 rc 0/0 00000100:00100000:3.0:1785774800.784566:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23758 00000100:00100000:0.0:1785774800.793862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774800.793946:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648479104 00000100:00100000:1.0:1785774800.793956:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648479104 00000100:00100000:1.0:1785774800.794016:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5193 00000100:00100000:1.0:1785774800.794026:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18204:x1872519648479104:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774800.794043:0:14729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774800.794077:0:14729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be74 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774800.794102:0:14729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774800.794124:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=1042s v=(0 0) 00010000:00010000:1.0:1785774800.794129:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774800.794138:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 10 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.794155:0:14729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 10 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774800.794620:0:14729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774800.794680:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18204:x1872519648479104:12345-192.168.202.31@tcp:101:bash.0 Request processed in 655us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774800.794689:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5193 00000100:00100000:1.0:1785774800.801538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.801631:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648479360 00000100:00100000:2.0:1785774800.801641:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648479360 00000100:00100000:2.0:1785774800.801695:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5080 00000100:00100000:2.0:1785774800.801705:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648479360:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774800.801999:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:18204:x1872519648479360:12345-192.168.202.31@tcp:35:bash.0 Request processed in 294us (470us total) trans 4294983571 rc 0/0 00000100:00100000:2.0:1785774800.802006:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5080 00000100:00100000:0.0:1785774800.811981:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.812066:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648479616 00000100:00100000:3.0:1785774800.812076:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648479616 00000100:00100000:3.0:1785774800.812132:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23759 00000100:00100000:3.0:1785774800.812141:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:18204:x1872519648479616:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774800.812590:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774800.812622:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ebf0 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be7b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.812735:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.812749:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.812761:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.812775:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.812782:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.812788:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774800.813118:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ca:0x0], index 1: 0 00010000:00010000:2.0:1785774800.813412:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ec05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813423:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813432:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813462:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813470:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813477:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813484:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813490:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774800.813494:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813502:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813513:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcbc00) 00010000:00010000:2.0:1785774800.813516:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774800.813520:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813527:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ebf7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774800.813539:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dbce500f reply state 00000000ab362c9a transno 4294983572 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813550:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813557:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7605fcbf00) 00010000:00010000:2.0:1785774800.813559:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774800.813562:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774800.813586:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ebf0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be7b expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813604:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ec05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be7b expref: 33 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.813612:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:2.0:1785774800.813615:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774800.813617:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ac00, rc 0) 00000100:00100000:2.0:1785774800.813728:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:18204:x1872519648479616:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1587us (1755us total) trans 4294983572 rc 0/0 00000100:00100000:2.0:1785774800.813736:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23759 00000100:00100000:0.0:1785774800.833108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.833213:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648479744 00000100:00100000:2.0:1785774800.833223:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648479744 00000100:00100000:2.0:1785774800.833282:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5194 00000100:00100000:2.0:1785774800.833292:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18204:x1872519648479744:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774800.833311:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774800.833332:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be82 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774800.833358:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774800.833382:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=1042s v=(0 0) 00010000:00010000:2.0:1785774800.833388:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774800.833397:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.833413:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.833425:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35be00, rc 0) 00000100:00100000:2.0:1785774800.833488:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18204:x1872519648479744:12345-192.168.202.31@tcp:101:bash.0 Request processed in 197us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774800.833495:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5194 00000100:00100000:0.0:1785774800.847472:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.850468:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648480000 00000100:00100000:2.0:1785774800.850480:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648480000 00000100:00100000:2.0:1785774800.850587:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5081 00000100:00100000:2.0:1785774800.850598:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:18204:x1872519648480000:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774800.850874:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:18204:x1872519648480000:12345-192.168.202.31@tcp:35:bash.0 Request processed in 278us (3410us total) trans 4294983573 rc 0/0 00000100:00100000:2.0:1785774800.850883:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5081 00000100:00100000:1.0:1785774800.881620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.881697:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648480256 00000100:00100000:3.0:1785774800.881707:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648480256 00000100:00100000:3.0:1785774800.881764:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23760 00000100:00100000:3.0:1785774800.881773:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:18361:x1872519648480256:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774800.881796:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774800.881816:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09ec1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be89 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774800.881986:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1533:0x0]: returning size 4096 00010000:00010000:3.0:1785774800.882082:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09ec1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be89 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.882097:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774800.882100:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774800.882105:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09ec1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be89 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.882126:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774800.882254:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:18361:x1872519648480256:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 481us (643us total) trans 4294983574 rc 301/301 00000100:00100000:3.0:1785774800.882261:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23760 00000100:00100000:0.0:1785774800.888574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.888649:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648480384 00000100:00100000:3.0:1785774800.888658:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648480384 00000100:00100000:3.0:1785774800.888712:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5082 00000100:00100000:3.0:1785774800.888722:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:18361:x1872519648480384:12345-192.168.202.31@tcp:33:lfs.0 00000004:00200000:3.0:1785774800.888855:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1533:0x0]: returning size 4096 00000004:00200000:3.0:1785774800.888861:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1785774800.888935:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:18361:x1872519648480384:12345-192.168.202.31@tcp:33:lfs.0 Request processed in 214us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.888942:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5082 00000100:00100000:1.0:1785774800.900605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.900700:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648480640 00000100:00100000:2.0:1785774800.900710:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648480640 00000100:00100000:2.0:1785774800.900765:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5083 00000100:00100000:2.0:1785774800.900776:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:18361:x1872519648480640:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1785774800.901005:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:18361:x1872519648480640:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 231us (410us total) trans 4294983575 rc 0/0 00000100:00100000:2.0:1785774800.901012:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5083 00000100:00100000:0.0:1785774800.965884:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.967554:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648480896 00000100:00100000:2.0:1785774800.967566:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648480896 00000100:00100000:2.0:1785774800.967635:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23761 00000100:00100000:2.0:1785774800.967645:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:18362:x1872519648480896:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774800.967671:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774800.967693:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ec28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.967870:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.967885:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1533:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.967895:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1533:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774800.967907:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1533:0x0]: returning size 4096 00010000:00010000:2.0:1785774800.968006:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ec28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be90 expref: 40 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.968026:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1533:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be90 expref: 39 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.968035:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9b7602507700) 00010000:00010000:2.0:1785774800.968038:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785774800.968041:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b000, rc 0) 00000100:00100000:2.0:1785774800.968111:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:18362:x1872519648480896:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 467us (2238us total) trans 4294983576 rc 0/0 00000100:00100000:2.0:1785774800.968122:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23761 00000100:00100000:0.0:1785774800.985565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774800.985716:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648481024 00000100:00100000:2.0:1785774800.985726:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648481024 00000100:00100000:2.0:1785774800.985788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1428 00000100:00100000:2.0:1785774800.985798:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:2416:x1872519648481024:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:2.0:1785774800.985816:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774800.985849:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09eaed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be20 expref: 39 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774800.985868:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774800.985873:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774800.985927:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:2416:x1872519648481024:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 131us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774800.985935:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1428 00000100:00100000:0.0:1785774800.988371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774800.989541:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648481280 00000100:00100000:1.0:1785774800.989553:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648481280 00000100:00100000:1.0:1785774800.989610:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5084 00000100:00100000:1.0:1785774800.989620:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732247c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:18362:x1872519648481280:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1785774800.989844:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732247c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:18362:x1872519648481280:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 224us (1478us total) trans 4294983577 rc 0/0 00000100:00100000:1.0:1785774800.989853:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5084 00000100:00100000:1.0:1785774800.996941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774800.997087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648481408 00000100:00100000:3.0:1785774800.997097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648481408 00000100:00100000:3.0:1785774800.997213:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1429 00000100:00100000:3.0:1785774800.997224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:2417:x1872519648481408:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:3.0:1785774800.997239:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1785774800.997264:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1533:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be90 expref: 39 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.997286:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eb09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be27 expref: 38 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774800.997302:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774800.997313:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774800.997361:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:2417:x1872519648481408:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 140us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774800.997368:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1429 00000100:00100000:0.0:1785774801.007939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.008088:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648481664 00000100:00100000:2.0:1785774801.008099:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648481664 00000100:00100000:2.0:1785774801.008221:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 0 00000100:00100000:2.0:1785774801.008232:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:18362:x1872519648481664:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1785774801.008327:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.008338:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.008349:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.008371:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231232:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1785774801.008416:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.008471:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.008666:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671231232 00000100:00100000:0.0:1785774801.008671:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671231232 00000100:00100000:0.0:1785774801.008707:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1785774801.008715:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6542:x1872519671231232:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1785774801.008726:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.008743:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ec44 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ec3d expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.008769:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ec44 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ec3d expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.008783:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ec44 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ec3d expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.008792:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7702bc0600) 00010000:00010000:0.0:1785774801.008796:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.008800:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2800, rc 0) 00000100:00100000:0.0:1785774801.008851:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231232:12345-0@lo:101:mdt_io00_000.0 Request processed in 137us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.008858:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1785774801.008893:0:6542:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983560 gen 2 00000004:00080000:0.0:1785774801.008899:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983557 committed transno 4294983560 00000004:00080000:0.0:1785774801.008915:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983558 committed transno 4294983560 00000004:00080000:0.0:1785774801.008925:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983559 committed transno 4294983560 00000004:00080000:0.0:1785774801.008932:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983560 committed transno 4294983560 00000100:00100000:0.0:1785774801.008945:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231232:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1785774801.008960:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.008971:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774801.008986:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:0.0:1785774801.009003:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1785774801.009033:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231360:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.009058:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.009074:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.009089:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671231360 00000100:00100000:0.0:1785774801.009093:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671231360 00000100:00100000:0.0:1785774801.009115:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:0.0:1785774801.009121:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231360:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.009334:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231360:12345-0@lo:1000:mdt_io00_000.0 Request processed in 212us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.009343:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00100000:0.0:1785774801.009370:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231360:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.009410:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231488:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.009434:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785774801.009639:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774801.009702:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671231488 00000100:00100000:2.0:1785774801.009706:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671231488 00000100:00100000:0.0:1785774801.013365:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.013958:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:2.0:1785774801.013977:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231488:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.014630:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231488:12345-0@lo:1000:mdt_io00_000.0 Request processed in 662us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.014638:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00100000:0.0:1785774801.014722:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231488:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.014794:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231616:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.014830:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.015138:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.015249:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671231616 00000100:00100000:2.0:1785774801.015256:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671231616 00000100:00100000:2.0:1785774801.015297:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:2.0:1785774801.015304:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231616:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.015394:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231616:12345-0@lo:1000:mdt_io00_000.0 Request processed in 91us (563us total) trans 0 rc 1/1 00000100:00100000:2.0:1785774801.015401:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:0.0:1785774801.015911:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231616:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.015971:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231744:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.015994:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.016091:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.019711:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671231744 00000100:00100000:1.0:1785774801.019725:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671231744 00000100:00100000:1.0:1785774801.019845:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:1.0:1785774801.019856:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231744:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.019985:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231744:12345-0@lo:1000:mdt_io00_000.0 Request processed in 130us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.019992:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:3.0:1785774801.020969:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231744:0@lo:1000:mdt_io00_000.0 00010000:00010000:3.0:1785774801.021055:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.021066:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.021076:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.021093:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231872:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785774801.021127:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.021177:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.021286:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671231872 00000100:00100000:2.0:1785774801.021292:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671231872 00000100:00100000:2.0:1785774801.021324:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:2.0:1785774801.021331:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6542:x1872519671231872:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774801.021342:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.021357:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec52 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ec4b expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.021381:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ec4b expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.021402:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ec4b expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.021411:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774801.021414:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.021417:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b000, rc 0) 00000100:00100000:2.0:1785774801.021465:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6542:x1872519671231872:12345-0@lo:101:mdt_io00_000.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.021472:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00100000:3.0:1785774801.022135:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671231872:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774801.022149:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.022197:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.022215:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1785774801.022240:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.022248:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.022255:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.022267:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232000:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785774801.022294:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.022362:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.023955:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232000 00000100:00100000:2.0:1785774801.023965:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232000 00000100:00100000:2.0:1785774801.024011:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:2.0:1785774801.024018:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6542:x1872519671232000:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774801.024033:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.026945:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ec60 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ec59 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.026986:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ec60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ec59 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.027003:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ec60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ec59 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.027011:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7605fcbb00) 00010000:00010000:2.0:1785774801.027014:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.027018:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ae00, rc 0) 00000100:00100000:2.0:1785774801.027277:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:6542:x1872519671232000:12345-0@lo:101:mdt_io00_000.0 Request processed in 3257us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.027286:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00100000:3.0:1785774801.027384:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232000:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774801.027403:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.027421:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.027442:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1785774801.027496:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.027599:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.027610:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.027631:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232128:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785774801.027663:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.027701:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.027747:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232128 00000100:00100000:1.0:1785774801.027754:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232128 00000100:00100000:1.0:1785774801.027799:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:1.0:1785774801.027807:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6542:x1872519671232128:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1785774801.027822:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774801.027846:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09ec6e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ec67 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.027861:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09ec6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ec67 expref: 17 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.027873:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09ec6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ec67 expref: 17 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.027881:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:1.0:1785774801.027884:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1785774801.027887:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00000100:00100000:1.0:1785774801.027924:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232128:12345-0@lo:101:mdt_io00_000.0 Request processed in 118us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.027930:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00100000:2.0:1785774801.028035:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232128:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774801.028045:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.028065:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774801.028077:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1533:0x0] 00000100:00100000:2.0:1785774801.028107:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232256:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.028136:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.028190:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb540 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.028303:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232256 00000100:00100000:1.0:1785774801.028308:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232256 00000100:00100000:1.0:1785774801.028330:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:1.0:1785774801.028335:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232256:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.028404:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232256:12345-0@lo:1000:mdt_io00_000.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.028411:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:2.0:1785774801.028930:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232256:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1785774801.028954:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1533:0x0] 00000100:00100000:2.0:1785774801.028979:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232384:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.029004:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.029031:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb540 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.029119:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232384 00000100:00100000:1.0:1785774801.029124:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232384 00000100:00100000:1.0:1785774801.029156:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:1.0:1785774801.029190:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232384:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.029258:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232384:12345-0@lo:1000:mdt_io00_000.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.029264:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1785774801.029329:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232384:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.030735:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232512:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774801.030781:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.030864:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.032319:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232512 00000100:00100000:0.0:1785774801.032328:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232512 00000100:00100000:0.0:1785774801.032383:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:0.0:1785774801.032392:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232512:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1785774801.034199:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232512:12345-0@lo:403:mdt_io00_000.0 Request processed in 1766us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.034212:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:2.0:1785774801.036731:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232512:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774801.037749:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232640:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.037809:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.037901:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb540 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.039801:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232640 00000100:00100000:1.0:1785774801.039811:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232640 00000100:00100000:1.0:1785774801.039874:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:1.0:1785774801.039883:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232640:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.039994:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232640:12345-0@lo:1000:mdt_io00_000.0 Request processed in 112us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.040001:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1785774801.041665:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232640:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.041751:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232768:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.041797:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.041848:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.042615:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232768 00000100:00100000:0.0:1785774801.042623:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232768 00000100:00100000:0.0:1785774801.042682:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1785774801.042691:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232768:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.042768:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232768:12345-0@lo:1000:mdt_io00_000.0 Request processed in 77us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.042776:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:2.0:1785774801.042966:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232768:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.043988:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232896:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774801.044031:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.044112:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.045517:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671232896 00000100:00100000:3.0:1785774801.045526:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671232896 00000100:00100000:1.0:1785774801.046274:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:1.0:1785774801.046284:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232896:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1785774801.049698:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671232896:12345-0@lo:403:mdt_io00_000.0 Request processed in 3407us (5659us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.049710:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:3.0:1785774801.052985:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671232896:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774801.056972:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233024:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.057039:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.057154:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.058994:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233024 00000100:00100000:1.0:1785774801.059006:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233024 00000100:00100000:1.0:1785774801.059120:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:1.0:1785774801.059131:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233024:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.059308:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233024:12345-0@lo:1000:mdt_io00_000.0 Request processed in 179us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.059316:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:3.0:1785774801.059403:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233024:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.059484:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233152:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.059519:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.066918:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233152 00000100:00100000:2.0:1785774801.066931:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233152 00000100:00100000:2.0:1785774801.066991:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:2.0:1785774801.066999:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233152:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.067107:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233152:12345-0@lo:1000:mdt_io00_000.0 Request processed in 109us (7587us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.067115:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:1.0:1785774801.078815:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.079005:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233152:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.079076:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233280:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.079139:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.079198:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.079253:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233280 00000100:00100000:2.0:1785774801.079260:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233280 00000100:00100000:2.0:1785774801.079310:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:2.0:1785774801.079319:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233280:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.079406:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233280:12345-0@lo:1000:mdt_io00_000.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.079415:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:1.0:1785774801.079522:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233280:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.079559:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233408:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.079580:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.079601:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.079649:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233408 00000100:00100000:2.0:1785774801.079653:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233408 00000100:00100000:2.0:1785774801.079681:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1785774801.079687:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233408:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.079745:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233408:12345-0@lo:1000:mdt_io00_000.0 Request processed in 58us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.079751:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:1.0:1785774801.079904:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233408:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.079934:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233536:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.079956:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.079977:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.080021:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233536 00000100:00100000:2.0:1785774801.080025:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233536 00000100:00100000:2.0:1785774801.080051:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:2.0:1785774801.080057:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233536:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.080148:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233536:12345-0@lo:1000:mdt_io00_000.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.080155:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1785774801.083361:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233536:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.085391:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233664:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774801.085674:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.085778:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.085913:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233664 00000100:00100000:1.0:1785774801.085920:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233664 00000100:00100000:1.0:1785774801.086017:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:1.0:1785774801.086026:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233664:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1785774801.089619:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233664:12345-0@lo:403:mdt_io00_000.0 Request processed in 3587us (4144us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.089633:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1785774801.094010:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233664:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774801.096062:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233792:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.096130:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.096266:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb540 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.098997:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233792 00000100:00100000:1.0:1785774801.099008:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233792 00000100:00100000:2.0:1785774801.099225:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1785774801.099237:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233792:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.099378:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233792:12345-0@lo:1000:mdt_io00_000.0 Request processed in 142us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.099386:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:0.0:1785774801.099468:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233792:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.099572:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233920:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.099613:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.105060:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.105788:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671233920 00000100:00100000:3.0:1785774801.105798:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671233920 00000100:00100000:2.0:1785774801.105934:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:2.0:1785774801.105945:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233920:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.106038:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671233920:12345-0@lo:1000:mdt_io00_000.0 Request processed in 96us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.106045:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:0.0:1785774801.108255:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671233920:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.108330:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671234048:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.108376:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.112457:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.116422:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671234048 00000100:00100000:1.0:1785774801.116435:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671234048 00000100:00100000:1.0:1785774801.116498:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:1.0:1785774801.116508:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671234048:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.116634:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6542:x1872519671234048:12345-0@lo:1000:mdt_io00_000.0 Request processed in 127us (8258us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.116641:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1785774801.116746:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671234048:0@lo:1000:mdt_io00_000.0 00000040:00080000:0.0:1785774801.117610:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].403, 2464 off604904 00000040:00080000:0.0:1785774801.117681:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].402, 2544 off651240 00000004:00080000:0.0:1785774801.117688:0:6542:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b77093adf00 with version 771 00000001:00080000:1.0:1785774801.119005:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968471 is committed 00000001:00080000:1.0:1785774801.119015:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968470 is committed 00000004:00080000:3.0:1785774801.122989:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 771 rpc_version 771 00000020:00100000:3.0:1785774801.123044:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774801.123055:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b39f80 x1872519671234304/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774801.123080:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671234304:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774801.123151:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.123282:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.125993:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671234304 00000100:00100000:1.0:1785774801.126005:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671234304 00000100:00100000:1.0:1785774801.126067:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1785774801.126076:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:7474:x1872519671234304:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774801.126912:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:7474:x1872519671234304:12345-0@lo:1000:osp_up0-1.0 Request processed in 836us (3758us total) trans 4294983578 rc 0/0 00000100:00100000:1.0:1785774801.126921:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:2.0:1785774801.134238:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671234304:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1785774801.134979:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.134996:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135008:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135030:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135041:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135047:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135082:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135091:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135101:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.135121:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671234432:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1785774801.135206:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.135250:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368c600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.135312:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671234432 00000100:00100000:3.0:1785774801.135320:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671234432 00000100:00100000:3.0:1785774801.135360:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:3.0:1785774801.135367:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6542:x1872519671234432:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774801.135384:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774801.135399:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ec8a lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ec83 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.135420:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ec8a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ec83 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.135431:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ec8a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ec83 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.135438:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:3.0:1785774801.135441:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.135445:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774801.135490:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:6542:x1872519671234432:12345-0@lo:101:mdt_io00_000.0 Request processed in 123us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.135498:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:1.0:1785774801.135565:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6542:1872519671234432:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1785774801.135578:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135588:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.135606:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2775994 reply state 00000000cf5bb2d3 transno 4294968471 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135616:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135622:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:1.0:1785774801.135625:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774801.135627:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774801.135633:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135640:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.135649:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00000004:00010000:1.0:1785774801.135658:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2775994 reply state 00000000cf5bb2d3 transno 4294968471 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135664:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135682:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7702c6a600) 00010000:00010000:1.0:1785774801.135684:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774801.135686:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774801.135695:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1533:0x0] 00010000:00010000:1.0:1785774801.135701:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135708:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.135716:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1785774801.135722:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135733:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135739:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135760:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774801.135763:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1785774801.135768:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135774:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.135784:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1785774801.135788:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135794:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135801:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135815:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1785774801.135911:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774801.135918:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135926:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774801.135931:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.135939:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135962:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.135968:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774801.135993:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.136001:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0800/0x7b7109e1d09ec4b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec52 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.136013:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774801.136016:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.136022:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774801.136026:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.136032:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.136052:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.136059:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774801.136072:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.136079:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09ec3d lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec44 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.136092:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774801.136094:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774801.136096:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774801.136107:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671234688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774801.136136:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1785774801.136223:0:6542:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1785774801.136237:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18362:x1872519648481664:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 128006us (128305us total) trans 4294968471 rc 0/0 00000100:00100000:1.0:1785774801.136245:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 0 00010000:00010000:3.0:1785774801.136658:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774801.139978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774801.141948:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774801.141972:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671234560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774801.142031:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.142220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671234688 00000100:00100000:2.0:1785774801.142228:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671234688 00000100:00100000:2.0:1785774801.142276:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671234560 00000100:00100000:2.0:1785774801.142279:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671234560 00000100:00100000:2.0:1785774801.142299:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1785774801.142307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+20:3655:x1872519671234688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.142322:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774801.142345:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ec44 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ec3d expref: 20 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.142363:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7702bc0600) 00010000:00010000:2.0:1785774801.142373:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774801.142408:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+19:3655:x1872519671234688:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (6272us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.142415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1785774801.142430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1785774801.142436:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+18:3653:x1872519671234560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.142443:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774801.142454:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ec52 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ec4b expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.142464:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774801.142468:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774801.142490:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+17:3653:x1872519671234560:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.142495:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1785774801.142532:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671234688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774801.142555:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671234560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774801.143245:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143256:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143262:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143268:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774801.143272:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143279:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143289:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7702c6a600) 00010000:00010000:1.0:1785774801.143292:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774801.143296:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143301:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce600/0x7b7109e1d09ec75 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143317:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143323:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143328:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143333:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774801.143335:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143344:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143351:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702c6a200) 00010000:00010000:1.0:1785774801.143354:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774801.143356:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.143361:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ec7c lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.144151:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648481792 00000100:00100000:3.0:1785774801.144294:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648481792 00000100:00100000:3.0:1785774801.144350:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23762 00000100:00100000:3.0:1785774801.144360:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:18362:x1872519648481792:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774801.144384:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774801.144402:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ec91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be97 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.144465:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.144479:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.144491:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774801.144537:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:3.0:1785774801.144541:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785774801.144560:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.144583:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ec91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 39 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.144604:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.144612:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774801.144614:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774801.144617:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774801.144681:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:18362:x1872519648481792:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 322us (4711us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.144691:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23762 00000100:00100000:1.0:1785774801.154069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.154143:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648482048 00000100:00100000:0.0:1785774801.154153:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648482048 00000100:00100000:0.0:1785774801.154240:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23763 00000100:00100000:0.0:1785774801.154250:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:18362:x1872519648482048:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774801.154271:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.154291:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ec9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259be9e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.154364:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.154378:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.154390:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.154400:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.154410:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ec60 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ec59 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.154418:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.154453:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ec60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ec59 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.154468:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671234816:0@lo:104: 00000100:00100000:0.0:1785774801.154516:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.154557:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.154637:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671234816 00000100:00100000:1.0:1785774801.154641:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671234816 00000100:00100000:1.0:1785774801.154670:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1785774801.154677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8627:x1872519671234816:12345-0@lo:104: 00010000:00010000:1.0:1785774801.154690:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.154741:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785774801.154748:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8627:x1872519671234816:12345-0@lo:104: Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.154755:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00010000:00010000:2.0:1785774801.154822:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774801.154840:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.154850:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774801.154856:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.154865:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.154892:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.154898:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774801.154926:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.154939:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09ec59 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ec60 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.154956:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.154958:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.154960:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774801.154967:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774801.154977:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671234944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774801.155005:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.155133:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671234944 00000100:00100000:0.0:1785774801.155137:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671234944 00010000:00010000:0.0:1785774801.155156:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ec60 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09ec59 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.155213:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1785774801.155220:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+17:3655:x1872519671234944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774801.155229:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.156880:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.156895:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.156926:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.156932:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774801.156956:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1a00/0x7b7109e1d09ead8 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09eadf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774801.156981:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983578 is committed 00000001:00080000:1.0:1785774801.156994:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983577 is committed 00000100:00100000:1.0:1785774801.157035:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774801.157047:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671235072:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1785774801.157088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.157120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671235072 00000100:00100000:1.0:1785774801.157125:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671235072 00000100:00100000:1.0:1785774801.157178:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1785774801.157196:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1872519671235072:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1785774801.157206:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.157223:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eadf lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ead8 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.157234:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd1:0x0].0x0 (ffff9b7706383100) 00010000:00010000:1.0:1785774801.157243:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774801.157269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671235072:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.157276:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1785774801.157310:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671235072:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1785774801.157687:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671234816:0@lo:104: 00010000:00010000:3.0:1785774801.157704:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157725:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157733:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157739:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157745:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.157749:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157756:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157768:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774801.157770:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.157774:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157780:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09eb2c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157797:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157804:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157809:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157813:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.157816:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157822:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157838:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7602507300) 00010000:00010000:3.0:1785774801.157841:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.157844:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157850:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eb56 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157868:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157873:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157879:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157883:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.157886:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157892:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157898:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7702bc0700) 00010000:00010000:3.0:1785774801.157900:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.157903:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157908:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09eb80 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157920:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157925:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157931:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157935:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.157937:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157942:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157947:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7605fd8e00) 00010000:00010000:3.0:1785774801.157949:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.157952:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157957:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ebaa lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157967:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157972:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157977:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157981:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.157983:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157989:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.157995:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7602507f00) 00010000:00010000:3.0:1785774801.157996:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.157999:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158004:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ebd4 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158014:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158023:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158029:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158033:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.158035:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158040:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158046:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7605fcbf00) 00010000:00010000:3.0:1785774801.158048:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.158050:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.158055:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ebfe lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.158470:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ec60 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09ec59 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.158482:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7605fcbb00) 00010000:00010000:0.0:1785774801.158486:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.158496:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.158504:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.158529:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774801.158571:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3655:x1872519671234944:12345-0@lo:103:ldlm_bl.0 Request processed in 3351us (3565us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.158578:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1785774801.158611:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671234944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774801.159088:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.159097:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.159252:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671235200:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1785774801.159289:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.159310:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.159404:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671235200 00000100:00100000:1.0:1785774801.159410:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671235200 00000100:00100000:1.0:1785774801.159448:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:1.0:1785774801.159456:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8627:x1872519671235200:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1785774801.159554:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8627:x1872519671235200:12345-0@lo:1000:mdt00_004.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.159562:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1785774801.159657:0:8627:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968470 gen 2 00000004:00080000:0.0:1785774801.159663:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968457 committed transno 4294968470 00000020:00080000:0.0:1785774801.159669:0:8627:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605d0ef00 refcount 2 committed 0 result 0 batchid 408 00000020:00080000:0.0:1785774801.159673:0:8627:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7606879100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605d0e0c0 00000020:00080000:0.0:1785774801.159676:0:8627:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].395 00000020:00080000:0.0:1785774801.159678:0:8627:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7606879900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603611c00 00000020:00080000:0.0:1785774801.159680:0:8627:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].396 00000004:00080000:0.0:1785774801.159708:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968458 committed transno 4294968470 00000004:00080000:0.0:1785774801.159719:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968459 committed transno 4294968470 00000004:00080000:0.0:1785774801.159727:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968460 committed transno 4294968470 00000004:00080000:0.0:1785774801.159734:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968461 committed transno 4294968470 00000004:00080000:0.0:1785774801.159741:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968462 committed transno 4294968470 00000004:00080000:0.0:1785774801.159749:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968463 committed transno 4294968470 00000004:00080000:0.0:1785774801.159755:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968464 committed transno 4294968470 00000004:00080000:0.0:1785774801.159763:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968465 committed transno 4294968470 00000004:00080000:0.0:1785774801.159773:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968466 committed transno 4294968470 00000004:00080000:0.0:1785774801.159782:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968467 committed transno 4294968470 00000004:00080000:0.0:1785774801.159789:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968468 committed transno 4294968470 00000004:00080000:0.0:1785774801.159799:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968469 committed transno 4294968470 00000004:00080000:0.0:1785774801.159807:0:8627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968470 committed transno 4294968470 00000100:00100000:0.0:1785774801.159818:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8627:1872519671235200:0@lo:1000:mdt00_004.0 00000020:00080000:2.0:1785774801.159906:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 408 committed batchid 407 00000020:00080000:2.0:1785774801.159960:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 407 00010000:00010000:0.0:1785774801.160012:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ecb4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160029:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ecb4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160039:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ecb4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160053:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160059:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160066:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160072:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160078:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.160082:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160090:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160099:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774801.160102:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.160106:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160112:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09eca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160124:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160131:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160137:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160143:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.160146:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160152:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160256:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7605fcbb00) 00010000:00010000:0.0:1785774801.160260:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.160263:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160270:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160308:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ec9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be9e expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160322:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ecb4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be9e expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.160334:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7702bc0b00) 00010000:00010000:0.0:1785774801.160336:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774801.160339:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2a00, rc 0) 00000100:00100000:0.0:1785774801.160418:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18362:x1872519648482048:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 6169us (6357us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.160426:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23763 00000100:00100000:2.0:1785774801.169556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774801.169634:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648482304 00000100:00100000:1.0:1785774801.169643:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648482304 00000100:00100000:1.0:1785774801.169697:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23764 00000100:00100000:1.0:1785774801.169707:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:18362:x1872519648482304:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774801.169730:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774801.169753:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ecbb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bea5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774801.169913:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:1.0:1785774801.170006:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ecbb lrc: 1/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bea5 expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.170020:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7605fd8800) 00010000:00010000:1.0:1785774801.170023:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774801.170027:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09ecbb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bea5 expref: 8 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.170044:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:1.0:1785774801.170113:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18362:x1872519648482304:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 408us (567us total) trans 4294968472 rc 301/301 00000100:00100000:1.0:1785774801.170124:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23764 00000100:00100000:2.0:1785774801.177592:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.177728:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648482432 00000100:00100000:0.0:1785774801.177737:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648482432 00000100:00100000:0.0:1785774801.177794:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23765 00000100:00100000:0.0:1785774801.177803:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18362:x1872519648482432:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774801.177826:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.177939:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ecc9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259beac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.177993:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecd0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.178006:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.178017:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774801.178113:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xcf:0x0]: returning size 4096 00000004:00200000:0.0:1785774801.178119:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1785774801.178154:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ecc9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beac expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.178255:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beac expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.178264:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0c00) 00010000:00010000:0.0:1785774801.178267:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774801.178270:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2e00, rc 0) 00000100:00100000:0.0:1785774801.178362:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18362:x1872519648482432:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 560us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.178370:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23765 00000100:00100000:3.0:1785774801.189193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774801.189264:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648482560 00000100:00100000:1.0:1785774801.189274:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648482560 00000100:00100000:1.0:1785774801.189337:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23766 00000100:00100000:1.0:1785774801.189347:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18362:x1872519648482560:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774801.189370:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774801.189391:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09ecd7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259beb3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.189451:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.189467:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ec8a lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ec83 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.189476:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 4/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.189508:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ec8a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ec83 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.189524:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671235328:0@lo:104: 00000100:00100000:1.0:1785774801.189568:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.189600:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.191206:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671235328 00000100:00100000:2.0:1785774801.191216:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671235328 00000100:00100000:2.0:1785774801.191263:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1785774801.191272:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8627:x1872519671235328:12345-0@lo:104: 00010000:00010000:2.0:1785774801.191287:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.191360:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785774801.191367:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8627:x1872519671235328:12345-0@lo:104: Request processed in 97us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.191374:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00010000:00010000:2.0:1785774801.191396:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774801.191402:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.191416:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774801.191421:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.191431:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.191462:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.191468:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774801.191494:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.191501:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09ec83 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ec8a expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.191519:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.191521:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.191522:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774801.191533:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671235456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774801.191564:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.191594:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671235456 00000100:00100000:2.0:1785774801.191598:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671235456 00010000:00010000:2.0:1785774801.191613:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ec8a lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09ec83 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.191634:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:2.0:1785774801.191640:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706101c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671235456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.191650:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1785774801.191965:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8627:1872519671235328:0@lo:104: 00010000:00010000:2.0:1785774801.191985:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1785774801.193438:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 408 batchid updated 00010000:00010000:2.0:1785774801.193506:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ec8a lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09ec83 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.193527:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:2.0:1785774801.193532:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.193541:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.193549:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.193569:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774801.193613:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706101c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3654:x1872519671235456:12345-0@lo:103:ldlm_bl.0 Request processed in 1972us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.193621:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:2.0:1785774801.193681:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671235456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.193699:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.193705:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774801.193751:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd1:0x0]: returning size 4096 00000004:00200000:2.0:1785774801.193756:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1785774801.193799:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09ecd7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beb3 expref: 19 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.193813:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beb3 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.193821:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:2.0:1785774801.193823:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774801.193826:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce600, rc 0) 00000020:00080000:1.0:1785774801.193909:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 408 00000004:00080000:1.0:1785774801.193965:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b760368c000 with version 755 00000020:00080000:1.0:1785774801.193974:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 408 cancel update log [0x240000401:0x3:0x0].395: rc = 0 00000020:00080000:1.0:1785774801.194038:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 408 cancel update log [0x200000400:0x3:0x0].396: rc = 0 00000020:00080000:1.0:1785774801.194059:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 408 00000100:00100000:2.0:1785774801.194278:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18362:x1872519648482560:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 4932us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.194286:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23766 00000004:00080000:2.0:1785774801.194305:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 755 rpc_version 755 00000020:00100000:2.0:1785774801.194325:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774801.194332:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb49500 x1872519671235712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774801.194350:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671235712:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774801.194380:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.194399:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.196317:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671235712 00000100:00100000:2.0:1785774801.196328:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671235712 00000100:00100000:2.0:1785774801.196377:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1785774801.196386:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7689:x1872519671235712:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774801.196591:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671235712:12345-0@lo:1000:osp_up1-0.0 Request processed in 204us (2209us total) trans 4294968473 rc 0/0 00000100:00100000:2.0:1785774801.196599:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:1.0:1785774801.202711:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671235712:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774801.203577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.203646:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648482688 00000100:00100000:3.0:1785774801.203652:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648482688 00000100:00100000:3.0:1785774801.203704:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23767 00000100:00100000:3.0:1785774801.203713:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18362:x1872519648482688:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774801.203731:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774801.203752:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ece5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259beba expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.203811:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ecec lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.203825:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ecec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.203847:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ecec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774801.203938:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:3.0:1785774801.203943:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:3.0:1785774801.203961:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ecec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.203984:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09ece5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beba expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.204009:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ecec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beba expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.204017:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774801.204021:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774801.204024:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774801.204082:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18362:x1872519648482688:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 369us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.204088:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23767 00000100:00100000:3.0:1785774801.215119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.215428:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648482816 00000100:00100000:0.0:1785774801.215439:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648482816 00000100:00100000:0.0:1785774801.215500:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5085 00000100:00100000:0.0:1785774801.215510:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18362:x1872519648482816:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:3.0:1785774801.228157:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18362:x1872519648482816:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 12638us (13037us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.228205:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5085 00000100:00100000:2.0:1785774801.239200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.239290:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648482944 00000100:00100000:0.0:1785774801.239301:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648482944 00000100:00100000:0.0:1785774801.239412:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5086 00000100:00100000:0.0:1785774801.239423:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18362:x1872519648482944:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:2.0:1785774801.247787:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18362:x1872519648482944:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 8355us (8620us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.247801:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5086 00000100:00100000:2.0:1785774801.268877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.269198:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648483072 00000100:00100000:0.0:1785774801.269209:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648483072 00000100:00100000:0.0:1785774801.269269:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23768 00000100:00100000:0.0:1785774801.269279:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18362:x1872519648483072:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:0.0:1785774801.269353:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269374:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269385:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269401:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269408:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269415:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269464:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269472:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269479:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774801.269533:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269548:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269556:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269568:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269575:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269581:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.269585:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269593:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269603:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:0.0:1785774801.269606:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.269610:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269616:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ecf3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269629:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269634:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269640:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269645:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.269649:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269654:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269660:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774801.269662:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.269664:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269669:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ecfa lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269681:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269686:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269692:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269696:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.269698:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269703:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269709:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774801.269711:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.269714:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.269719:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09ed01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.269897:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18362:x1872519648483072:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 619us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.269905:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23768 00000100:00100000:0.0:1785774801.275764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.275840:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648483328 00000100:00100000:2.0:1785774801.275850:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648483328 00000100:00100000:2.0:1785774801.275906:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23769 00000100:00100000:2.0:1785774801.275916:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18362:x1872519648483328:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774801.275936:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.275956:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bec1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.276073:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.276088:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.276100:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774801.276111:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1536:0x0]: returning size 2 00010000:00010000:2.0:1785774801.276312:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1536:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.276330:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 20 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.276338:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:2.0:1785774801.276341:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785774801.276344:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a400, rc 0) 00000100:00100000:2.0:1785774801.276398:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18362:x1872519648483328:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 484us (642us total) trans 4294983579 rc 0/0 00000100:00100000:2.0:1785774801.276406:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23769 00000100:00100000:1.0:1785774801.287704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.287783:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648483456 00000100:00100000:3.0:1785774801.287793:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648483456 00000100:00100000:3.0:1785774801.287858:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5195 00000100:00100000:3.0:1785774801.287868:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648483456:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:3.0:1785774801.287908:0:14530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.287928:0:14530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 10 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.287937:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9c9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785774801.287941:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774801.287946:0:14530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.287978:0:14530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 10 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.287997:0:14530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 10 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.288011:0:14530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14530:1872519671235840:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774801.288111:0:14530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.294042:0:14530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14530:1872519671235840:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774801.294077:0:14530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.302119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.302258:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648483584 00000100:00100000:3.0:1785774801.302269:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648483584 00002000:00100000:3.0:1785774801.302320:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff9b7603d7bb80 x1872519648483584/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/0 e 0 to 0 dl 1785774812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774801.302332:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603d7bb80 with x1872519648483584 ext(0->1) 00010000:00010000:3.0:1785774801.302343:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 11 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.302361:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 11 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774801.302369:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b7603d7bb80 00000100:00100000:3.0:1785774801.302402:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 0 00000100:00100000:3.0:1785774801.302412:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648483584:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774801.303346:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648483584:12345-192.168.202.31@tcp:4:bash.0 Request processed in 932us (1234us total) trans 4294969880 rc 0/0 00000100:00100000:3.0:1785774801.303355:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 0 00002000:00100000:3.0:1785774801.303363:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff9b7603d7bb80 x1872519648483584/t4294969880(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/448 e 0 to 0 dl 1785774812 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774801.303371:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603d7bb80 with x1872519648483584 ext(0->1) 00010000:00010000:3.0:1785774801.303378:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 13 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.303391:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 13 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774801.303398:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b7603d7bb80 00000100:00100000:0.0:1785774801.314481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774801.316995:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648483712 00000100:00100000:1.0:1785774801.317008:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648483712 00010000:00010000:1.0:1785774801.317110:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 13 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.317227:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1633 00000100:00100000:1.0:1785774801.317237:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648483712:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774801.317254:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1785774801.317271:0:6516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:1.0:1785774801.317274:0:6516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1785774799 00002000:00010000:1.0:1785774801.317277:0:6516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1785774799 00002000:00010000:1.0:1785774801.317279:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1785774801.317285:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 13 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.317299:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 13 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.317324:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09eb95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be58 expref: 13 pid: 14730 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.317340:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774801.317346:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774801.317352:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.317361:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.317396:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774801.317459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648483712:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 223us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.317467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1633 00010000:00010000:3.0:1785774801.317531:0:14530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317540:0:14530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317560:0:14530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317568:0:14530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317581:0:14530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317588:0:14530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774801.317591:0:14530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317599:0:14530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317610:0:14530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.317616:0:14530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09ed1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.317676:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648483456:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 29810us (29981us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.317684:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5195 00000100:00100000:2.0:1785774801.328882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.328958:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648483840 00000100:00100000:3.0:1785774801.328968:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648483840 00000100:00100000:3.0:1785774801.329028:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1433 00000100:00100000:3.0:1785774801.329038:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648483840:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:3.0:1785774801.329065:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774801.329091:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ecec lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beba expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.329115:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774801.329126:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774801.329214:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2418:x1872519648483840:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 177us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.329222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1433 00000100:00100000:2.0:1785774801.335364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.335403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.335428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.335502:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648484352 00000100:00100000:3.0:1785774801.335512:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648484352 00000100:00100000:1.0:1785774801.335523:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648483968 00000100:00100000:1.0:1785774801.335526:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648483968 00000100:00100000:1.0:1785774801.335561:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648484096 00000100:00100000:1.0:1785774801.335564:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648484096 00000100:00100000:3.0:1785774801.335570:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1 00000100:00100000:3.0:1785774801.335580:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18362:x1872519648484352:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:1.0:1785774801.335586:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1434 00000100:00100000:1.0:1785774801.335592:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:2419:x1872519648483968:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:1.0:1785774801.335605:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774801.335627:0:6544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.335629:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ecde lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beb3 expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.335638:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09eb87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be51 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.335645:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507a00) 00010000:00010000:3.0:1785774801.335647:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:3.0:1785774801.335650:0:6544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774801.335655:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774801.335672:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.335684:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.335692:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.335702:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648483968:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 110us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.335708:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1434 00000004:00080000:3.0:1785774801.335713:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:1.0:1785774801.335722:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1435 00000100:00100000:1.0:1785774801.335727:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2419:x1872519648484096:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:1.0:1785774801.335735:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.335746:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09ecd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beac expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.335755:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0c00) 00000100:00100000:3.0:1785774801.335761:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671235968:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1785774801.335761:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774801.335777:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648484096:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.335782:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1435 00000100:00100000:3.0:1785774801.335802:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.335825:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.335881:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671235968 00000100:00100000:1.0:1785774801.335885:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671235968 00000100:00100000:1.0:1785774801.335919:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:1.0:1785774801.335926:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671235968:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.336025:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671235968:12345-0@lo:1000:mdt_io00_002.0 Request processed in 99us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.336032:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:2.0:1785774801.336125:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671235968:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.336689:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236096:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774801.336723:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.336747:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.338267:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671236096 00000100:00100000:3.0:1785774801.338276:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671236096 00000100:00100000:3.0:1785774801.338328:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:3.0:1785774801.338337:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671236096:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774801.342572:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671236096:12345-0@lo:403:mdt_io00_002.0 Request processed in 4229us (5840us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.342586:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:3.0:1785774801.342846:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236096:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774801.344940:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236224:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.344995:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.345078:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb240 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.348004:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671236224 00000100:00100000:1.0:1785774801.348017:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671236224 00000100:00100000:2.0:1785774801.351222:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:2.0:1785774801.351237:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671236224:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.351363:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671236224:12345-0@lo:1000:mdt_io00_002.0 Request processed in 129us (6368us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.351375:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:0.0:1785774801.351452:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236224:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1785774801.351535:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.351546:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.351556:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.351575:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236352:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1785774801.351609:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.360316:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.360500:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671236352 00000100:00100000:3.0:1785774801.360510:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671236352 00000100:00100000:3.0:1785774801.360614:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1785774801.360625:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671236352:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774801.360644:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774801.360669:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ed32 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ed2b expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.360700:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ed32 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ed2b expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.360714:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ed32 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ed2b expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.360723:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774801.360726:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.360729:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774801.360788:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671236352:12345-0@lo:101:mdt_io00_002.0 Request processed in 166us (9178us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.360794:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1785774801.360833:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236352:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774801.360850:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.360860:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.360884:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.360915:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.360922:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.360931:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.360948:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236480:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1785774801.360980:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.364353:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.364464:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671236480 00000100:00100000:2.0:1785774801.364473:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671236480 00000100:00100000:2.0:1785774801.364521:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:2.0:1785774801.364530:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671236480:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774801.364548:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.364572:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ed39 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.364601:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ed39 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.364616:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ed39 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.364624:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x391d5834 (ffff9b7605fcb900) 00010000:00010000:2.0:1785774801.364627:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.364630:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b800, rc 0) 00000100:00100000:2.0:1785774801.364691:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671236480:12345-0@lo:101:mdt_io00_002.0 Request processed in 162us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.364697:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:2.0:1785774801.368394:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236480:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774801.368424:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368439:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774801.368466:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:2.0:1785774801.368497:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368508:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368517:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368528:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368535:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368542:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368588:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368599:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368607:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368643:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.368665:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 18 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.368678:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671236608:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774801.368759:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb000 going to sleep for 11 seconds 00010000:00010000:3.0:1785774801.377462:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000e0e6da96 x1872519671236608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 18 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.377489:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 18 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.377515:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ed0f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec1 expref: 18 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.377538:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671236608:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774801.377558:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:3.0:1785774801.377563:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.377573:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.377581:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.377601:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.377610:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.377616:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.377770:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236736:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774801.377820:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.377851:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.377910:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671236736 00000100:00100000:2.0:1785774801.377917:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671236736 00000100:00100000:2.0:1785774801.378012:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:2.0:1785774801.378022:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671236736:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.378146:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671236736:12345-0@lo:1000:mdt_io00_002.0 Request processed in 124us (324us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774801.378154:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:3.0:1785774801.378265:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236736:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774801.378301:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236864:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774801.378324:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.382395:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.382488:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671236864 00000100:00100000:1.0:1785774801.382496:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671236864 00000100:00100000:1.0:1785774801.382557:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:1.0:1785774801.382565:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671236864:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.382666:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671236864:12345-0@lo:1000:mdt_io00_002.0 Request processed in 102us (4341us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.382673:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:1.0:1785774801.382709:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236864:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.382838:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236992:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.382873:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.382888:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760368cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.382899:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671236992 00000100:00100000:1.0:1785774801.382902:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671236992 00000100:00100000:1.0:1785774801.382918:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:1.0:1785774801.382923:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671236992:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.382977:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671236992:12345-0@lo:1000:mdt_io00_002.0 Request processed in 53us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.382984:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:1.0:1785774801.383008:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671236992:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385205:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237120:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385245:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.385272:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.385342:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671237120 00000100:00100000:3.0:1785774801.385348:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671237120 00000100:00100000:3.0:1785774801.385387:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1785774801.385394:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671237120:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774801.385455:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671237120:12345-0@lo:1000:mdt_io00_002.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.385462:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:1.0:1785774801.385568:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237120:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385602:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237248:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385623:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.385644:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.385657:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671237248 00000100:00100000:1.0:1785774801.385660:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671237248 00000100:00100000:1.0:1785774801.385678:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:1.0:1785774801.385684:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671237248:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385736:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671237248:12345-0@lo:1000:mdt_io00_002.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.385742:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:1.0:1785774801.385763:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237248:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385818:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237376:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385840:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.385850:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.385861:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671237376 00000100:00100000:1.0:1785774801.385864:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671237376 00000100:00080000:1.0:1785774801.385883:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774801.385899:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:1.0:1785774801.385905:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6544:x1872519671237376:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.385963:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6544:x1872519671237376:12345-0@lo:1000:mdt_io00_002.0 Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.385969:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:1.0:1785774801.385994:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237376:0@lo:1000:mdt_io00_002.0 00000040:00080000:1.0:1785774801.386404:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].397, 1264 off593784 00000040:00080000:1.0:1785774801.386453:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].396, 1344 off648456 00000100:00100000:1.0:1785774801.386476:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237504:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.386503:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.386513:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.386525:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671237504 00000100:00100000:1.0:1785774801.386528:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671237504 00000100:00100000:1.0:1785774801.386547:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:1.0:1785774801.386552:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6544:x1872519671237504:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.386636:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671237504:12345-0@lo:1000:mdt_io00_002.0 Request processed in 82us (131us total) trans 4294969881 rc 0/0 00000100:00100000:1.0:1785774801.386642:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:1.0:1785774801.386668:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671237504:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1785774801.386676:0:6544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b760368cb40 with version 756 00000004:00080000:2.0:1785774801.388148:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 756 rpc_version 756 00000020:00100000:2.0:1785774801.388218:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774801.388227:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb4b800 x1872519671237760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774801.388245:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671237760:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774801.388285:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.388306:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebba80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.388321:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671237760 00000100:00100000:2.0:1785774801.388325:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671237760 00000100:00100000:2.0:1785774801.388353:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:2.0:1785774801.388359:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671237760:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774801.388762:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671237760:12345-0@lo:1000:osp_up1-0.0 Request processed in 401us (475us total) trans 4294968474 rc 0/0 00000100:00100000:2.0:1785774801.388773:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:2.0:1785774801.388814:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671237760:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1785774801.390221:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d62a8801 reply state 000000008ddfe0ba transno 4294983580 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390246:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390255:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:1.0:1785774801.390259:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1785774801.390263:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774801.390270:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390278:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390284:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390290:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774801.390294:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390302:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390311:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcb300) 00010000:00010000:1.0:1785774801.390313:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774801.390317:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390323:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ed47 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.390342:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d62a8801 reply state 000000008ddfe0ba transno 4294983580 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390350:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390356:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7605fcb500) 00010000:00010000:1.0:1785774801.390358:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774801.390360:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774801.390365:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.390372:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390380:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390386:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390404:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774801.390407:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.390412:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390419:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.390430:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:1.0:1785774801.390436:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390442:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390448:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390453:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774801.390456:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390462:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390469:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7602507f00) 00010000:00010000:1.0:1785774801.390472:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774801.390475:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.390480:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ed24 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.390566:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18362:x1872519648484352:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 54985us (55160us total) trans 4294983580 rc 0/0 00000100:00100000:1.0:1785774801.390574:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1 00010000:00010000:2.0:1785774801.393132:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774801.393144:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.393156:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774801.393205:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.393215:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.393253:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.393259:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774801.393282:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 1/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.393289:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec3600/0x7b7109e1d09ed2b lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ed32 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.393309:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.393311:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.393313:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774801.393361:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774801.393380:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671237888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774801.393431:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.393507:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671237888 00000100:00100000:2.0:1785774801.393514:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671237888 00000100:00100000:2.0:1785774801.394128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1785774801.394139:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3656:x1872519671237888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.394153:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774801.394200:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ed32 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ed2b expref: 9 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.394218:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7602507300) 00010000:00010000:2.0:1785774801.394225:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774801.394262:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671237888:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.394269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:3.0:1785774801.400987:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671237888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774801.401411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.401467:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648484480 00000100:00100000:2.0:1785774801.401474:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648484480 00000100:00100000:2.0:1785774801.401526:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23770 00000100:00100000:2.0:1785774801.401535:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18362:x1872519648484480:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1785774801.401615:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401632:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401644:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401657:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401665:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401677:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401732:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401740:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401747:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.401791:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401803:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401810:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401816:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401822:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401936:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.401941:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401949:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401961:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcb100) 00010000:00010000:2.0:1785774801.401964:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.401968:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401973:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ed5c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401989:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.401995:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402000:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402005:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.402008:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402014:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402022:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7605fcbb00) 00010000:00010000:2.0:1785774801.402025:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.402027:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402033:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed63 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402103:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402110:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402116:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402121:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.402123:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402130:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402137:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:2.0:1785774801.402139:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.402142:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.402147:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.402251:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18362:x1872519648484480:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 716us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.402260:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23770 00000100:00100000:1.0:1785774801.410030:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.411946:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648484736 00000100:00100000:2.0:1785774801.411958:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648484736 00000100:00100000:2.0:1785774801.412028:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23771 00000100:00100000:2.0:1785774801.412040:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18362:x1872519648484736:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774801.412119:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.412141:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bec8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.412381:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.412396:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.412408:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774801.412419:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1539:0x0]: returning size 3 00010000:00010000:2.0:1785774801.412521:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09ed71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1539:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.412537:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.412546:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:2.0:1785774801.412549:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785774801.412553:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ae00, rc 0) 00000100:00100000:2.0:1785774801.412653:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18362:x1872519648484736:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 614us (2633us total) trans 4294983581 rc 0/0 00000100:00100000:2.0:1785774801.412661:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23771 00000100:00100000:1.0:1785774801.431003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.437964:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648484864 00000100:00100000:3.0:1785774801.437979:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648484864 00000100:00100000:2.0:1785774801.440338:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5196 00000100:00100000:2.0:1785774801.440352:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648484864:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:2.0:1785774801.440399:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.440420:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.440430:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9ca:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1785774801.440435:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774801.440441:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.440477:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.440491:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 9 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.440507:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8447:1872519671238016:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774801.440595:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebba80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.442984:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8447:1872519671238016:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774801.443012:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.451287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.451662:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648484992 00000100:00100000:0.0:1785774801.451672:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648484992 00002000:00100000:0.0:1785774801.451716:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->2) req@ffff9b773fb9fb80 x1872519648484992/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/0 e 0 to 0 dl 1785774812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774801.451726:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb9fb80 with x1872519648484992 ext(0->2) 00010000:00010000:0.0:1785774801.451736:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 10 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.451754:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 10 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774801.451763:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b773fb9fb80 00000100:00100000:0.0:1785774801.451795:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1 00000100:00100000:0.0:1785774801.451805:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648484992:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:0.0:1785774801.453774:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648484992:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1961us (2487us total) trans 4294969881 rc 0/0 00000100:00100000:0.0:1785774801.453786:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1 00002000:00100000:0.0:1785774801.453796:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->2) req@ffff9b773fb9fb80 x1872519648484992/t4294969881(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/448 e 0 to 0 dl 1785774812 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774801.453807:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb9fb80 with x1872519648484992 ext(0->2) 00010000:00010000:0.0:1785774801.453817:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 12 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.453844:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 12 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774801.453853:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b773fb9fb80 00000100:00100000:3.0:1785774801.466886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774801.467330:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648485120 00000100:00100000:1.0:1785774801.467340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648485120 00010000:00010000:1.0:1785774801.467378:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 12 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.467419:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1634 00000100:00100000:1.0:1785774801.467428:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648485120:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774801.467444:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1785774801.467461:0:6514:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:1.0:1785774801.467465:0:6514:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1785774799 00002000:00010000:1.0:1785774801.467467:0:6514:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1785774799 00002000:00010000:1.0:1785774801.467469:0:6514:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1785774801.467476:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 12 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.467490:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 12 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.467514:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3614849/0x7b7109e1d09ec13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be82 expref: 12 pid: 8448 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.467533:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774801.467537:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774801.467544:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.467554:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.467593:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774801.467647:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648485120:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 220us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.467654:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1634 00010000:00010000:3.0:1785774801.468064:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468074:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468094:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468103:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468110:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468118:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774801.468122:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468131:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468142:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.468150:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09ed86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.468263:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2418:x1872519648484864:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 27913us (37269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.468270:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5196 00000100:00100000:3.0:1785774801.484754:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774801.484863:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648485376 00000100:00100000:1.0:1785774801.484874:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648485376 00000100:00100000:1.0:1785774801.484940:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2 00000100:00100000:1.0:1785774801.484951:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18362:x1872519648485376:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1785774801.485006:0:6542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.485034:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ec05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be7b expref: 21 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.485062:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:1.0:1785774801.485068:0:6542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774801.485094:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.485107:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.485117:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.485136:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:1.0:1785774801.485246:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238144:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.485297:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.485325:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.485435:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671238144 00000100:00100000:0.0:1785774801.485440:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671238144 00000100:00100000:0.0:1785774801.485476:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1785774801.485484:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6542:x1872519671238144:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.485580:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6542:x1872519671238144:12345-0@lo:1000:mdt_io00_000.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.485588:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:1.0:1785774801.485780:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238144:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.486399:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238272:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1785774801.486437:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.486688:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.488995:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671238272 00000100:00100000:3.0:1785774801.489008:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671238272 00000100:00100000:0.0:1785774801.492131:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:0.0:1785774801.492145:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6542:x1872519671238272:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1785774801.497850:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6542:x1872519671238272:12345-0@lo:403:mdt_io00_000.0 Request processed in 5697us (11400us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.497865:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00100000:1.0:1785774801.501966:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238272:0@lo:403:mdt_io00_000.0 00010000:00010000:1.0:1785774801.502824:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.503445:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.503460:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.503484:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238400:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1785774801.503542:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.503643:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.506231:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671238400 00000100:00100000:0.0:1785774801.506243:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671238400 00000100:00100000:0.0:1785774801.506355:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:0.0:1785774801.506366:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6542:x1872519671238400:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1785774801.506386:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.506408:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ed9b lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ed94 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.506434:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ed9b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ed94 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.506447:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ed9b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ed94 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.506456:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0900) 00010000:00010000:0.0:1785774801.506459:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.506462:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3200, rc 0) 00000100:00100000:0.0:1785774801.506533:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6542:x1872519671238400:12345-0@lo:101:mdt_io00_000.0 Request processed in 169us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.506541:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:1.0:1785774801.506615:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238400:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1785774801.506634:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.506645:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.506667:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.506696:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.506703:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.506712:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.506728:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238528:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1785774801.506757:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.511979:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.512140:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671238528 00000100:00100000:3.0:1785774801.512150:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671238528 00000100:00100000:3.0:1785774801.512752:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:3.0:1785774801.512762:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6542:x1872519671238528:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774801.512781:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774801.512806:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eda9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09eda2 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.512945:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09eda2 expref: 10 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.512962:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09eda2 expref: 10 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.512971:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x84832a57 (ffff9b7602507500) 00010000:00010000:3.0:1785774801.512974:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.512977:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:1.0:1785774801.513146:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238528:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1785774801.513190:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513201:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.513223:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.513244:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513253:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513262:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513274:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513281:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513287:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513330:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513342:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513350:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513379:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.513393:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 20 pid: 6530 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.513407:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671238656:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774801.517445:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.520240:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671238528:12345-0@lo:101:mdt_io00_000.0 Request processed in 7470us (13472us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.520253:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00010000:00010000:0.0:1785774801.520465:0:6542:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@000000003e13f670 x1872519671238656) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 20 pid: 6530 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.520486:0:6542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 20 pid: 6530 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.520511:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ed78 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bec8 expref: 20 pid: 6530 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.520527:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671238656:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774801.520548:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:0.0:1785774801.520553:0:6542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.520562:0:6542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.520570:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.520588:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.520596:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.520602:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.520732:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238784:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.520776:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.520804:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad780 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.520905:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671238784 00000100:00100000:1.0:1785774801.520912:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671238784 00000100:00100000:1.0:1785774801.520955:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:1.0:1785774801.520964:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671238784:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.521206:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671238784:12345-0@lo:1000:mdt_io00_000.0 Request processed in 243us (428us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774801.521213:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:0.0:1785774801.521293:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238784:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.521333:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238912:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.521356:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.521380:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.521462:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671238912 00000100:00100000:1.0:1785774801.521467:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671238912 00000100:00100000:1.0:1785774801.521495:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:1.0:1785774801.521502:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671238912:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.521562:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671238912:12345-0@lo:1000:mdt_io00_000.0 Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.521568:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1785774801.521629:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671238912:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.521711:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671239040:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.521738:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.521758:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.521800:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671239040 00000100:00100000:0.0:1785774801.521804:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671239040 00000100:00100000:0.0:1785774801.521894:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1785774801.521902:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671239040:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.521945:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671239040:12345-0@lo:1000:mdt_io00_000.0 Request processed in 44us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.521952:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:3.0:1785774801.522014:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671239040:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.522202:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671239168:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.522226:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.522243:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.522295:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671239168 00000100:00100000:1.0:1785774801.522299:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671239168 00000100:00100000:1.0:1785774801.522328:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:1.0:1785774801.522334:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1872519671239168:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.522395:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1872519671239168:12345-0@lo:1000:mdt_io00_000.0 Request processed in 61us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.522401:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:3.0:1785774801.522509:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671239168:0@lo:1000:mdt_io00_000.0 00000040:00080000:3.0:1785774801.522801:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].398, 1264 off595048 00000040:00080000:3.0:1785774801.523948:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].397, 1344 off649800 00000100:00100000:3.0:1785774801.523982:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671239296:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.524022:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.524039:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7701359600 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.524156:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671239296 00000100:00100000:1.0:1785774801.524197:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671239296 00000100:00100000:1.0:1785774801.524233:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:1.0:1785774801.524241:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1872519671239296:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.524361:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671239296:12345-0@lo:1000:mdt_io00_000.0 Request processed in 121us (337us total) trans 4294969882 rc 0/0 00000100:00100000:1.0:1785774801.524369:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1785774801.524450:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671239296:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1785774801.524460:0:6542:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605d0e480 with version 757 00000004:00080000:2.0:1785774801.524561:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 757 rpc_version 757 00000020:00100000:2.0:1785774801.524583:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774801.524590:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb49880 x1872519671239552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774801.524604:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671239552:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774801.524632:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.524653:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebba80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.524694:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671239552 00000100:00100000:3.0:1785774801.524698:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671239552 00000100:00100000:3.0:1785774801.524727:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1785774801.524733:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671239552:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774801.526009:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7689:x1872519671239552:12345-0@lo:1000:osp_up1-0.0 Request processed in 1272us (1372us total) trans 4294968475 rc 0/0 00000100:00100000:3.0:1785774801.526020:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:1.0:1785774801.526312:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671239552:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1785774801.526923:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b9be504 reply state 00000000003d8712 transno 4294983582 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.526944:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.526953:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:3.0:1785774801.526956:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1785774801.526960:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774801.526967:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.526975:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.526980:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.526987:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.526993:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.526997:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527004:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527015:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:3.0:1785774801.527018:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.527022:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527028:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09edb0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774801.527058:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b9be504 reply state 00000000003d8712 transno 4294983582 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527067:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527073:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774801.527075:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774801.527077:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1785774801.527081:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.527088:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527095:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527106:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527129:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774801.527132:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.527137:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527145:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.527157:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:3.0:1785774801.527200:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527207:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527212:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527216:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.527219:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527225:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527232:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7605fd8800) 00010000:00010000:3.0:1785774801.527235:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.527238:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.527243:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09ed8d lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.527308:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18362:x1872519648485376:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 42357us (42560us total) trans 4294983582 rc 0/0 00000100:00100000:3.0:1785774801.527315:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2 00010000:00010000:1.0:1785774801.527420:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774801.527427:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.527434:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774801.527438:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.527450:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.527479:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.527485:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774801.527514:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.527522:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce800/0x7b7109e1d09ed94 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ed9b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.527535:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774801.527537:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774801.527539:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774801.527546:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774801.527558:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671239680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774801.527594:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.527626:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671239680 00000100:00100000:1.0:1785774801.527632:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671239680 00000100:00100000:1.0:1785774801.527667:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1785774801.527674:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706101450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3655:x1872519671239680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774801.527684:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.527699:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ed9b lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ed94 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.527710:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0900) 00010000:00010000:1.0:1785774801.527717:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774801.527740:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706101450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3655:x1872519671239680:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.527747:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1785774801.527794:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671239680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774801.532909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.533054:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648485504 00000100:00100000:2.0:1785774801.533064:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648485504 00000100:00100000:2.0:1785774801.533121:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23772 00000100:00100000:2.0:1785774801.533131:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18362:x1872519648485504:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1785774801.533248:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533265:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533277:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533290:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533298:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533305:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533356:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533364:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533376:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.533428:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533442:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533448:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533455:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533461:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533467:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.533471:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533478:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533489:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:2.0:1785774801.533492:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.533496:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533503:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09edc5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533519:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533525:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533531:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533537:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.533540:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533546:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533553:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7605fcb100) 00010000:00010000:2.0:1785774801.533556:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.533559:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533565:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09edcc lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533576:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533583:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533589:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533595:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.533598:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533604:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533611:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9b7602507100) 00010000:00010000:2.0:1785774801.533613:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.533616:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.533621:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09edd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.533681:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18362:x1872519648485504:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 551us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.533689:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23772 00000100:00100000:2.0:1785774801.542700:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.542783:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648485760 00000100:00100000:0.0:1785774801.542794:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648485760 00000100:00100000:0.0:1785774801.542864:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23773 00000100:00100000:0.0:1785774801.542875:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18362:x1872519648485760:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774801.542908:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.542931:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09edda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259becf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.543084:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.543108:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.543121:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774801.543138:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1535:0x0]: returning size 2 00010000:00010000:0.0:1785774801.543288:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09edda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.543304:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.543313:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9b7602507100) 00010000:00010000:0.0:1785774801.543315:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785774801.543319:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2800, rc 0) 00000100:00100000:0.0:1785774801.543381:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18362:x1872519648485760:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 509us (691us total) trans 4294983583 rc 0/0 00000100:00100000:0.0:1785774801.543389:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23773 00000100:00100000:1.0:1785774801.553348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.553454:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648485888 00000100:00100000:0.0:1785774801.553464:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648485888 00000100:00100000:0.0:1785774801.553517:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5197 00000100:00100000:0.0:1785774801.553526:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648485888:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:0.0:1785774801.553570:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.553591:0:8661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 10 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.553602:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9c8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785774801.553606:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774801.553611:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.553643:0:8661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 10 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.553658:0:8661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 10 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.553672:0:8661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8661:1872519671239808:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774801.553748:0:8661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.556018:0:8661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8661:1872519671239808:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774801.556056:0:8661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.561329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.561538:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648486016 00000100:00100000:3.0:1785774801.561548:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648486016 00002000:00100000:3.0:1785774801.561591:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff9b7605c97480 x1872519648486016/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/0 e 0 to 0 dl 1785774812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774801.561601:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c97480 with x1872519648486016 ext(0->1) 00010000:00010000:3.0:1785774801.561610:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 11 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.561627:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 11 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774801.561635:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7605c97480 00000100:00100000:3.0:1785774801.561668:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2 00000100:00100000:3.0:1785774801.561677:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648486016:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774801.562419:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648486016:12345-192.168.202.31@tcp:4:bash.0 Request processed in 740us (1095us total) trans 4294969883 rc 0/0 00000100:00100000:3.0:1785774801.562433:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2 00002000:00100000:3.0:1785774801.562440:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff9b7605c97480 x1872519648486016/t4294969883(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/448 e 0 to 0 dl 1785774812 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774801.562449:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c97480 with x1872519648486016 ext(0->1) 00010000:00010000:3.0:1785774801.562456:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 13 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.562469:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 13 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774801.562476:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7605c97480 00000100:00100000:3.0:1785774801.566269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.566551:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648486144 00000100:00100000:2.0:1785774801.566561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648486144 00010000:00010000:2.0:1785774801.566600:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 13 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.566646:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1635 00000100:00100000:2.0:1785774801.566656:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648486144:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.566671:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785774801.566686:0:6516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1785774801.566690:0:6516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1785774799 00002000:00010000:2.0:1785774801.566692:0:6516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1785774799 00002000:00010000:2.0:1785774801.566694:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1785774801.566700:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 13 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.566713:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 13 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.566735:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc7118c/0x7b7109e1d09eb6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be4a expref: 13 pid: 14719 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.566752:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774801.566755:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774801.566762:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.566771:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.566802:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774801.566951:0:8661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.566961:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.566983:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.566991:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.567000:0:8661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.567008:0:8661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774801.567012:0:8661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.567021:0:8661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.567033:0:8661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.567041:0:8661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d09edef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.567121:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648486144:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 465us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.567128:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1635 00000100:00100000:0.0:1785774801.573543:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648485888:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 20004us (20191us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.573559:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5197 00000100:00100000:2.0:1785774801.581696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774801.581780:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648486400 00000100:00100000:1.0:1785774801.581790:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648486400 00000100:00100000:1.0:1785774801.581858:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:1.0:1785774801.581869:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18362:x1872519648486400:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1785774801.581926:0:6544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.581954:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09eb5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be43 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.581977:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9b7602507100) 00010000:00010000:1.0:1785774801.581982:0:6544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774801.582008:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.582021:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.582033:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.582065:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:1.0:1785774801.582115:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671239936:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.582394:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.582426:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.582510:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671239936 00000100:00100000:0.0:1785774801.582515:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671239936 00000100:00100000:0.0:1785774801.582555:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:0.0:1785774801.582563:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6544:x1872519671239936:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.582648:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6544:x1872519671239936:12345-0@lo:1000:mdt_io00_002.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.582657:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1785774801.582752:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671239936:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.583518:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240064:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774801.583557:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.583586:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.584428:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671240064 00000100:00100000:3.0:1785774801.584436:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671240064 00000100:00100000:3.0:1785774801.584484:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:3.0:1785774801.584493:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6544:x1872519671240064:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774801.590892:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6544:x1872519671240064:12345-0@lo:403:mdt_io00_002.0 Request processed in 6391us (7324us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.590912:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:1.0:1785774801.593982:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240064:0@lo:403:mdt_io00_002.0 00010000:00010000:1.0:1785774801.594788:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.594801:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.594811:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.595932:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240192:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1785774801.595999:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.596102:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.597971:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671240192 00000100:00100000:0.0:1785774801.597985:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671240192 00000100:00100000:0.0:1785774801.598919:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:0.0:1785774801.599267:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6544:x1872519671240192:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1785774801.599289:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.599314:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09ee04 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09edfd expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.599347:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09ee04 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09edfd expref: 11 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.599361:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09ee04 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09edfd expref: 11 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.599369:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:0.0:1785774801.599372:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.599375:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3000, rc 0) 00000100:00100000:0.0:1785774801.599447:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6544:x1872519671240192:12345-0@lo:101:mdt_io00_002.0 Request processed in 188us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.599454:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:1.0:1785774801.599610:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240192:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774801.599631:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.599641:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.599662:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.599695:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.599702:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.599711:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.599727:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240320:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1785774801.599757:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.599816:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.603014:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671240320 00000100:00100000:2.0:1785774801.603028:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671240320 00000100:00100000:2.0:1785774801.603976:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1785774801.603986:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6544:x1872519671240320:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774801.604008:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.604033:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09ee12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ee0b expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.604224:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09ee12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ee0b expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.604241:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09ee12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ee0b expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.604250:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xbc0ca3a9 (ffff9b7605fcb100) 00010000:00010000:2.0:1785774801.604253:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.604256:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b600, rc 0) 00000100:00100000:2.0:1785774801.604490:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671240320:12345-0@lo:101:mdt_io00_002.0 Request processed in 504us (4730us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.604497:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1785774801.604589:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240320:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774801.604608:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604619:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774801.604642:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.604663:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604671:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604679:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604689:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604700:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604706:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604747:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604759:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604767:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604796:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.604810:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 22 pid: 6529 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.604823:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671240448:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774801.604961:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd0f00 going to sleep for 11 seconds 00010000:00010000:2.0:1785774801.607999:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@000000006ffd2692 x1872519671240448) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 22 pid: 6529 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.608022:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 22 pid: 6529 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.608108:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09ede1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259becf expref: 22 pid: 6529 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.608124:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671240448:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774801.608141:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9b7602507100) 00010000:00010000:2.0:1785774801.608146:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.608155:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.608214:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.608235:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.608245:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.608250:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.608379:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240576:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.608426:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.608443:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.608499:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671240576 00000100:00100000:0.0:1785774801.608506:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671240576 00000100:00100000:0.0:1785774801.608550:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:0.0:1785774801.608558:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671240576:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.610396:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671240576:12345-0@lo:1000:mdt_io00_002.0 Request processed in 1833us (1964us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774801.610408:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1785774801.612153:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240576:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.612352:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240704:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.612406:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.612474:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.614392:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671240704 00000100:00100000:2.0:1785774801.614403:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671240704 00000100:00100000:2.0:1785774801.614496:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:2.0:1785774801.614506:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671240704:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.614614:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671240704:12345-0@lo:1000:mdt_io00_002.0 Request processed in 109us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.614622:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:1.0:1785774801.614692:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240704:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.614814:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240832:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.614857:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.618729:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605fd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.622371:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671240832 00000100:00100000:0.0:1785774801.622385:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671240832 00000100:00100000:0.0:1785774801.622463:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:0.0:1785774801.622474:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671240832:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.622589:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671240832:12345-0@lo:1000:mdt_io00_002.0 Request processed in 117us (7731us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.622596:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1785774801.622731:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240832:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.622861:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240960:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.622897:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.622923:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.622940:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671240960 00000100:00100000:1.0:1785774801.622944:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671240960 00000100:00100000:1.0:1785774801.622964:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:1.0:1785774801.622970:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671240960:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.623216:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671240960:12345-0@lo:1000:mdt_io00_002.0 Request processed in 244us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.623222:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:1.0:1785774801.623247:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671240960:0@lo:1000:mdt_io00_002.0 00000040:00080000:1.0:1785774801.623560:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].399, 1264 off596312 00000040:00080000:1.0:1785774801.623608:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].398, 1344 off651144 00000100:00100000:1.0:1785774801.623629:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671241088:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.623654:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.623666:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ceca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.623716:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671241088 00000100:00100000:0.0:1785774801.623721:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671241088 00000100:00100000:0.0:1785774801.623748:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:0.0:1785774801.623754:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671241088:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.623851:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671241088:12345-0@lo:1000:mdt_io00_002.0 Request processed in 97us (195us total) trans 4294969884 rc 0/0 00000100:00100000:0.0:1785774801.623857:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:1.0:1785774801.624025:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671241088:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1785774801.624035:0:6544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605fd09c0 with version 758 00000004:00080000:0.0:1785774801.627036:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 758 rpc_version 758 00000020:00100000:1.0:1785774801.630010:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774801.630028:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c95500 x1872519671241344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774801.630113:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671241344:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774801.630244:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.630317:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ceca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.633127:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671241344 00000100:00100000:0.0:1785774801.633140:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671241344 00000100:00100000:0.0:1785774801.633350:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:0.0:1785774801.633361:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7689:x1872519671241344:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774801.633818:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7689:x1872519671241344:12345-0@lo:1000:osp_up1-0.0 Request processed in 457us (3572us total) trans 4294968476 rc 0/0 00000100:00100000:2.0:1785774801.634200:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671241344:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1785774801.634299:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cf57285 reply state 0000000073a90607 transno 4294983584 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634322:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634332:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9b7602507100) 00010000:00010000:3.0:1785774801.634335:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1785774801.634339:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774801.634345:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634357:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634365:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634371:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.634375:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634383:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634392:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:3.0:1785774801.634395:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.634398:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634405:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09ee19 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774801.634424:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cf57285 reply state 0000000073a90607 transno 4294983584 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634433:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634439:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7605fd8e00) 00010000:00010000:3.0:1785774801.634442:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774801.634443:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1785774801.634448:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.634455:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634462:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634469:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634491:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774801.634496:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.634501:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634508:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.634522:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:3.0:1785774801.634529:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634534:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634540:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634545:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.634547:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634557:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634565:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:3.0:1785774801.634567:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.634570:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.634575:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09edf6 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.634646:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18362:x1872519648486400:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 52777us (52957us total) trans 4294983584 rc 0/0 00000100:00100000:3.0:1785774801.634653:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3 00010000:00010000:2.0:1785774801.634709:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774801.634715:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.634722:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774801.634727:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.634734:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.634765:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.634771:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774801.634802:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 1/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.634809:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09edfd lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ee04 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.634824:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.634836:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.634838:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774801.634846:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774801.634859:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671241472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774801.634900:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.634933:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671241472 00000100:00100000:2.0:1785774801.634939:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671241472 00000100:00100000:2.0:1785774801.634972:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1785774801.634979:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3654:x1872519671241472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.634989:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774801.635005:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09ee04 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09edfd expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.635016:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:2.0:1785774801.635024:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774801.635063:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3654:x1872519671241472:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.635070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1785774801.635100:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671241472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774801.636114:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:3.0:1785774801.641802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.641923:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648486528 00000100:00100000:2.0:1785774801.641932:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648486528 00000100:00100000:2.0:1785774801.641990:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23774 00000100:00100000:2.0:1785774801.642000:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18362:x1872519648486528:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1785774801.642090:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642107:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642123:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642135:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642142:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642148:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642235:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642244:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642250:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.642297:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642311:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642318:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642324:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642335:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642342:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.642346:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642354:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642366:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:2.0:1785774801.642369:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.642373:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642379:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ee2e lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642397:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642403:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642408:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642412:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.642415:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642423:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642431:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7605fcbf00) 00010000:00010000:2.0:1785774801.642433:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.642436:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642442:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee35 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642453:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642459:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642465:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642470:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.642472:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642478:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642484:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9b7602507200) 00010000:00010000:2.0:1785774801.642487:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.642489:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.642498:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.642583:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18362:x1872519648486528:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 584us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.642591:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23774 00000100:00100000:2.0:1785774801.646637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.646703:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648486784 00000100:00100000:3.0:1785774801.646713:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648486784 00000100:00100000:3.0:1785774801.646773:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23775 00000100:00100000:3.0:1785774801.646782:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18362:x1872519648486784:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774801.646801:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774801.646821:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bed6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.646944:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.646959:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.646975:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774801.646986:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1538:0x0]: returning size 2 00010000:00010000:3.0:1785774801.647102:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1538:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.647126:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 25 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.647134:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9b7602507200) 00010000:00010000:3.0:1785774801.647137:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785774801.647140:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774801.647227:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18362:x1872519648486784:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 447us (598us total) trans 4294983585 rc 0/0 00000100:00100000:3.0:1785774801.647234:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23775 00000100:00100000:1.0:1785774801.656721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.656791:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648486912 00000100:00100000:2.0:1785774801.656801:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648486912 00000100:00100000:2.0:1785774801.656862:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5198 00000100:00100000:2.0:1785774801.656873:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648486912:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:2.0:1785774801.656917:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.656938:0:14712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 11 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.656947:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9ca:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1785774801.656952:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774801.656957:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.656990:0:14712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 11 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.657005:0:14712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 11 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.657021:0:14712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14712:1872519671241600:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774801.657110:0:14712:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.671620:0:14712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14712:1872519671241600:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774801.671651:0:14712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.674141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.674272:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648487040 00000100:00100000:0.0:1785774801.674282:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648487040 00002000:00100000:0.0:1785774801.674327:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->1) req@ffff9b7741b3b800 x1872519648487040/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/0 e 0 to 0 dl 1785774812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774801.674338:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b3b800 with x1872519648487040 ext(0->1) 00010000:00010000:0.0:1785774801.674346:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 12 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.674363:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 12 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774801.674372:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b7741b3b800 00000100:00100000:0.0:1785774801.674404:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:0.0:1785774801.674413:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648487040:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:0.0:1785774801.675351:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648487040:12345-192.168.202.31@tcp:4:bash.0 Request processed in 935us (1213us total) trans 4294969882 rc 0/0 00000100:00100000:0.0:1785774801.675360:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3 00002000:00100000:0.0:1785774801.675368:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->1) req@ffff9b7741b3b800 x1872519648487040/t4294969882(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/448 e 0 to 0 dl 1785774812 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774801.675377:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b3b800 with x1872519648487040 ext(0->1) 00010000:00010000:0.0:1785774801.675384:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 14 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.675399:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 14 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774801.675413:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b7741b3b800 00000100:00100000:1.0:1785774801.693507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.693598:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648487168 00000100:00100000:3.0:1785774801.693607:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648487168 00010000:00010000:3.0:1785774801.693647:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 14 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.693689:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1636 00000100:00100000:3.0:1785774801.693698:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648487168:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774801.693713:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1785774801.693732:0:9541:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1785774801.693735:0:9541:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1785774799 00002000:00010000:3.0:1785774801.693738:0:9541:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1785774799 00002000:00010000:3.0:1785774801.693740:0:9541:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1785774801.693746:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 14 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.693760:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 14 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.693783:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e52674f5/0x7b7109e1d09ebe9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be74 expref: 14 pid: 14729 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.693799:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774801.693803:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774801.693809:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.693818:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.693859:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774801.693922:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2418:x1872519648487168:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 223us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.693930:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1636 00010000:00010000:2.0:1785774801.693999:0:14712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694009:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694031:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694040:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694059:0:14712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694067:0:14712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774801.694071:0:14712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694087:0:14712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694100:0:14712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.694108:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027152fa5/0x7b7109e1d09ee58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.694210:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648486912:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 37287us (37446us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.694220:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5198 00010000:00010000:2.0:1785774801.700728:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774801.713636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.713738:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648487424 00000100:00100000:3.0:1785774801.713749:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648487424 00000100:00100000:3.0:1785774801.713814:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:3.0:1785774801.713825:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18362:x1872519648487424:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1785774801.713898:0:6542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774801.713930:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ebdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be6d expref: 25 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.713956:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9b7602507200) 00010000:00010000:3.0:1785774801.713960:0:6542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774801.713986:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.713998:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.714009:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.714030:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:3.0:1785774801.714105:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671241728:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.714156:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.714551:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77052ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.715542:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671241728 00000100:00100000:1.0:1785774801.715550:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671241728 00000100:00100000:1.0:1785774801.715630:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1785774801.715639:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6542:x1872519671241728:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774801.715758:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6542:x1872519671241728:12345-0@lo:1000:mdt_io00_000.0 Request processed in 120us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.715765:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:2.0:1785774801.715846:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671241728:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.716424:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671241856:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774801.716465:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.724571:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.727972:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671241856 00000100:00100000:3.0:1785774801.727988:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671241856 00000100:00100000:3.0:1785774801.728076:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:3.0:1785774801.728087:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:6542:x1872519671241856:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1785774801.730654:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:6542:x1872519671241856:12345-0@lo:403:mdt_io00_000.0 Request processed in 2562us (14181us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.730667:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:2.0:1785774801.730835:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671241856:0@lo:403:mdt_io00_000.0 00010000:00010000:2.0:1785774801.731524:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731536:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731552:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.731570:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671241984:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1785774801.731604:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.731633:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.731650:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671241984 00000100:00100000:2.0:1785774801.731656:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671241984 00000100:00100000:2.0:1785774801.731685:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:2.0:1785774801.731692:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6542:x1872519671241984:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774801.731707:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.731721:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee6d lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ee66 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731746:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee6d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ee66 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731760:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee6d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ee66 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731769:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:2.0:1785774801.731772:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.731775:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35be00, rc 0) 00000100:00100000:2.0:1785774801.731805:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6542:x1872519671241984:12345-0@lo:101:mdt_io00_000.0 Request processed in 113us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.731812:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:2.0:1785774801.731836:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671241984:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774801.731849:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731858:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774801.731873:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:2.0:1785774801.731892:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731900:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.731907:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.731919:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242112:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1785774801.731940:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.731949:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.731959:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671242112 00000100:00100000:2.0:1785774801.731962:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671242112 00000100:00100000:2.0:1785774801.731979:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1785774801.731984:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6542:x1872519671242112:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774801.731991:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.732003:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09ee7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ee74 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732017:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09ee7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ee74 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732031:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09ee7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ee74 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732037:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xb62e0cbf (ffff9b7605fcb600) 00010000:00010000:2.0:1785774801.732039:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.732042:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774801.732069:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671242112:12345-0@lo:101:mdt_io00_000.0 Request processed in 84us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.732075:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1785774801.732096:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242112:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774801.732105:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732114:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774801.732125:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:2.0:1785774801.732139:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732148:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732156:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732197:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732204:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732212:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732245:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732256:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732265:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732286:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.732300:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 24 pid: 6531 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.732311:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671242240:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774801.732367:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00010000:00010000:2.0:1785774801.737341:0:6542:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@0000000012f1a74a x1872519671242240) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 24 pid: 6531 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.737367:0:6542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 24 pid: 6531 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.737392:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ee4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bed6 expref: 24 pid: 6531 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.737412:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671242240:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774801.737433:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9b7602507200) 00010000:00010000:2.0:1785774801.737439:0:6542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.737449:0:6542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.737457:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.737475:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.737484:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.737490:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.737620:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242368:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.737665:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.737734:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.738927:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671242368 00000100:00100000:1.0:1785774801.738936:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671242368 00000100:00100000:0.0:1785774801.741943:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:0.0:1785774801.741966:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671242368:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.742371:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671242368:12345-0@lo:1000:mdt_io00_000.0 Request processed in 416us (4704us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774801.742379:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:2.0:1785774801.744946:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242368:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.745031:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242496:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.745233:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.745257:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.745311:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671242496 00000100:00100000:0.0:1785774801.745318:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671242496 00000100:00100000:0.0:1785774801.745368:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1785774801.745377:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671242496:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.745503:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671242496:12345-0@lo:1000:mdt_io00_000.0 Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.745510:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:3.0:1785774801.747258:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242496:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.747389:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242624:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.747432:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.747507:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.751003:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671242624 00000100:00100000:1.0:1785774801.751018:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671242624 00000100:00100000:0.0:1785774801.753060:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:0.0:1785774801.753073:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671242624:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774801.753227:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671242624:12345-0@lo:1000:mdt_io00_000.0 Request processed in 156us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.753234:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:2.0:1785774801.753396:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242624:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.753528:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242752:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.753576:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.758481:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.760224:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671242752 00000100:00100000:3.0:1785774801.760235:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671242752 00000100:00100000:3.0:1785774801.760303:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:3.0:1785774801.760313:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671242752:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774801.760432:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671242752:12345-0@lo:1000:mdt_io00_000.0 Request processed in 121us (6856us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774801.760440:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1785774801.761208:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242752:0@lo:1000:mdt_io00_000.0 00000040:00080000:2.0:1785774801.761591:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].400, 1264 off597576 00000040:00080000:2.0:1785774801.761641:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].399, 1344 off652488 00000100:00100000:2.0:1785774801.761675:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242880:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.761754:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.761775:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.761793:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671242880 00000100:00100000:2.0:1785774801.761798:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671242880 00000100:00100000:2.0:1785774801.761822:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:2.0:1785774801.762946:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671242880:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774801.763424:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671242880:12345-0@lo:1000:mdt_io00_000.0 Request processed in 488us (1669us total) trans 4294969883 rc 0/0 00000100:00100000:2.0:1785774801.763433:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:3.0:1785774801.775440:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671242880:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1785774801.775461:0:6542:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605ebb0c0 with version 759 00000004:00080000:2.0:1785774801.782412:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 759 rpc_version 759 00000020:00100000:2.0:1785774801.782474:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1785774801.782484:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d7100 x1872519671243136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785774801.782507:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671243136:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774801.782572:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774801.782653:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774801.788332:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671243136 00000100:00100000:3.0:1785774801.788347:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671243136 00000100:00100000:2.0:1785774801.788493:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1785774801.788504:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:7689:x1872519671243136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774801.790308:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:7689:x1872519671243136:12345-0@lo:1000:osp_up1-0.0 Request processed in 1801us (7731us total) trans 4294968477 rc 0/0 00000100:00100000:2.0:1785774801.790318:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:1.0:1785774801.796271:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671243136:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1785774801.796460:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3287da7 reply state 0000000062cb5c17 transno 4294983586 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796483:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796493:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9b7602507200) 00010000:00010000:3.0:1785774801.796496:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1785774801.796501:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774801.796511:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796518:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796524:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796536:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796542:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.796546:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796553:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796563:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcbc00) 00010000:00010000:3.0:1785774801.796566:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.796570:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796576:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee82 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774801.796597:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3287da7 reply state 0000000062cb5c17 transno 4294983586 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796605:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796610:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7605fcb000) 00010000:00010000:3.0:1785774801.796612:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774801.796614:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1785774801.796619:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.796625:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796636:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796643:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796673:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774801.796678:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.796683:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796690:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.796703:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:3.0:1785774801.796710:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796716:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796722:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796726:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774801.796729:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796735:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796744:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7602507600) 00010000:00010000:3.0:1785774801.796747:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774801.796750:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.796755:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ee5f lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.796914:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774801.796921:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.796930:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774801.796935:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.796943:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.796976:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.796982:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774801.797015:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.797023:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ee66 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ee6d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.797037:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774801.797125:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671243264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774801.797275:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18362:x1872519648487424:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 83450us (83645us total) trans 4294983586 rc 0/0 00000100:00100000:3.0:1785774801.797284:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4 00010000:00010000:2.0:1785774801.797345:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774801.797348:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774801.806980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.807114:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671243264 00000100:00100000:1.0:1785774801.807123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671243264 00000100:00100000:1.0:1785774801.807212:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1785774801.807221:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+15:3654:x1872519671243264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774801.807238:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.807261:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09ee6d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ee66 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.807279:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:1.0:1785774801.807291:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774801.807334:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+14:3654:x1872519671243264:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.807341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1785774801.807379:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671243264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774801.816172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.816363:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648487552 00000100:00100000:2.0:1785774801.816373:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648487552 00000100:00100000:2.0:1785774801.816436:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23776 00000100:00100000:2.0:1785774801.816446:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18362:x1872519648487552:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1785774801.816525:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816542:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816554:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816567:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816574:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816581:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816637:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816646:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816653:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774801.816704:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816718:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816725:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816731:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816738:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816745:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.816750:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816757:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816769:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcbf00) 00010000:00010000:2.0:1785774801.816772:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.816777:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816783:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09ee97 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816801:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816808:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816814:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816819:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.816835:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816843:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816850:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7605fcb300) 00010000:00010000:2.0:1785774801.816852:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.816855:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816860:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ee9e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816872:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816877:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816884:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816889:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774801.816892:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816902:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816909:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:2.0:1785774801.816911:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.816914:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.816920:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09eea5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.816997:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18362:x1872519648487552:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 552us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.817005:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23776 00000100:00100000:2.0:1785774801.828135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.828921:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648487808 00000100:00100000:0.0:1785774801.828932:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648487808 00000100:00100000:0.0:1785774801.828993:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23777 00000100:00100000:0.0:1785774801.829005:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18362:x1872519648487808:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774801.829026:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.829138:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09eeac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bedd expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.829280:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.829294:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.829306:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774801.829317:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1537:0x0]: returning size 2 00010000:00010000:0.0:1785774801.829412:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09eeac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1537:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 28 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.829429:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 27 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.829438:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:0.0:1785774801.829441:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785774801.829445:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3000, rc 0) 00000100:00100000:0.0:1785774801.829555:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18362:x1872519648487808:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 551us (1427us total) trans 4294983587 rc 0/0 00000100:00100000:0.0:1785774801.829563:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23777 00000100:00100000:1.0:1785774801.842581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.842651:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648487936 00000100:00100000:0.0:1785774801.842661:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648487936 00000100:00100000:0.0:1785774801.842720:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5199 00000100:00100000:0.0:1785774801.842731:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648487936:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:0.0:1785774801.842777:0:14729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.842799:0:14729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 11 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.842809:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9c9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785774801.842813:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774801.842817:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.842864:0:14729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 11 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.842880:0:14729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 11 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.842895:0:14729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14729:1872519671243392:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774801.842995:0:14729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.854321:0:14729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14729:1872519671243392:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774801.854352:0:14729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.859748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.859830:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648488064 00000100:00100000:3.0:1785774801.859841:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648488064 00002000:00100000:3.0:1785774801.859890:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff9b773fb9d180 x1872519648488064/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/0 e 0 to 0 dl 1785774812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774801.859899:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb9d180 with x1872519648488064 ext(0->1) 00010000:00010000:3.0:1785774801.859909:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 12 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.859926:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 12 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774801.859934:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b773fb9d180 00000100:00100000:3.0:1785774801.859968:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:3.0:1785774801.859978:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648488064:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774801.861136:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648488064:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1157us (1394us total) trans 4294969885 rc 0/0 00000100:00100000:3.0:1785774801.861146:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4 00002000:00100000:3.0:1785774801.861154:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff9b773fb9d180 x1872519648488064/t4294969885(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:492/0 lens 496/448 e 0 to 0 dl 1785774812 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774801.861189:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb9d180 with x1872519648488064 ext(0->1) 00010000:00010000:3.0:1785774801.861196:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 14 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.861211:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 14 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774801.861218:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b773fb9d180 00000100:00100000:1.0:1785774801.880727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774801.880822:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648488192 00000100:00100000:2.0:1785774801.880843:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648488192 00010000:00010000:2.0:1785774801.880888:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 14 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774801.880931:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1637 00000100:00100000:2.0:1785774801.880941:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648488192:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774801.880956:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785774801.880974:0:19895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1785774801.880977:0:19895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1785774799 00002000:00010000:2.0:1785774801.880980:0:19895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1785774799 00002000:00010000:2.0:1785774801.880982:0:19895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1785774801.880989:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 14 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.881003:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 14 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.881027:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000070d82bc/0x7b7109e1d09ebbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be66 expref: 14 pid: 14712 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.881054:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774801.881059:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774801.881065:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.881075:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.881106:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774801.881157:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648488192:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 217us (441us total) trans 0 rc 0/0 00010000:00010000:0.0:1785774801.881380:0:14729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881392:0:14729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881413:0:14729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881422:0:14729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881431:0:14729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881439:0:14729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774801.881442:0:14729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881450:0:14729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881462:0:14729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.881469:0:14729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d09eec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.881521:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2418:x1872519648487936:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 38792us (38950us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.881530:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5199 00000100:00100000:2.0:1785774801.881995:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1637 00000100:00100000:2.0:1785774801.899998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774801.900135:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648488448 00000100:00100000:3.0:1785774801.900144:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648488448 00000100:00100000:3.0:1785774801.900252:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:3.0:1785774801.900262:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18362:x1872519648488448:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1785774801.900313:0:6544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774801.900339:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09ebb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be5f expref: 27 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.900357:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:3.0:1785774801.900362:0:6544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774801.900386:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.900399:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.900414:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.900432:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:3.0:1785774801.900482:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243520:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774801.900530:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.900551:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.900655:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671243520 00000100:00100000:0.0:1785774801.900660:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671243520 00000100:00100000:0.0:1785774801.900704:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:0.0:1785774801.900711:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6544:x1872519671243520:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.900800:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6544:x1872519671243520:12345-0@lo:1000:mdt_io00_002.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.900807:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:3.0:1785774801.900963:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243520:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774801.901550:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243648:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1785774801.901583:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.901648:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.907200:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671243648 00000100:00100000:2.0:1785774801.907214:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671243648 00000100:00100000:2.0:1785774801.907296:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1785774801.907306:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6544:x1872519671243648:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774801.914432:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6544:x1872519671243648:12345-0@lo:403:mdt_io00_002.0 Request processed in 7118us (12838us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.914446:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00100000:3.0:1785774801.921012:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243648:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1785774801.924253:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.924270:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.924283:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.924304:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243776:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1785774801.924362:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.924429:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774801.924577:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671243776 00000100:00100000:0.0:1785774801.924585:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671243776 00000100:00100000:0.0:1785774801.924628:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:0.0:1785774801.924638:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6544:x1872519671243776:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1785774801.924654:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.924670:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09eed6 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09eecf expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.924695:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09eed6 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09eecf expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.924709:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09eed6 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09eecf expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.924718:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:0.0:1785774801.924722:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.924725:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2800, rc 0) 00000100:00100000:0.0:1785774801.924765:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6544:x1872519671243776:12345-0@lo:101:mdt_io00_002.0 Request processed in 129us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.924772:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1785774801.924980:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243776:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774801.924995:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.925006:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.925026:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.925105:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.925113:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.925121:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.925132:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243904:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1785774801.925154:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774801.925261:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.931032:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671243904 00000100:00100000:2.0:1785774801.931289:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671243904 00000100:00100000:2.0:1785774801.931399:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:2.0:1785774801.931422:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6544:x1872519671243904:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774801.931445:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774801.931471:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b200/0x7b7109e1d09eee4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09eedd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.931503:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b200/0x7b7109e1d09eee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09eedd expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.931520:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b200/0x7b7109e1d09eee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09eedd expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774801.931529:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x18618557 (ffff9b7605fcb300) 00010000:00010000:2.0:1785774801.931532:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774801.931535:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b200, rc 0) 00000100:00100000:2.0:1785774801.931618:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671243904:12345-0@lo:101:mdt_io00_002.0 Request processed in 199us (6462us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.931625:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:3.0:1785774801.931712:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671243904:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774801.931732:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931744:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774801.931772:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:3.0:1785774801.931792:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931801:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931811:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931833:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931841:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931848:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931890:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931901:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931909:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931936:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.931949:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 26 pid: 8469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.931961:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671244032:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774801.932034:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00010000:00010000:3.0:1785774801.937729:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000fd7ed414 x1872519671244032) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 26 pid: 8469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.937754:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 26 pid: 8469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.937780:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09eeb3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bedd expref: 26 pid: 8469 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.937797:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671244032:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774801.937820:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:3.0:1785774801.937836:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.937845:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.937852:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.937873:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.937881:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774801.937886:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774801.938026:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244160:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774801.938085:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.947087:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671244160 00000100:00100000:0.0:1785774801.947101:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671244160 00000100:00100000:0.0:1785774801.949151:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e180 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.951320:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:1.0:1785774801.951335:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671244160:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.951526:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671244160:12345-0@lo:1000:mdt_io00_002.0 Request processed in 194us (13440us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774801.951535:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:0.0:1785774801.954231:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244160:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.954329:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244288:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.954385:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.954420:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7715f796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.954919:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671244288 00000100:00100000:2.0:1785774801.954926:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671244288 00000100:00100000:2.0:1785774801.954969:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1785774801.954978:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671244288:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.955068:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671244288:12345-0@lo:1000:mdt_io00_002.0 Request processed in 90us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.955080:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:0.0:1785774801.955208:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244288:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.955314:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244416:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.955339:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.955368:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774801.955418:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671244416 00000100:00100000:2.0:1785774801.955422:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671244416 00000100:00100000:2.0:1785774801.955452:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:2.0:1785774801.955458:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671244416:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774801.955505:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671244416:12345-0@lo:1000:mdt_io00_002.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774801.955512:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:0.0:1785774801.955575:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244416:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.955653:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244544:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.955675:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.955697:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.955754:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671244544 00000100:00100000:1.0:1785774801.955758:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671244544 00000100:00100000:1.0:1785774801.955794:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1785774801.955801:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671244544:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.955974:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671244544:12345-0@lo:1000:mdt_io00_002.0 Request processed in 174us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.955981:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:0.0:1785774801.956056:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244544:0@lo:1000:mdt_io00_002.0 00000040:00080000:0.0:1785774801.956421:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].401, 1264 off598840 00000040:00080000:0.0:1785774801.956471:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].400, 1344 off653832 00000100:00100000:0.0:1785774801.956494:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244672:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774801.956520:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774801.956533:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095600 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.956634:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671244672 00000100:00100000:1.0:1785774801.956639:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671244672 00000100:00100000:1.0:1785774801.956669:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1785774801.956676:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671244672:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774801.956766:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671244672:12345-0@lo:1000:mdt_io00_002.0 Request processed in 89us (244us total) trans 4294969886 rc 0/0 00000100:00100000:1.0:1785774801.956776:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1785774801.956805:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671244672:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1785774801.956814:0:6544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7606095d80 with version 760 00000004:00080000:1.0:1785774801.956884:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 760 rpc_version 760 00000020:00100000:1.0:1785774801.956904:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774801.956912:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fa81180 x1872519671244928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774801.956925:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671244928:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774801.956951:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774801.956965:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec780 going to sleep for 11 seconds 00000100:00100000:1.0:1785774801.956977:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671244928 00000100:00100000:1.0:1785774801.956980:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671244928 00000100:00100000:1.0:1785774801.957000:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:1.0:1785774801.957006:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7689:x1872519671244928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774801.957374:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7689:x1872519671244928:12345-0@lo:1000:osp_up1-0.0 Request processed in 367us (420us total) trans 4294968478 rc 0/0 00000100:00100000:1.0:1785774801.957381:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:1.0:1785774801.957416:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671244928:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1785774801.957449:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d05517dd reply state 0000000080e55dd4 transno 4294983588 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957469:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957478:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:1.0:1785774801.957481:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1785774801.957486:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774801.957493:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957500:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957507:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957514:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774801.957518:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957526:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957538:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:1.0:1785774801.957541:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774801.957545:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957552:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09eeeb lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.957577:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d05517dd reply state 0000000080e55dd4 transno 4294983588 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957585:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957591:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7602507300) 00010000:00010000:1.0:1785774801.957594:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774801.957596:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774801.957602:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.957608:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957617:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957625:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957641:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774801.957645:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774801.957652:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774801.957657:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957664:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774801.957667:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774801.957676:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957698:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957704:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774801.957727:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 1/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957740:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09eecf lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09eed6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.957753:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774801.957755:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774801.957756:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774801.957766:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671245056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774801.957795:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774801.959943:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.959959:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774801.959979:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:0.0:1785774801.959990:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.959997:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.960003:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.960008:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.960012:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.960020:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.960033:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7602507600) 00010000:00010000:0.0:1785774801.960036:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.962467:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.962481:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09eec8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774801.962717:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671245056 00000100:00100000:1.0:1785774801.962726:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671245056 00000100:00100000:1.0:1785774801.962785:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1785774801.962795:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+17:3655:x1872519671245056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774801.962810:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774801.962891:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09eed6 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09eecf expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774801.962906:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:1.0:1785774801.962915:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774801.962966:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+16:3655:x1872519671245056:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (5170us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774801.962974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1785774801.963023:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671245056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774801.963985:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18362:x1872519648488448:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 63721us (63993us total) trans 4294983588 rc 0/0 00000100:00100000:0.0:1785774801.963995:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:1.0:1785774801.982396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.982661:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648488576 00000100:00100000:0.0:1785774801.982671:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648488576 00000100:00100000:0.0:1785774801.982731:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23778 00000100:00100000:0.0:1785774801.982741:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18362:x1872519648488576:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:0.0:1785774801.982829:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982846:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982857:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982870:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982877:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982883:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982938:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982947:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.982954:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774801.982999:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983013:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983021:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983026:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983032:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983038:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.983042:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983049:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983060:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0900) 00010000:00010000:0.0:1785774801.983063:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.983067:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983074:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef00 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983092:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983099:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983105:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983109:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.983112:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983118:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983125:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774801.983128:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.983131:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983136:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef07 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983146:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983151:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983156:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983293:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774801.983297:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983303:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983310:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:0.0:1785774801.983313:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774801.983316:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.983321:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ef0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774801.985090:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18362:x1872519648488576:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 2340us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774801.985103:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23778 00000100:00100000:3.0:1785774801.996713:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774801.997025:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648488832 00000100:00100000:0.0:1785774801.997047:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648488832 00000100:00100000:0.0:1785774801.997105:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23779 00000100:00100000:0.0:1785774801.997114:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18362:x1872519648488832:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774801.997135:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774801.997155:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bee4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.997294:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.997311:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.997328:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774801.997339:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1534:0x0]: returning size 2 00010000:00010000:0.0:1785774801.997437:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09ef15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1534:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 30 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.997455:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774801.997464:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:0.0:1785774801.997467:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785774801.997471:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774801.997522:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18362:x1872519648488832:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 409us (819us total) trans 4294983589 rc 0/0 00000100:00100000:0.0:1785774801.997530:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23779 00000100:00100000:1.0:1785774802.016078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.016207:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648488960 00000100:00100000:0.0:1785774802.016218:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648488960 00000100:00100000:0.0:1785774802.016279:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5200 00000100:00100000:0.0:1785774802.016289:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2419:x1872519648488960:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:0.0:1785774802.016331:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.016352:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 12 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.016369:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9c8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785774802.016373:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774802.016378:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.016415:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 12 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.016429:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 12 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774802.016443:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1872519671245184:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774802.016547:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060959c0 going to sleep for 11 seconds 00000100:00080000:1.0:1785774802.016853:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774802.020245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774802.020324:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648489088 00000100:00100000:2.0:1785774802.020332:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648489088 00002000:00100000:2.0:1785774802.020378:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff9b773fa83100 x1872519648489088/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:493/0 lens 496/0 e 0 to 0 dl 1785774813 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774802.020390:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa83100 with x1872519648489088 ext(0->1) 00010000:00010000:2.0:1785774802.020399:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 13 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.020416:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 13 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774802.020425:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b773fa83100 00000100:00100000:2.0:1785774802.020456:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:2.0:1785774802.020465:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648489088:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:0.0:1785774802.021234:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1872519671245184:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774802.021260:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774802.021406:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648489088:12345-192.168.202.31@tcp:4:bash.0 Request processed in 942us (1171us total) trans 4294969884 rc 0/0 00000100:00100000:2.0:1785774802.021415:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00002000:00100000:2.0:1785774802.021422:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff9b773fa83100 x1872519648489088/t4294969884(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:493/0 lens 496/448 e 0 to 0 dl 1785774813 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774802.021431:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa83100 with x1872519648489088 ext(0->1) 00010000:00010000:2.0:1785774802.021438:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 15 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.021450:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 15 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774802.021457:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b773fa83100 00000100:00100000:2.0:1785774802.026256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.026331:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648489216 00000100:00100000:0.0:1785774802.026340:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648489216 00010000:00010000:0.0:1785774802.026379:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 15 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774802.026418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1638 00000100:00100000:0.0:1785774802.026427:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706102850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648489216:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774802.026445:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1785774802.026462:0:6515:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1785774802.026465:0:6515:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1785774799 00002000:00010000:0.0:1785774802.026467:0:6515:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1785774799 00002000:00010000:0.0:1785774802.026469:0:6515:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1785774802.026476:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 15 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.026489:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 15 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.026513:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d09eb41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be3c expref: 15 pid: 8445 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.026531:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774802.026535:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774802.026541:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.026551:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.026588:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774802.026712:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706102850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648489216:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 285us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.026720:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1638 00010000:00010000:1.0:1785774802.026813:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026833:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026878:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026887:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026895:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026902:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774802.026907:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026916:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026929:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.026937:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd1478d/0x7b7109e1d09ef2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774802.026991:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2419:x1872519648488960:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 10703us (10922us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774802.027000:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5200 00000100:00100000:1.0:1785774802.036817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.036962:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648489472 00000100:00100000:3.0:1785774802.036972:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648489472 00000100:00100000:3.0:1785774802.037047:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:3.0:1785774802.037057:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18362:x1872519648489472:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1785774802.037111:0:6542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774802.037139:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09eb33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be35 expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.037156:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff9b7605fd8600) 00000100:00080000:1.0:1785774802.037232:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785774802.039655:0:6542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774802.039693:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.039709:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.039721:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774802.039742:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00000100:00100000:3.0:1785774802.039803:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245312:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774802.039870:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774802.039903:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774802.039999:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671245312 00000100:00100000:0.0:1785774802.040007:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671245312 00000100:00100000:0.0:1785774802.040061:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:0.0:1785774802.040070:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6542:x1872519671245312:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774802.040214:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6542:x1872519671245312:12345-0@lo:1000:mdt_io00_000.0 Request processed in 145us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.040223:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:3.0:1785774802.040345:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245312:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774802.040905:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245440:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1785774802.040941:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774802.040956:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e240 going to sleep for 11 seconds 00000100:00100000:2.0:1785774802.041016:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671245440 00000100:00100000:2.0:1785774802.041021:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671245440 00000100:00100000:2.0:1785774802.041057:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1785774802.041064:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6542:x1872519671245440:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774802.042727:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6542:x1872519671245440:12345-0@lo:403:mdt_io00_000.0 Request processed in 1657us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774802.042739:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1785774802.046332:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245440:0@lo:403:mdt_io00_000.0 00010000:00010000:3.0:1785774802.047030:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.047042:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.047054:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774802.047073:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245568:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785774802.047131:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774802.047216:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774802.047293:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671245568 00000100:00100000:0.0:1785774802.047300:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671245568 00000100:00100000:0.0:1785774802.047350:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1785774802.047359:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6542:x1872519671245568:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1785774802.047376:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774802.047393:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ef3f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ef38 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.047419:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ef3f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ef38 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.047435:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ef3f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ef38 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.047443:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774802.047445:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774802.047449:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3400, rc 0) 00000100:00100000:0.0:1785774802.047493:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6542:x1872519671245568:12345-0@lo:101:mdt_io00_000.0 Request processed in 135us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.047500:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:3.0:1785774802.048135:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245568:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774802.048151:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.048314:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774802.048334:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:2.0:1785774802.050461:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.050476:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.050488:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774802.050511:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245696:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1785774802.050567:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774802.050602:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774802.050708:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671245696 00000100:00100000:3.0:1785774802.050715:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671245696 00000100:00100000:3.0:1785774802.050758:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:3.0:1785774802.050767:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6542:x1872519671245696:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774802.050783:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.050800:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ef4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09ef46 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.050833:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ef4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09ef46 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.050848:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ef4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ef46 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.050857:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xdcc87686 (ffff9b7602507700) 00010000:00010000:3.0:1785774802.050860:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774802.050863:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774802.050911:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:6542:x1872519671245696:12345-0@lo:101:mdt_io00_000.0 Request processed in 144us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774802.050918:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:2.0:1785774802.051034:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245696:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774802.051048:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051059:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774802.051075:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:2.0:1785774802.051095:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051103:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051110:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051120:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051127:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051132:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051219:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051235:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 28 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051242:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051265:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 28 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.051277:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 28 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774802.051287:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671245824:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774802.051347:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbb40 going to sleep for 11 seconds 00010000:00010000:2.0:1785774802.059986:0:6542:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000b5a10968 x1872519671245824) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 28 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.060014:0:6542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 28 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.060049:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09ef1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bee4 expref: 28 pid: 8627 timeout: 1143 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774802.060066:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671245824:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774802.060087:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:2.0:1785774802.060092:0:6542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.060102:0:6542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.060109:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.060127:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.060136:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.060141:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774802.060328:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245952:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.060372:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774802.060452:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00000100:00100000:1.0:1785774802.062294:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671245952 00000100:00100000:1.0:1785774802.062305:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671245952 00000100:00100000:1.0:1785774802.062405:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:1.0:1785774802.062416:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:6542:x1872519671245952:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774802.062580:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:6542:x1872519671245952:12345-0@lo:1000:mdt_io00_000.0 Request processed in 166us (2206us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774802.062587:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1785774802.062654:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671245952:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.062713:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246080:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.062742:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774802.068694:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00000100:00100000:0.0:1785774802.072541:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671246080 00000100:00100000:0.0:1785774802.072556:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671246080 00000100:00100000:0.0:1785774802.072618:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1785774802.072628:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:6542:x1872519671246080:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774802.072751:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:6542:x1872519671246080:12345-0@lo:1000:mdt_io00_000.0 Request processed in 124us (10008us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.072759:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:2.0:1785774802.076496:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246080:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.076639:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246208:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.076694:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774802.076717:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb840 going to sleep for 11 seconds 00000100:00100000:0.0:1785774802.077117:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671246208 00000100:00100000:0.0:1785774802.077124:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671246208 00000100:00100000:0.0:1785774802.077195:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1785774802.077204:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:6542:x1872519671246208:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774802.077271:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:6542:x1872519671246208:12345-0@lo:1000:mdt_io00_000.0 Request processed in 68us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.077279:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:2.0:1785774802.077418:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246208:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.077511:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246336:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.077536:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774802.077549:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774802.077605:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671246336 00000100:00100000:0.0:1785774802.077610:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671246336 00000100:00100000:0.0:1785774802.077642:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:0.0:1785774802.077648:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671246336:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774802.077710:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671246336:12345-0@lo:1000:mdt_io00_000.0 Request processed in 62us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.077716:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1785774802.077776:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246336:0@lo:1000:mdt_io00_000.0 00000040:00080000:2.0:1785774802.078129:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].402, 1264 off600104 00000040:00080000:2.0:1785774802.078219:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].401, 1344 off655176 00000100:00100000:2.0:1785774802.078245:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246464:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.078271:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774802.078283:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774802.078297:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671246464 00000100:00100000:2.0:1785774802.078301:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671246464 00000100:00100000:2.0:1785774802.078323:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1785774802.078328:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671246464:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774802.078418:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6542:x1872519671246464:12345-0@lo:1000:mdt_io00_000.0 Request processed in 88us (145us total) trans 4294969885 rc 0/0 00000100:00100000:2.0:1785774802.078425:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1785774802.078453:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671246464:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1785774802.078461:0:6542:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605ebb240 with version 761 00000004:00080000:1.0:1785774802.078705:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 761 rpc_version 761 00000020:00100000:1.0:1785774802.078728:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774802.078736:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fa80e00 x1872519671246720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774802.078750:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671246720:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774802.078782:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774802.078806:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec780 going to sleep for 11 seconds 00000100:00100000:1.0:1785774802.078817:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671246720 00000100:00100000:1.0:1785774802.078830:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671246720 00000100:00100000:1.0:1785774802.078861:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:1.0:1785774802.078868:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:7689:x1872519671246720:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774802.079341:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:7689:x1872519671246720:12345-0@lo:1000:osp_up1-0.0 Request processed in 472us (556us total) trans 4294968479 rc 0/0 00000100:00100000:1.0:1785774802.079352:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1785774802.079447:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671246720:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1785774802.080952:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc876be3 reply state 00000000d835ded1 transno 4294983590 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.080975:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.080985:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774802.080987:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1785774802.080992:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774802.081001:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081009:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081015:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081022:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081028:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.081032:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081050:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081061:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fcb700) 00010000:00010000:1.0:1785774802.081063:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.081068:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081074:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09ef54 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774802.081094:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc876be3 reply state 00000000d835ded1 transno 4294983590 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081102:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081108:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7605fcbe00) 00010000:00010000:1.0:1785774802.081110:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774802.081112:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774802.081116:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774802.081123:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081131:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081137:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081193:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774802.081198:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xcf:0x0] 00010000:00010000:1.0:1785774802.081203:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081210:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774802.081225:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x18b:0x0] 00010000:00010000:1.0:1785774802.081232:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081238:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081243:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081249:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.081251:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081258:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081266:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7602507f00) 00010000:00010000:1.0:1785774802.081269:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.081271:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.081277:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09ef31 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774802.081362:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18362:x1872519648489472:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 44304us (44550us total) trans 4294983590 rc 0/0 00000100:00100000:1.0:1785774802.081370:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 6 00010000:00010000:0.0:1785774802.081699:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774802.081706:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.081713:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774802.081718:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774802.081726:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.081756:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.081762:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774802.081784:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.081791:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0200/0x7b7109e1d09ef38 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ef3f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.081805:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774802.081807:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774802.081808:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774802.081832:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671246848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774802.081880:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774802.081927:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671246848 00000100:00100000:0.0:1785774802.081934:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671246848 00000100:00100000:0.0:1785774802.081972:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1785774802.081980:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+19:3656:x1872519671246848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774802.081992:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774802.082009:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ef3f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ef38 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.082019:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774802.082027:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774802.082068:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+18:3656:x1872519671246848:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.082074:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1785774802.082109:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671246848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774802.093266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.093401:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648489728 00000100:00100000:3.0:1785774802.093411:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648489728 00000100:00100000:3.0:1785774802.093463:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5087 00000100:00100000:3.0:1785774802.093473:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18362:x1872519648489728:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1785774802.094392:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18362:x1872519648489728:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 917us (1132us total) trans 4294968480 rc 0/0 00000100:00100000:3.0:1785774802.094403:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5087 00000100:00100000:1.0:1785774802.142016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.142224:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648489984 00000100:00100000:0.0:1785774802.142234:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648489984 00000100:00100000:0.0:1785774802.142286:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23780 00000100:00100000:0.0:1785774802.142298:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18363:x1872519648489984:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774802.142322:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774802.142343:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ef69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259beeb expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142410:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142425:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142436:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142449:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142456:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142462:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142536:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ef7e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142545:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ef7e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142553:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ef7e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142567:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142574:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142581:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142588:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142594:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774802.142598:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142606:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142616:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774802.142619:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774802.142623:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142630:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09ef70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142641:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142646:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142651:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142657:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774802.142659:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142665:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142672:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774802.142674:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774802.142677:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142683:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ef77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142711:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ef69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beeb expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142723:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ef7e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beeb expref: 30 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.142732:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7702bc0b00) 00010000:00010000:0.0:1785774802.142735:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774802.142737:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2200, rc 0) 00000100:00100000:0.0:1785774802.142878:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18363:x1872519648489984:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 581us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.142885:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23780 00000100:00100000:0.0:1785774802.152284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.152335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.152418:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648490240 00000100:00100000:1.0:1785774802.152429:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648490240 00000100:00100000:1.0:1785774802.152487:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23781 00000100:00100000:1.0:1785774802.152497:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18363:x1872519648490240:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774802.152524:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.152547:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09ef85 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bef2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774802.152703:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:1.0:1785774802.152788:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09ef85 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bef2 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.152802:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774802.152805:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774802.152810:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09ef85 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bef2 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774802.152823:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648490368 00010000:00010000:1.0:1785774802.152827:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:3.0:1785774802.152836:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648490368 00000100:00100000:3.0:1785774802.152873:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1442 00000100:00100000:1.0:1785774802.152879:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18363:x1872519648490240:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 385us (611us total) trans 4294968481 rc 301/301 00000100:00100000:3.0:1785774802.152880:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2418:x1872519648490368:12345-192.168.202.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1785774802.152887:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23781 00010000:00010000:3.0:1785774802.152889:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774802.152905:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ef7e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259beeb expref: 30 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.152916:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7702bc0b00) 00010000:00010000:3.0:1785774802.152919:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774802.152938:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:2418:x1872519648490368:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 59us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774802.152943:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1442 00000100:00100000:2.0:1785774802.170095:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.170288:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648490496 00000100:00100000:0.0:1785774802.170297:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648490496 00000100:00100000:0.0:1785774802.170358:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5088 00000100:00100000:0.0:1785774802.170372:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18363:x1872519648490496:12345-192.168.202.31@tcp:33:lfs.0 00000004:00200000:0.0:1785774802.170512:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:0.0:1785774802.170517:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:0.0:1785774802.170601:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18363:x1872519648490496:12345-192.168.202.31@tcp:33:lfs.0 Request processed in 229us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.170607:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5088 00000100:00100000:1.0:1785774802.210284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774802.210968:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648490752 00000100:00100000:2.0:1785774802.210979:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648490752 00000100:00100000:2.0:1785774802.211048:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5089 00000100:00100000:2.0:1785774802.211058:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732245050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18363:x1872519648490752:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1785774802.211320:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732245050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18363:x1872519648490752:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 263us (1044us total) trans 4294968482 rc 0/0 00000100:00100000:2.0:1785774802.211329:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5089 00000100:00100000:2.0:1785774802.219036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.219329:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648490880 00000100:00100000:3.0:1785774802.219340:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648490880 00000100:00100000:3.0:1785774802.219455:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23782 00000100:00100000:3.0:1785774802.219467:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18204:x1872519648490880:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774802.219491:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.219514:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09ef93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bef9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.219578:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ef9a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.219592:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ef9a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.219604:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ef9a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774802.219682:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:3.0:1785774802.219687:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:3.0:1785774802.219707:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ef9a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.219730:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09ef93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bef9 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.219768:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ef9a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bef9 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.219777:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:3.0:1785774802.219780:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774802.219789:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774802.219856:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18204:x1872519648490880:12345-192.168.202.31@tcp:101:bash.0 Request processed in 391us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774802.219863:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23782 00000100:00100000:3.0:1785774802.242500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.242607:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648491008 00000100:00100000:0.0:1785774802.242618:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648491008 00000100:00100000:0.0:1785774802.242680:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23783 00000100:00100000:0.0:1785774802.242690:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18204:x1872519648491008:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774802.242712:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774802.242736:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09efa1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf00 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.242802:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09efa8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.242816:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09efa8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.243099:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09efa8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774802.243149:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xcf:0x0]: returning size 4096 00000004:00200000:0.0:1785774802.243154:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1785774802.243326:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09efa1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf00 expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.243345:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09efa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf00 expref: 12 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.243355:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774802.243358:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774802.243362:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774802.243467:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18204:x1872519648491008:12345-192.168.202.31@tcp:101:bash.0 Request processed in 778us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.243474:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23783 00000100:00100000:0.0:1785774802.255156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774802.255485:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648491136 00000100:00100000:2.0:1785774802.255496:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648491136 00000100:00100000:1.0:1785774802.255631:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23784 00000100:00100000:1.0:1785774802.255643:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18204:x1872519648491136:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774802.255663:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.255685:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09efaf lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf07 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.256524:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.256538:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.256549:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774802.256596:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd1:0x0]: returning size 4096 00000004:00200000:1.0:1785774802.256600:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1785774802.256635:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09efaf lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.256651:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 30 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.256659:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774802.256661:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774802.256665:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:1.0:1785774802.256718:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648491136:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1078us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774802.256724:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23784 00000100:00100000:0.0:1785774802.273698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.273950:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648491392 00000100:00100000:3.0:1785774802.273962:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648491392 00000100:00100000:3.0:1785774802.274040:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23785 00000100:00100000:3.0:1785774802.274052:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18204:x1872519648491392:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774802.274074:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.274097:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09efbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf0e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.274300:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09efc4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.274315:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09efc4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.274327:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09efc4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774802.274343:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:3.0:1785774802.274447:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09efbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf0e expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.274475:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09efc4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf0e expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.274484:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:3.0:1785774802.274487:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785774802.274490:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:3.0:1785774802.274540:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18204:x1872519648491392:12345-192.168.202.31@tcp:101:bash.0 Request processed in 491us (852us total) trans 4294968483 rc 0/0 00000100:00100000:3.0:1785774802.274548:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23785 00000100:00100000:0.0:1785774802.334780:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.334879:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648491520 00000100:00100000:1.0:1785774802.334889:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648491520 00000100:00100000:1.0:1785774802.334949:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5090 00000100:00100000:1.0:1785774802.334959:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18204:x1872519648491520:12345-192.168.202.31@tcp:37:bash.0 00000100:00100000:1.0:1785774802.344008:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18204:x1872519648491520:12345-192.168.202.31@tcp:37:bash.0 Request processed in 9041us (9228us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774802.344022:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5090 00000100:00100000:0.0:1785774802.366675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774802.373922:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648491648 00000100:00100000:2.0:1785774802.373936:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648491648 00000100:00100000:3.0:1785774802.374283:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5091 00000100:00100000:3.0:1785774802.374295:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648491648:12345-192.168.202.31@tcp:37:bash.0 00000100:00100000:3.0:1785774802.398852:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648491648:12345-192.168.202.31@tcp:37:bash.0 Request processed in 24549us (32180us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774802.398867:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5091 00000100:00100000:0.0:1785774802.434704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.435847:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648491776 00000100:00100000:3.0:1785774802.435858:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648491776 00000100:00100000:3.0:1785774802.435946:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23786 00000100:00100000:3.0:1785774802.435971:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648491776:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774802.435998:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.436019:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09efd2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf15 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436119:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436135:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436151:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436195:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436205:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436212:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436257:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436265:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436271:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436278:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436284:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774802.436289:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436298:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436317:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774802.436321:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774802.436325:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436337:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09efd9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436355:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436361:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436380:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436385:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774802.436389:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436395:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436406:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xeddcfc6c (ffff9b7602507000) 00010000:00010000:3.0:1785774802.436409:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774802.436413:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436419:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09efe0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436483:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09efd2 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf15 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436503:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774802.436505:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774802.436509:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09efd2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf15 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.436520:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774802.436601:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648491776:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 646us (1906us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774802.436609:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23786 00000100:00100000:0.0:1785774802.444280:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.444362:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648491904 00000100:00100000:3.0:1785774802.444383:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648491904 00000100:00100000:3.0:1785774802.444539:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23787 00000100:00100000:3.0:1785774802.444550:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18365:x1872519648491904:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774802.444864:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.444895:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09efe7 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf1c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.444970:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.444988:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.444999:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445013:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445019:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445025:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445077:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445083:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445089:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445095:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445101:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774802.445105:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445113:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445125:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:3.0:1785774802.445128:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774802.445132:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445138:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09efee lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445155:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445204:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445211:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445217:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774802.445220:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445227:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445234:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xeddcfc6c (ffff9b7602507a00) 00010000:00010000:3.0:1785774802.445236:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774802.445239:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445244:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09eff5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445281:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09efe7 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf1c expref: 15 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445291:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:3.0:1785774802.445294:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774802.445297:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09efe7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf1c expref: 15 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.445307:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:3.0:1785774802.445363:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18365:x1872519648491904:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 815us (1093us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774802.445848:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23787 00000100:00100000:1.0:1785774802.466132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.485536:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648492032 00000100:00100000:0.0:1785774802.485550:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648492032 00000100:00100000:1.0:1785774802.498965:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23788 00000100:00100000:1.0:1785774802.498989:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648492032:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774802.499010:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.499031:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09effc lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf23 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499093:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499107:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499118:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499133:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499140:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499146:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499215:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499224:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499229:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499236:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499241:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.499245:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499253:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499265:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774802.499268:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.499273:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499279:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f003 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499292:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499297:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499302:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499306:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.499309:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499313:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499319:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x3491cd4c (ffff9b7605fd8900) 00010000:00010000:1.0:1785774802.499322:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.499324:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499329:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f00a lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499359:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09effc lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf23 expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499369:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774802.499371:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774802.499374:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09effc lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf23 expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.499383:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce200, rc 0) 00000100:00100000:1.0:1785774802.499462:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648492032:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 484us (33338us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774802.499470:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23788 00000100:00100000:2.0:1785774802.511564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.511665:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648492160 00000100:00100000:1.0:1785774802.511680:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648492160 00000100:00100000:1.0:1785774802.511836:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23789 00000100:00100000:1.0:1785774802.511852:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18365:x1872519648492160:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774802.511880:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.511918:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f011 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf2a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512115:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512129:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512140:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512153:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512204:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512212:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512251:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512258:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512263:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512271:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512276:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.512281:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512287:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512298:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:1.0:1785774802.512301:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.512305:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512313:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f018 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512325:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512332:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512338:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512343:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.512346:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512356:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512362:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x3491cd4c (ffff9b7605fd8900) 00010000:00010000:1.0:1785774802.512364:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.512366:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512483:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f01f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512673:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f011 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf2a expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512685:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:1.0:1785774802.512687:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774802.512691:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f011 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf2a expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.512708:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce200, rc 0) 00000100:00100000:1.0:1785774802.513666:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18365:x1872519648492160:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 921us (1214us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774802.513676:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23789 00000100:00100000:0.0:1785774802.535532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.537957:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648492288 00000100:00100000:3.0:1785774802.537969:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648492288 00000100:00100000:3.0:1785774802.538050:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23790 00000100:00100000:3.0:1785774802.538061:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648492288:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774802.538081:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.538101:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f026 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf31 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538408:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538423:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538436:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538451:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538458:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538464:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538504:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538511:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538517:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538524:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538529:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774802.538533:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538540:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538550:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774802.538553:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774802.538556:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538563:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f02d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538582:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538588:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538594:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538599:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774802.538602:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538608:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538615:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x3735a305 (ffff9b7602507a00) 00010000:00010000:3.0:1785774802.538617:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774802.538620:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538624:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f034 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538670:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f026 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf31 expref: 31 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538686:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774802.538688:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774802.538692:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f026 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf31 expref: 31 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.538702:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:2.0:1785774802.540339:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648492288:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 2272us (4807us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774802.540351:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23790 00000100:00100000:2.0:1785774802.552939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.561934:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648492416 00000100:00100000:1.0:1785774802.561949:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648492416 00000100:00100000:1.0:1785774802.562205:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23791 00000100:00100000:1.0:1785774802.562217:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18365:x1872519648492416:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774802.562244:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.562267:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f03b lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf38 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562340:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562357:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562379:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562394:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562401:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562407:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562453:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562461:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562467:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562474:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562480:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.562491:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562498:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562510:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:1.0:1785774802.562513:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.562517:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562523:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f042 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562536:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562542:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562547:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.562552:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.562554:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.564036:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.564059:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x3735a305 (ffff9b7605fd8900) 00010000:00010000:1.0:1785774802.564062:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.564066:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.564073:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f049 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.564115:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f03b lrc: 1/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf38 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.564125:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:1.0:1785774802.564128:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774802.564131:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f03b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf38 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.564140:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774802.564233:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18365:x1872519648492416:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 2017us (11302us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774802.564242:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23791 00000100:00100000:1.0:1785774802.588009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774802.588301:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648492672 00000100:00100000:2.0:1785774802.588311:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648492672 00000100:00100000:2.0:1785774802.588375:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23792 00000100:00100000:2.0:1785774802.588384:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648492672:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774802.588408:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774802.588429:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f050 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf3f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588508:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588523:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588534:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588546:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588553:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588558:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588596:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588604:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588610:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588616:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588621:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774802.588625:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588631:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588641:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:2.0:1785774802.588645:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774802.588649:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588654:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f057 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588668:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588673:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588677:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588681:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774802.588683:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588688:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588692:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7605fcbe00) 00010000:00010000:2.0:1785774802.588694:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774802.588697:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588701:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09f05e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588726:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f050 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf3f expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.588735:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:2.0:1785774802.588737:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774802.590350:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f050 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf3f expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.590371:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a600, rc 0) 00000100:00100000:2.0:1785774802.590441:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18365:x1872519648492672:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 2057us (2441us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774802.590449:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23792 00000100:00100000:1.0:1785774802.603024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.606202:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648492928 00000100:00100000:3.0:1785774802.606216:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648492928 00000100:00100000:3.0:1785774802.606281:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23793 00000100:00100000:3.0:1785774802.606290:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18365:x1872519648492928:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774802.606310:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.606330:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09f065 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf46 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606404:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606417:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606429:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606440:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606450:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ef4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ef46 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606463:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606499:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ef4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ef46 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774802.606513:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671246976:0@lo:104: 00000100:00100000:3.0:1785774802.606573:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774802.606623:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d0e180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774802.606642:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671246976 00000100:00100000:3.0:1785774802.606646:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671246976 00000100:00100000:3.0:1785774802.606676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1785774802.606682:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8627:x1872519671246976:12345-0@lo:104: 00010000:00010000:3.0:1785774802.606695:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606742:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774802.606748:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8627:x1872519671246976:12345-0@lo:104: Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774802.606755:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00010000:00010000:3.0:1785774802.606778:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774802.606784:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.606791:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774802.606797:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774802.606811:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.607111:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.607118:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774802.607144:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.607151:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a400/0x7b7109e1d09ef46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ef4d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.607198:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774802.607200:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774802.607202:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774802.607210:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774802.607221:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671247104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774802.607251:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774802.607280:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671247104 00000100:00100000:3.0:1785774802.607284:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671247104 00010000:00010000:3.0:1785774802.607301:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ef4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09ef46 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774802.607329:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:3.0:1785774802.607336:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+18:3654:x1872519671247104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774802.607345:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1785774802.607488:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671246976:0@lo:104: 00010000:00010000:3.0:1785774802.607506:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612111:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774802.612131:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612216:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612223:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774802.612243:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09ec67 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09ec6e expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774802.612262:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968483 is committed 00000001:00080000:2.0:1785774802.612277:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968479 is committed 00010000:00010000:2.0:1785774802.612353:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d09ef4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09ef46 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612372:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xdcc87686 (ffff9b7602507700) 00010000:00010000:2.0:1785774802.612377:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612386:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612395:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612419:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774802.612486:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671247104:12345-0@lo:103:ldlm_bl.0 Request processed in 5148us (5233us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774802.612497:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00010000:00010000:2.0:1785774802.612528:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612535:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612648:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f07a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612658:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f07a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.612666:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f07a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774802.612675:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x191:0x0]: returning size 2 00000100:00100000:3.0:1785774802.612983:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671247232:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1785774802.613037:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774802.613090:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671247104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774802.613255:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671247232 00000100:00100000:0.0:1785774802.613262:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671247232 00000100:00100000:0.0:1785774802.613317:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1785774802.613326:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3654:x1872519671247232:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1785774802.613339:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774802.613354:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09ec6e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09ec67 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.613366:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:0.0:1785774802.613627:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774802.613668:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671247232:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 344us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.613676:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1785774802.614142:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671247232:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1785774802.614982:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.614991:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.614997:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615009:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615015:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774802.615019:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615026:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615250:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:2.0:1785774802.615254:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774802.615258:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615265:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744800/0x7b7109e1d09f06c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615280:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615286:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615292:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615296:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774802.615299:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615309:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615315:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xdcc87686 (ffff9b7602507700) 00010000:00010000:2.0:1785774802.615317:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774802.615320:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615326:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d09f073 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615390:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d09f065 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf46 expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615407:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f07a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf46 expref: 11 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.615415:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:2.0:1785774802.615417:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774802.615420:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044a00, rc 0) 00000100:00100000:2.0:1785774802.615517:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18365:x1872519648492928:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 9227us (12503us total) trans 4294968484 rc 0/0 00000100:00100000:2.0:1785774802.615526:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23793 00000100:00100000:1.0:1785774802.650552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.651293:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648493056 00000100:00100000:3.0:1785774802.651303:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648493056 00000100:00100000:3.0:1785774802.651362:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5201 00000100:00100000:3.0:1785774802.651371:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2418:x1872519648493056:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774802.651391:0:14530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774802.651411:0:14530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf4d expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774802.651447:0:14530:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x6a70c2cf, atime: 0x0, ctime: 0x6a70c2cf, blocks: 0x8 00010000:00010000:3.0:1785774802.651467:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=1044s v=(0 0) 00010000:00010000:3.0:1785774802.651471:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774802.651480:0:14530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 14 pid: 14530 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.651507:0:14530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 14 pid: 14530 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.651520:0:14530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:3.0:1785774802.651682:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648493056:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 311us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774802.651690:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5201 00000100:00100000:1.0:1785774802.667133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.667275:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648493184 00000100:00100000:3.0:1785774802.667285:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648493184 00002000:00100000:3.0:1785774802.667333:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff9b773fa82d80 x1872519648493184/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1785774813 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774802.667343:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa82d80 with x1872519648493184 ext(0->4095) 00002000:00010000:3.0:1785774802.667349:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fa82d80 00000100:00100000:3.0:1785774802.667584:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2 00000100:00100000:3.0:1785774802.667594:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648493184:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:3.0:1785774802.667774:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648493184:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 181us (650us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785774802.667783:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2 00002000:00100000:3.0:1785774802.667789:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff9b773fa82d80 x1872519648493184/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1785774813 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774802.667797:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa82d80 with x1872519648493184 ext(0->4095) 00002000:00010000:3.0:1785774802.667801:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fa82d80 00000100:00100000:2.0:1785774802.713134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.713702:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648493440 00000100:00100000:1.0:1785774802.713712:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648493440 00000100:00100000:1.0:1785774802.713773:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5092 00000100:00100000:1.0:1785774802.713783:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18365:x1872519648493440:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:1.0:1785774802.714863:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18365:x1872519648493440:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 1077us (1734us total) trans 4294968485 rc 0/0 00000100:00100000:1.0:1785774802.714874:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5092 00010000:00010000:2.0:1785774802.725150:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774802.775232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.775317:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648493568 00000100:00100000:0.0:1785774802.775327:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648493568 00000100:00100000:0.0:1785774802.775389:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3781 00000100:00100000:0.0:1785774802.775398:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2418:x1872519648493568:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:0.0:1785774802.775448:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774802.775468:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f08f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf54 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775528:0:20645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775540:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775551:0:20645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775571:0:20645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775578:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775583:0:20645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775632:0:20645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775638:0:20645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775643:0:20645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775648:0:20645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774802.775652:0:20645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775658:0:20645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775667:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774802.775669:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774802.775672:0:20645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775678:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775687:0:20645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775692:0:20645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775697:0:20645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775701:0:20645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774802.775703:0:20645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775708:0:20645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775714:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7702bc0900) 00010000:00010000:0.0:1785774802.775717:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774802.775719:0:20645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775724:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f09d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775752:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f08f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf54 expref: 31 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775768:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774802.775770:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774802.775774:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f08f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf54 expref: 31 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.775783:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2e00, rc -2) 00000100:00100000:0.0:1785774802.775856:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2418:x1872519648493568:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 458us (693us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774802.775864:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3781 00000100:00100000:2.0:1785774802.789080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.789209:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648493824 00000100:00100000:1.0:1785774802.789219:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648493824 00000100:00100000:1.0:1785774802.789275:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23794 00000100:00100000:1.0:1785774802.789283:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18367:x1872519648493824:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774802.789303:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.789322:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f0a4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf8c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789404:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789417:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789427:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789445:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789451:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789457:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789503:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789509:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789514:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789520:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789525:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.789528:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789534:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789543:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774802.789545:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.789549:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789555:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0ab lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789693:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789699:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789706:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789712:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.789715:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789721:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789729:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7605fd8e00) 00010000:00010000:1.0:1785774802.789732:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.789735:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789740:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0b2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789771:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f0a4 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf8c expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789782:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774802.789784:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774802.789787:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f0a4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf8c expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.789796:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cec00, rc 0) 00000100:00100000:1.0:1785774802.791121:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18367:x1872519648493824:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 1833us (2045us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774802.791135:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23794 00000100:00100000:2.0:1785774802.804095:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.804515:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648494080 00000100:00100000:1.0:1785774802.804525:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648494080 00000100:00100000:1.0:1785774802.804580:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23795 00000100:00100000:1.0:1785774802.804591:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18367:x1872519648494080:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774802.804615:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.804635:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f0b9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.804701:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.804714:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.804724:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.804735:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.804745:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09ee12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ee0b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.804753:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.804784:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09ee12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ee0b expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774802.804804:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671247360:0@lo:104: 00000100:00100000:1.0:1785774802.805921:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774802.805981:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cecd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774802.806348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671247360 00000100:00100000:2.0:1785774802.806354:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671247360 00000100:00100000:2.0:1785774802.806398:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1785774802.806406:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671247360:12345-0@lo:104: 00010000:00010000:2.0:1785774802.806420:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.806496:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785774802.806503:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671247360:12345-0@lo:104: Request processed in 98us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774802.806510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00010000:00010000:0.0:1785774802.806568:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774802.806576:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.806585:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774802.806590:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774802.806599:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.806628:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.806636:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774802.806666:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.806678:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce000/0x7b7109e1d09ee0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ee12 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.806695:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774802.806697:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774802.806698:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774802.806706:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774802.806718:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671247488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774802.806750:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774802.806782:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671247488 00000100:00100000:0.0:1785774802.806785:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671247488 00010000:00010000:0.0:1785774802.806804:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09ee12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09ee0b expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774802.806837:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:0.0:1785774802.806844:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3656:x1872519671247488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774802.806854:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1785774802.808257:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671247360:0@lo:104: 00010000:00010000:1.0:1785774802.808285:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774802.812153:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968485 is committed 00010000:00010000:3.0:1785774802.812363:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09ee12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09ee0b expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.812382:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xbc0ca3a9 (ffff9b7605fcb100) 00010000:00010000:3.0:1785774802.812388:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.812397:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.812409:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.812442:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774802.812520:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3656:x1872519671247488:12345-0@lo:103:ldlm_bl.0 Request processed in 5675us (5767us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774802.812529:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:0.0:1785774802.812678:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671247488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774802.812761:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.812770:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.812890:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f0ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.812902:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f0ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.812910:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f0ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774802.812920:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18e:0x0]: returning size 2 00010000:00010000:1.0:1785774802.813023:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813137:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813145:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813153:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813295:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.813300:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813308:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813318:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:1.0:1785774802.813321:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.813325:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813332:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0c0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813342:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813348:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813354:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813360:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774802.813362:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813372:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813379:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xbc0ca3a9 (ffff9b7605fcb100) 00010000:00010000:1.0:1785774802.813382:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774802.813385:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813391:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813865:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f0b9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf93 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813884:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f0ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf93 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.813892:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff9b7605fccc00) 00010000:00010000:1.0:1785774802.813894:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774802.813897:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00000100:00100000:1.0:1785774802.817965:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18367:x1872519648494080:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 9358us (9861us total) trans 4294968486 rc 0/0 00000100:00100000:1.0:1785774802.817990:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23795 00000100:00100000:3.0:1785774802.820288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774802.820535:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648494208 00000100:00100000:2.0:1785774802.820545:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648494208 00000100:00100000:2.0:1785774802.820611:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5202 00000100:00100000:2.0:1785774802.820620:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648494208:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774802.820638:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774802.820658:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bf9a expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774802.820680:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x6a70c2cf, atime: 0x0, ctime: 0x6a70c2cf, blocks: 0x8 00010000:00010000:2.0:1785774802.820699:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=1044s v=(0 0) 00010000:00010000:2.0:1785774802.820704:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774802.820713:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 13 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.820729:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 13 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.820748:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045200, rc 0) 00000100:00100000:2.0:1785774802.820802:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2418:x1872519648494208:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 183us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774802.820810:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5202 00000100:00080000:0.0:1785774802.821134:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774802.849521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774802.849679:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648494336 00000100:00100000:0.0:1785774802.849689:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648494336 00002000:00100000:0.0:1785774802.849735:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff9b760471d880 x1872519648494336/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1785774813 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774802.849747:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d880 with x1872519648494336 ext(0->4095) 00002000:00010000:0.0:1785774802.849753:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d880 00000100:00100000:0.0:1785774802.849796:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:0.0:1785774802.849806:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2419:x1872519648494336:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:0.0:1785774802.850270:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2419:x1872519648494336:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 464us (756us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1785774802.850278:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3 00002000:00100000:0.0:1785774802.850284:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff9b760471d880 x1872519648494336/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1785774813 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774802.850292:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d880 with x1872519648494336 ext(0->4095) 00002000:00010000:0.0:1785774802.850296:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d880 00000100:00100000:2.0:1785774802.878231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774802.878782:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648494592 00000100:00100000:3.0:1785774802.878792:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648494592 00000100:00100000:3.0:1785774802.879017:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5093 00000100:00100000:3.0:1785774802.879040:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18367:x1872519648494592:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:3.0:1785774802.879425:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18367:x1872519648494592:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 396us (1261us total) trans 4294968487 rc 0/0 00000100:00100000:3.0:1785774802.879444:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5093 00000100:00100000:3.0:1785774802.946352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774802.946454:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648494848 00000100:00100000:2.0:1785774802.946464:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648494848 00000100:00100000:2.0:1785774802.946522:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23796 00000100:00100000:2.0:1785774802.946531:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18371:x1872519648494848:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774802.946554:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774802.946575:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f0e3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfa1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946645:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946659:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946670:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946681:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946687:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946694:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946733:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946739:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946745:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946752:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946757:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774802.946761:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946779:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946790:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:2.0:1785774802.946793:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774802.946798:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.946804:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f0ea lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947110:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947119:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947125:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947131:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774802.947134:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947141:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947151:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7605fd8d00) 00010000:00010000:2.0:1785774802.947153:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774802.947156:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947369:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f0f1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947400:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f0e3 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfa1 expref: 31 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947411:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:2.0:1785774802.947414:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774802.947418:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f0e3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfa1 expref: 31 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.947443:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045600, rc 0) 00000100:00100000:2.0:1785774802.947508:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18371:x1872519648494848:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 977us (1357us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774802.947516:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23796 00000100:00100000:2.0:1785774802.962356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774802.962565:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648495104 00000100:00100000:1.0:1785774802.962576:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648495104 00000100:00100000:1.0:1785774802.962636:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23797 00000100:00100000:1.0:1785774802.962645:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18371:x1872519648495104:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774802.962672:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774802.962693:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0f8 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfa8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.962786:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.962802:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.962943:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.963013:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.963025:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eda9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09eda2 expref: 8 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.963088:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774802.963121:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09eda2 expref: 8 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774802.963138:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671247616:0@lo:104: 00000100:00100000:1.0:1785774802.963220:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774802.963352:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cecd80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774802.965909:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671247616 00000100:00100000:3.0:1785774802.965920:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671247616 00000100:00100000:2.0:1785774802.969694:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1785774802.969708:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6529:x1872519671247616:12345-0@lo:104: 00010000:00010000:2.0:1785774802.969730:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774802.969845:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785774802.969852:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6529:x1872519671247616:12345-0@lo:104: Request processed in 148us (6632us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774802.969858:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:3.0:1785774802.969937:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671247616:0@lo:104: 00010000:00010000:3.0:1785774802.969961:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.970607:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774802.970615:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.970625:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774802.970631:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774802.970640:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.970676:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.970683:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774802.970714:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.970729:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfe00/0x7b7109e1d09eda2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09eda9 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.970748:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774802.970750:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774802.970752:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774802.970769:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774802.970782:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671247744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774802.970831:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774802.970866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671247744 00000100:00100000:0.0:1785774802.970871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671247744 00010000:00010000:0.0:1785774802.970892:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09eda2 expref: 9 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774802.970914:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1785774802.970921:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3655:x1872519671247744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774802.970932:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1785774802.975554:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968487 is committed 00010000:00010000:3.0:1785774802.982712:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09eda9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09eda2 expref: 9 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.982741:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x84832a57 (ffff9b7602507500) 00010000:00010000:3.0:1785774802.982746:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.982755:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.983088:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.986704:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774802.986807:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3655:x1872519671247744:12345-0@lo:103:ldlm_bl.0 Request processed in 15881us (15970us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774802.988618:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:2.0:1785774802.989150:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671247744:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774802.990998:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774802.991012:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992138:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f10d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992156:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f10d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992280:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f10d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774802.992294:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18d:0x0]: returning size 3 00010000:00010000:0.0:1785774802.992388:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992396:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992403:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992411:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992417:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774802.992421:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992427:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992545:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774802.992548:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774802.992553:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992559:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f0ff lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992572:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992578:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992583:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992588:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774802.992590:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992596:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992601:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x84832a57 (ffff9b7602507500) 00010000:00010000:0.0:1785774802.992604:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774802.992606:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992612:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f106 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992657:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f0f8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfa8 expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992669:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f10d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfa8 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774802.992676:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774802.992678:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774802.992681:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2e00, rc 0) 00000100:00100000:0.0:1785774802.992791:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18371:x1872519648495104:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 30146us (30443us total) trans 4294968488 rc 0/0 00000100:00100000:0.0:1785774802.992800:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23797 00000100:00100000:1.0:1785774803.006460:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.006646:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648495232 00000100:00100000:0.0:1785774803.006656:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648495232 00000100:00100000:0.0:1785774803.006716:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5203 00000100:00100000:0.0:1785774803.006727:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2419:x1872519648495232:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774803.006745:0:8661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.006774:0:8661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfaf expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774803.006800:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 3, mtime: 0x6a70c2cf, atime: 0x0, ctime: 0x6a70c2cf, blocks: 0x8 00010000:00010000:0.0:1785774803.006978:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=1044s v=(0 0) 00010000:00010000:0.0:1785774803.006985:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774803.006994:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 14 pid: 8661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.007014:0:8661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 14 pid: 8661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.007027:0:8661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3600, rc 0) 00000100:00100000:0.0:1785774803.007094:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2419:x1872519648495232:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 368us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.007101:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5203 00000100:00100000:0.0:1785774803.029834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.030026:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648495360 00000100:00100000:3.0:1785774803.030045:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648495360 00002000:00100000:3.0:1785774803.030090:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff9b76062c2680 x1872519648495360/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1785774814 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774803.030102:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76062c2680 with x1872519648495360 ext(0->4095) 00002000:00010000:3.0:1785774803.030107:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76062c2680 00000100:00100000:3.0:1785774803.030144:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:3.0:1785774803.030153:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648495360:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:3.0:1785774803.030350:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648495360:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 197us (535us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785774803.030357:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4 00002000:00100000:3.0:1785774803.030363:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff9b76062c2680 x1872519648495360/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1785774814 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774803.030371:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76062c2680 with x1872519648495360 ext(0->4095) 00002000:00010000:3.0:1785774803.030375:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76062c2680 00000100:00100000:2.0:1785774803.055716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.055929:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648495616 00000100:00100000:0.0:1785774803.055939:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648495616 00000100:00100000:0.0:1785774803.056007:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5094 00000100:00100000:0.0:1785774803.056015:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732244c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18371:x1872519648495616:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:0.0:1785774803.056339:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732244c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18371:x1872519648495616:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 324us (632us total) trans 4294968489 rc 0/0 00000100:00100000:0.0:1785774803.056347:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5094 00000100:00080000:1.0:1785774803.058620:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774803.104311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774803.104732:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648495872 00000100:00100000:1.0:1785774803.104743:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648495872 00000100:00100000:1.0:1785774803.104814:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23798 00000100:00100000:1.0:1785774803.104832:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18373:x1872519648495872:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774803.104853:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774803.104875:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f122 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfb6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.104954:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.104968:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.104980:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.104990:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.104998:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105004:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105044:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105051:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105062:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105069:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105076:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.105081:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105088:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105099:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774803.105102:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.105106:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105111:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f129 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105124:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105129:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105135:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105139:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.105142:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105148:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105154:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7605fcb500) 00010000:00010000:1.0:1785774803.105156:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.105212:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105219:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f130 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105250:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f122 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfb6 expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105261:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774803.105263:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774803.105266:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f122 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfb6 expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.105275:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce200, rc 0) 00000100:00100000:1.0:1785774803.105339:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18373:x1872519648495872:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 508us (1038us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774803.105346:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23798 00000100:00100000:0.0:1785774803.111137:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774803.111197:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671247872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774803.111268:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774803.112139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.112235:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648496128 00000100:00100000:0.0:1785774803.112243:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648496128 00000100:00100000:0.0:1785774803.112290:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23799 00000100:00100000:0.0:1785774803.112300:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18373:x1872519648496128:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774803.112322:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.112345:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f137 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfbd expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.112417:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.112431:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.112443:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.112455:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.112465:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ed39 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.112473:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.112499:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ed39 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.112512:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671248000:0@lo:104: 00000100:00100000:0.0:1785774803.112547:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.112577:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774803.112681:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785774803.112693:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671248000 00000100:00100000:3.0:1785774803.112696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671248000 00000100:00100000:3.0:1785774803.112746:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1785774803.112753:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735b20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8469:x1872519671248000:12345-0@lo:104: 00010000:00010000:3.0:1785774803.112766:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.112968:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774803.112975:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735b20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8469:x1872519671248000:12345-0@lo:104: Request processed in 222us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.112982:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1785774803.113131:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671248000:0@lo:104: 00010000:00010000:0.0:1785774803.113148:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.113244:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671247872 00000100:00100000:2.0:1785774803.113249:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671247872 00000100:00100000:2.0:1785774803.113288:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1785774803.113295:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671247872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774803.113319:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444073472 avail 1297833984 00000100:00100000:2.0:1785774803.113359:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671247872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (2091us total) trans 0 rc 0/0 00010000:00010000:1.0:1785774803.113363:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1785774803.113365:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00010000:00010000:1.0:1785774803.113370:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.113385:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774803.113390:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.113399:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.113444:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.113452:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774803.113469:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.113477:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1c00/0x7b7109e1d09ed39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ed40 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.113499:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.113501:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.113502:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774803.114108:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774803.114120:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671248128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.114194:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.114889:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983578 gen 2 00000004:00080000:0.0:1785774803.114895:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983578 committed transno 4294983578 00000020:00080000:0.0:1785774803.114900:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b77093add80 refcount 2 committed 0 result 0 batchid 404 00000020:00080000:0.0:1785774803.114904:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77093adf00 00000020:00080000:0.0:1785774803.114907:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].402 00000020:00080000:0.0:1785774803.114910:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ece800 00000020:00080000:0.0:1785774803.114913:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].403 00000100:00100000:0.0:1785774803.114953:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671247872:0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1785774803.115048:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 404 committed batchid 403 00000020:00080000:3.0:1785774803.115105:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 403 00000100:00100000:1.0:1785774803.115514:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671248128 00000100:00100000:1.0:1785774803.115520:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671248128 00010000:00010000:1.0:1785774803.115543:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09ed39 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.115745:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:2.0:1785774803.115754:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706103c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3653:x1872519671248128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774803.115776:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1785774803.118082:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 404 batchid updated 00000001:00080000:0.0:1785774803.118104:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968489 is committed 00000020:00080000:3.0:1785774803.118209:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 404 00000004:00080000:3.0:1785774803.118270:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605d0ec00 with version 772 00000020:00080000:3.0:1785774803.118280:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 404 cancel update log [0x200000401:0x3:0x0].402: rc = 0 00000020:00080000:3.0:1785774803.118344:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 404 cancel update log [0x240000400:0x3:0x0].403: rc = 0 00000020:00080000:3.0:1785774803.118351:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 404 00000004:00080000:0.0:1785774803.119093:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 772 rpc_version 772 00000020:00100000:0.0:1785774803.119125:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774803.119135:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603c5e300 x1872519671248384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774803.119157:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671248384:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774803.119352:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.119380:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095180 going to sleep for 11 seconds 00010000:00010000:2.0:1785774803.119690:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09ed40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09ed39 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.119708:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x391d5834 (ffff9b7605fcb900) 00010000:00010000:2.0:1785774803.119713:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.119724:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.119732:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.119751:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774803.119924:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671248384 00000100:00100000:1.0:1785774803.119932:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671248384 00000100:00100000:1.0:1785774803.119972:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:1.0:1785774803.119980:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:7474:x1872519671248384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774803.120116:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671248384:12345-0@lo:1000:osp_up0-1.0 Request processed in 136us (763us total) trans 4294983591 rc 0/0 00000100:00100000:1.0:1785774803.120123:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1785774803.120352:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706103c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1872519671248128:12345-0@lo:103:ldlm_bl.0 Request processed in 4598us (6191us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.120359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00010000:00010000:3.0:1785774803.120637:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.120647:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.120751:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09f14c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.121111:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671248384:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774803.121384:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671248128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774803.121546:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09f14c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.121715:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09f14c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774803.121729:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 2 00010000:00010000:3.0:1785774803.121810:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.122951:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.122958:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.122965:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.122972:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.122976:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.122984:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.122997:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:3.0:1785774803.123000:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.123004:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123011:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f13e lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123025:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123032:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123039:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123044:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.123047:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123053:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123059:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x391d5834 (ffff9b7605fcb900) 00010000:00010000:3.0:1785774803.123061:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.123064:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123069:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f145 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123113:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f137 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfbd expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123127:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09f14c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfbd expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.123141:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9b7602507f00) 00010000:00010000:3.0:1785774803.123143:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774803.123145:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745a00, rc 0) 00000100:00100000:3.0:1785774803.125134:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18373:x1872519648496128:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 12829us (12989us total) trans 4294968490 rc 0/0 00000100:00100000:3.0:1785774803.125146:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23799 00000100:00100000:3.0:1785774803.152326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774803.160657:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648496256 00000100:00100000:2.0:1785774803.160671:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648496256 00000100:00100000:2.0:1785774803.160740:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5204 00000100:00100000:2.0:1785774803.160751:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648496256:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774803.160908:0:14712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774803.160933:0:14712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfe0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774803.160959:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x6a70c2cf, atime: 0x0, ctime: 0x6a70c2cf, blocks: 0x8 00010000:00010000:2.0:1785774803.160979:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=1045s v=(0 0) 00010000:00010000:2.0:1785774803.160983:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774803.160993:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 15 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.161012:0:14712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 15 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.161025:0:14712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044600, rc 0) 00000100:00100000:2.0:1785774803.161137:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2418:x1872519648496256:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 386us (8820us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.161145:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5204 00000100:00100000:2.0:1785774803.178364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.186924:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648496384 00000100:00100000:0.0:1785774803.186938:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648496384 00000100:00100000:0.0:1785774803.187065:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3784 00000100:00100000:0.0:1785774803.187076:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648496384:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:0.0:1785774803.187110:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.187133:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f161 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfc4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187215:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187229:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187242:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187252:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187259:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187267:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187313:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187319:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187325:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187330:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.187334:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187341:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187351:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:0.0:1785774803.187354:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.187358:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187363:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f168 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187376:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187382:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187388:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187393:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.187395:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187400:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187417:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7602507300) 00010000:00010000:0.0:1785774803.187420:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.187422:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187435:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f16f lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187474:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f161 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfc4 expref: 31 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187490:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:0.0:1785774803.187493:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774803.187496:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f161 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfc4 expref: 31 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.187504:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc -2) 00000100:00100000:0.0:1785774803.189136:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648496384:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 1402us (10121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774803.189153:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3784 00000100:00100000:2.0:1785774803.212928:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.221340:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648496512 00000100:00100000:0.0:1785774803.221358:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648496512 00002000:00100000:0.0:1785774803.221914:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff9b760471df80 x1872519648496512/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1785774814 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774803.221927:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471df80 with x1872519648496512 ext(0->4095) 00002000:00010000:0.0:1785774803.221933:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471df80 00000100:00100000:3.0:1785774803.222734:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:3.0:1785774803.222750:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648496512:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:3.0:1785774803.222932:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648496512:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 187us (10013us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785774803.222940:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00002000:00100000:3.0:1785774803.222946:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff9b760471df80 x1872519648496512/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1785774814 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774803.222954:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471df80 with x1872519648496512 ext(0->4095) 00002000:00010000:3.0:1785774803.222959:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471df80 00000100:00100000:1.0:1785774803.247953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.248032:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648496768 00000100:00100000:3.0:1785774803.248041:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648496768 00000100:00100000:3.0:1785774803.248144:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5095 00000100:00100000:3.0:1785774803.248156:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18373:x1872519648496768:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:3.0:1785774803.248475:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18373:x1872519648496768:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 322us (531us total) trans 4294968491 rc 0/0 00000100:00100000:3.0:1785774803.249653:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5095 00000100:00100000:2.0:1785774803.297806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.298526:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648497024 00000100:00100000:0.0:1785774803.298537:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648497024 00000100:00100000:0.0:1785774803.298595:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23800 00000100:00100000:0.0:1785774803.298603:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18378:x1872519648497024:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774803.298623:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.298642:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f176 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfe7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298710:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298723:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298734:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298745:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298751:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298758:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298794:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298801:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298808:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298829:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298836:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.298840:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298847:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298859:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:0.0:1785774803.298862:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.298867:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298874:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f17d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298886:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298893:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298899:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298905:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.298907:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298913:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298920:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7602507300) 00010000:00010000:0.0:1785774803.298922:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.298925:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298932:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f184 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298956:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f176 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe7 expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298965:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:0.0:1785774803.298967:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774803.298971:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f176 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe7 expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.298986:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774803.299047:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18378:x1872519648497024:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 444us (1249us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774803.299055:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23800 00000100:00100000:2.0:1785774803.305039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.305119:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648497280 00000100:00100000:3.0:1785774803.305129:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648497280 00000100:00100000:3.0:1785774803.305220:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23801 00000100:00100000:3.0:1785774803.305232:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18378:x1872519648497280:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774803.305256:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.305276:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d09f18b lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bfee expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.305343:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.305356:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.305368:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.305379:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.305389:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b200/0x7b7109e1d09eee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09eedd expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.305397:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.305426:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b200/0x7b7109e1d09eee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09eedd expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.305452:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671248512:0@lo:104: 00000100:00100000:2.0:1785774803.311727:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.311846:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.318339:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671248512 00000100:00100000:0.0:1785774803.318353:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671248512 00000100:00100000:1.0:1785774803.324090:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1785774803.324104:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8627:x1872519671248512:12345-0@lo:104: 00010000:00010000:1.0:1785774803.324125:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.324354:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785774803.324361:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8627:x1872519671248512:12345-0@lo:104: Request processed in 261us (12642us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.324368:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00010000:00010000:0.0:1785774803.325735:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774803.325744:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.325756:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774803.325763:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774803.325772:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.325812:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.325828:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774803.325856:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.325864:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec0600/0x7b7109e1d09eedd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09eee4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.325891:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774803.325893:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774803.325895:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774803.325916:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774803.325931:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671248640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.325983:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.326020:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671248640 00000100:00100000:0.0:1785774803.326038:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671248640 00010000:00010000:0.0:1785774803.326061:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b200/0x7b7109e1d09eee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09eedd expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.326089:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1785774803.326096:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3656:x1872519671248640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.326108:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1785774803.331773:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968491 is committed 00010000:00010000:1.0:1785774803.331957:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x18618557 (ffff9b7605fcb300) 00010000:00010000:1.0:1785774803.331967:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.331981:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.331989:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.332009:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774803.332099:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3656:x1872519671248640:12345-0@lo:103:ldlm_bl.0 Request processed in 5999us (6111us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.332113:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1785774803.332476:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671248640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774803.334133:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b200/0x7b7109e1d09eee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09eedd expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.334153:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671248512:0@lo:104: 00010000:00010000:3.0:1785774803.334194:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334206:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334212:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334318:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f1a0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334330:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f1a0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334339:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f1a0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774803.334350:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x190:0x0]: returning size 2 00010000:00010000:3.0:1785774803.334864:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334872:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334878:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334890:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334896:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.334901:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334909:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334920:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:3.0:1785774803.334924:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.334928:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334934:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d09f192 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334950:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334956:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334961:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334966:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.334969:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334978:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334984:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x18618557 (ffff9b7605fcb300) 00010000:00010000:3.0:1785774803.334986:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.334989:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.334994:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d09f199 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.335734:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d09f18b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfee expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.335752:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f1a0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfee expref: 15 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.335760:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff9b7602507c00) 00010000:00010000:3.0:1785774803.335762:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774803.335764:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745200, rc 0) 00000100:00100000:3.0:1785774803.335839:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18378:x1872519648497280:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 30609us (30818us total) trans 4294968492 rc 0/0 00000100:00100000:3.0:1785774803.335848:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23801 00000100:00100000:3.0:1785774803.351441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.351606:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648497408 00000100:00100000:0.0:1785774803.351615:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648497408 00000100:00100000:0.0:1785774803.351677:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5205 00000100:00100000:0.0:1785774803.351686:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648497408:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774803.351704:0:14729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.351724:0:14729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bff5 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774803.351748:0:14729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x6a70c2cf, atime: 0x0, ctime: 0x6a70c2cf, blocks: 0x8 00010000:00010000:0.0:1785774803.351770:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=1045s v=(0 0) 00010000:00010000:0.0:1785774803.351775:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774803.351783:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 15 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.351800:0:14729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 15 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.351823:0:14729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774803.351884:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648497408:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 199us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.351891:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5205 00000100:00100000:2.0:1785774803.382140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.384547:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648497536 00000100:00100000:0.0:1785774803.384560:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648497536 00002000:00100000:0.0:1785774803.384622:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff9b760471c380 x1872519648497536/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1785774814 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774803.384634:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471c380 with x1872519648497536 ext(0->4095) 00002000:00010000:0.0:1785774803.384640:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471c380 00000100:00100000:0.0:1785774803.384674:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:0.0:1785774803.384683:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2418:x1872519648497536:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:0.0:1785774803.384865:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2418:x1872519648497536:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 182us (2735us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1785774803.384873:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 6 00002000:00100000:0.0:1785774803.384880:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff9b760471c380 x1872519648497536/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1785774814 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774803.384895:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471c380 with x1872519648497536 ext(0->4095) 00002000:00010000:0.0:1785774803.384899:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471c380 00000100:00100000:2.0:1785774803.419919:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774803.420014:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648497792 00000100:00100000:1.0:1785774803.420024:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648497792 00000100:00100000:1.0:1785774803.420083:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5096 00000100:00100000:1.0:1785774803.420094:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18378:x1872519648497792:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:1.0:1785774803.420415:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18378:x1872519648497792:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 322us (505us total) trans 4294968493 rc 0/0 00000100:00100000:1.0:1785774803.420422:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5096 00000100:00100000:1.0:1785774803.478287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.478378:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648498048 00000100:00100000:3.0:1785774803.478387:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648498048 00000100:00100000:3.0:1785774803.478452:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23802 00000100:00100000:3.0:1785774803.478460:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18380:x1872519648498048:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774803.478678:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.478700:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f1b5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259bffc expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478769:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478782:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478794:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478821:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478829:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478835:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478871:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478878:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478883:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478890:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478896:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.478899:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478906:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478915:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774803.478918:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.478922:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478927:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f1bc lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478944:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478950:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478955:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478960:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.478962:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478967:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478976:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7605fcb000) 00010000:00010000:3.0:1785774803.478978:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.478980:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.478985:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f1c3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.479010:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f1b5 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bffc expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.479018:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774803.479021:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774803.479024:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f1b5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bffc expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.479034:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745c00, rc 0) 00000100:00100000:3.0:1785774803.479091:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18380:x1872519648498048:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 632us (813us total) trans 0 rc 301/301 00000100:00100000:3.0:1785774803.479098:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23802 00000100:00100000:2.0:1785774803.484065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.484980:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648498304 00000100:00100000:3.0:1785774803.484990:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648498304 00000100:00100000:3.0:1785774803.485139:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23803 00000100:00100000:3.0:1785774803.485151:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18380:x1872519648498304:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774803.485197:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.485218:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09f1ca lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c003 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.485292:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.485306:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.485318:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.485329:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.485340:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09ee7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09ee74 expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.485349:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.485379:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09ee7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09ee74 expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.485395:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671248768:0@lo:104: 00000100:00100000:3.0:1785774803.485453:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774803.485509:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785774803.488594:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671248768 00000100:00100000:2.0:1785774803.488618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671248768 00000100:00100000:2.0:1785774803.488682:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1785774803.488693:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671248768:12345-0@lo:104: 00010000:00010000:2.0:1785774803.488711:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.488794:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785774803.488819:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671248768:12345-0@lo:104: Request processed in 126us (3364us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.488826:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00010000:00010000:2.0:1785774803.488848:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774803.488854:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.488863:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774803.488868:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774803.488877:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.488911:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.488917:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774803.488936:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.488944:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a800/0x7b7109e1d09ee74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09ee7b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.488967:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774803.488969:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774803.488971:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774803.488977:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774803.488990:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671248896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.489033:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.489068:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671248896 00000100:00100000:2.0:1785774803.489072:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671248896 00010000:00010000:2.0:1785774803.489089:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09ee7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09ee74 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.489109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:2.0:1785774803.489115:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671248896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774803.489125:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1785774803.489323:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671248768:0@lo:104: 00010000:00010000:2.0:1785774803.489343:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774803.493960:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968493 is committed 00010000:00010000:2.0:1785774803.499385:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09ee7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09ee74 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.499408:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xb62e0cbf (ffff9b7605fcb600) 00010000:00010000:2.0:1785774803.499414:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.499423:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.499435:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.499468:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774803.499548:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671248896:12345-0@lo:103:ldlm_bl.0 Request processed in 10430us (10522us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.499559:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00010000:00010000:0.0:1785774803.499594:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.499612:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.499615:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671248896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.499737:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f1df lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.499748:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f1df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.499756:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f1df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774803.499768:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18f:0x0]: returning size 2 00010000:00010000:0.0:1785774803.500633:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500644:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500650:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500657:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500663:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.500668:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500676:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500687:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774803.500690:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.500694:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500702:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d09f1d1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500719:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500726:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500732:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500737:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.500740:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500746:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500753:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xb62e0cbf (ffff9b7605fcb600) 00010000:00010000:0.0:1785774803.500755:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.500759:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.500765:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d09f1d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.501086:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744000/0x7b7109e1d09f1ca lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c003 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.501105:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f1df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c003 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.501113:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff9b7702bc0600) 00010000:00010000:0.0:1785774803.501116:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774803.501119:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3800, rc 0) 00000100:00100000:0.0:1785774803.509461:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18380:x1872519648498304:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 24300us (25391us total) trans 4294968494 rc 0/0 00000100:00100000:0.0:1785774803.509483:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23803 00000100:00100000:2.0:1785774803.515306:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774803.515400:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648498432 00000100:00100000:1.0:1785774803.515410:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648498432 00000100:00100000:1.0:1785774803.515463:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5206 00000100:00100000:1.0:1785774803.515473:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648498432:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774803.515493:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774803.515514:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c00a expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774803.515540:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 2, mtime: 0x6a70c2cf, atime: 0x0, ctime: 0x6a70c2cf, blocks: 0x8 00010000:00010000:1.0:1785774803.515561:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=1045s v=(0 0) 00010000:00010000:1.0:1785774803.515566:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774803.515576:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 16 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.515595:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 16 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.515614:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf000, rc 0) 00000100:00100000:1.0:1785774803.515671:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648498432:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 199us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.515678:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5206 00000100:00100000:1.0:1785774803.548242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774803.548331:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648498560 00000100:00100000:2.0:1785774803.548341:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648498560 00002000:00100000:2.0:1785774803.548387:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff9b760474dc00 x1872519648498560/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/0 e 0 to 0 dl 1785774814 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774803.548397:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760474dc00 with x1872519648498560 ext(0->4095) 00002000:00010000:2.0:1785774803.548404:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760474dc00 00000100:00100000:2.0:1785774803.548436:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:2.0:1785774803.548445:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648498560:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:2.0:1785774803.548604:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648498560:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 160us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1785774803.548612:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00002000:00100000:2.0:1785774803.548619:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff9b760474dc00 x1872519648498560/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:494/0 lens 488/4536 e 0 to 0 dl 1785774814 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774803.548627:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760474dc00 with x1872519648498560 ext(0->4095) 00002000:00010000:2.0:1785774803.548630:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760474dc00 00000100:00100000:2.0:1785774803.574283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.574345:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648498816 00000100:00100000:3.0:1785774803.574355:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648498816 00000100:00100000:3.0:1785774803.574413:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5097 00000100:00100000:3.0:1785774803.574423:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18380:x1872519648498816:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:3.0:1785774803.574714:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18380:x1872519648498816:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 291us (440us total) trans 4294968495 rc 0/0 00000100:00100000:3.0:1785774803.574722:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5097 00000100:00100000:1.0:1785774803.592640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.592753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648498944 00000100:00100000:3.0:1785774803.592766:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648498944 00000100:00100000:3.0:1785774803.592849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 550 00000100:00100000:3.0:1785774803.592861:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648498944:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774803.592944:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648498944:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.592952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 550 00000100:00100000:2.0:1785774803.617406:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774803.617559:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648499072 00000100:00100000:1.0:1785774803.617568:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648499072 00000100:00100000:1.0:1785774803.617642:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3785 00000100:00100000:1.0:1785774803.617652:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2419:x1872519648499072:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:1.0:1785774803.617706:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774803.617728:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f1f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c011 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617783:0:20645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617810:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617822:0:20645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617837:0:20645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617844:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617852:0:20645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617912:0:20645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617919:0:20645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617926:0:20645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617932:0:20645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.617935:0:20645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617942:0:20645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617953:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774803.617956:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.617960:0:20645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.617965:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f1fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618409:0:20645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618416:0:20645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618423:0:20645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618429:0:20645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.618432:0:20645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618438:0:20645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618447:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7605fcca00) 00010000:00010000:1.0:1785774803.618449:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.618452:0:20645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618457:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618489:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f1f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c011 expref: 31 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618498:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774803.618500:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774803.618504:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f1f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c011 expref: 31 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.618514:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc -2) 00000100:00100000:1.0:1785774803.619276:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2419:x1872519648499072:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 1624us (1878us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774803.619289:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3785 00000100:00100000:2.0:1785774803.643673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.643866:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648499200 00000100:00100000:3.0:1785774803.643876:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648499200 00000100:00100000:3.0:1785774803.643931:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23804 00000100:00100000:3.0:1785774803.643940:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18381:x1872519648499200:12345-192.168.202.31@tcp:41:rm.0 00000004:00000024:3.0:1785774803.643990:0:8627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847018496 avail 7383973888 00000100:00100000:3.0:1785774803.644072:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18381:x1872519648499200:12345-192.168.202.31@tcp:41:rm.0 Request processed in 132us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.644081:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23804 00000100:00100000:3.0:1785774803.674731:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.677962:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648499456 00000100:00100000:0.0:1785774803.677977:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648499456 00000100:00100000:0.0:1785774803.678057:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23805 00000100:00100000:0.0:1785774803.678068:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18381:x1872519648499456:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774803.678124:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.678149:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d09f14c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfbd expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.678707:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9b7602507f00) 00010000:00010000:0.0:1785774803.678720:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774803.678772:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.678782:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.678793:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.678827:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249024:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774803.678894:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.679085:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774803.679573:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671249024 00000100:00100000:3.0:1785774803.679580:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671249024 00000100:00100000:3.0:1785774803.679620:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:3.0:1785774803.679628:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:8469:x1872519671249024:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774803.679643:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.679658:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f209 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.679683:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.679693:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 4/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.679718:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.689147:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 29 pid: 6530 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.689209:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671249152:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774803.689755:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774803.720563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.720727:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6535:1872519671249152:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774803.720759:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.720771:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:3.0:1785774803.720774:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.720777:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.720786:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745c00, rc 0) 00000100:00100000:3.0:1785774803.720850:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249024:12345-0@lo:101:mdt00_003.0 Request processed in 41222us (41954us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.720859:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:0.0:1785774803.721018:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648499584 00000100:00100000:0.0:1785774803.721026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648499584 00010000:00010000:0.0:1785774803.721058:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 30 pid: 6530 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.721094:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1645 00000100:00100000:0.0:1785774803.721103:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648499584:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.721117:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.721124:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 30 pid: 6530 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.721135:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 30 pid: 6530 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.721203:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09efb6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf07 expref: 30 pid: 6530 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.721219:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:0.0:1785774803.721224:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.721234:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.721242:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.721288:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.721302:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6516:1872519671249280:0@lo:105: 00000100:00100000:0.0:1785774803.721336:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.721384:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095600 going to sleep for 11 seconds 00000100:00100000:1.0:1785774803.721767:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249024:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774803.721788:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.721799:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.722288:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671249280 00000100:00100000:3.0:1785774803.722293:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671249280 00000100:00100000:3.0:1785774803.722333:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1785774803.722341:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6516:x1872519671249280:12345-0@lo:105: 00010000:00010000:3.0:1785774803.722360:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.722377:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.722386:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.722393:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.722400:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.722408:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.722430:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec2800) 00000100:00100000:3.0:1785774803.722478:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6516:x1872519671249280:12345-0@lo:105: Request processed in 138us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.722493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1785774803.722522:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6516:1872519671249280:0@lo:105: 00010000:00010000:3.0:1785774803.722535:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774803.722574:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:2416:x1872519648499584:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1471us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.722581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1645 00010000:00010000:1.0:1785774803.723002:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.723012:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774803.723033:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:1.0:1785774803.723068:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.723076:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.723085:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774803.723101:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249408:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1785774803.723133:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.723198:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ceca80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774803.725139:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671249408 00000100:00100000:3.0:1785774803.725150:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671249408 00000100:00100000:3.0:1785774803.725242:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:3.0:1785774803.725261:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249408:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774803.725290:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.725310:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f217 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.725338:0:7692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.725574:0:7692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 4/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.725596:0:7692:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1785774803.725627:0:7692:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1785774803.725670:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.725678:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7605fcb500) 00010000:00010000:3.0:1785774803.725681:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.725685:0:7692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.725691:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745000, rc 0) 00000100:00100000:3.0:1785774803.725750:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:8469:x1872519671249408:12345-0@lo:101:mdt00_003.0 Request processed in 501us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.725756:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1785774803.726319:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249408:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774803.726338:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.726347:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774803.738622:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983591 is committed 00000001:00080000:1.0:1785774803.738657:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983590 is committed 00010000:00010000:0.0:1785774803.738751:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738762:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738770:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738775:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35aa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.738780:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738789:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738818:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7605fcb500) 00010000:00010000:0.0:1785774803.738821:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.738827:0:3639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738839:0:3639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738848:0:3639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.738894:0:3639:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.738910:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3639:1872519671249536:0@lo:105: 00000100:00100000:0.0:1785774803.738974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.739021:0:3639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095180 going to sleep for 11 seconds 00000100:00100000:3.0:1785774803.739129:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671249536 00000100:00100000:3.0:1785774803.739137:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671249536 00000100:00100000:3.0:1785774803.739554:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1785774803.739565:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3639:x1872519671249536:12345-0@lo:105: 00010000:00010000:3.0:1785774803.739577:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.739586:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.739595:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.739603:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.739609:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.739617:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.739647:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b76057cf200) 00000100:00100000:3.0:1785774803.739692:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3639:x1872519671249536:12345-0@lo:105: Request processed in 129us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.739699:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1785774803.739752:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3639:1872519671249536:0@lo:105: 00010000:00010000:0.0:1785774803.739770:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739777:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09ed4e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739790:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739796:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739803:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739819:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.739822:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739829:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739838:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774803.739840:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1785774803.739843:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739849:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09ed55 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1536:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739868:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739874:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739879:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739883:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.739886:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739896:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739903:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7605fd8d00) 00010000:00010000:0.0:1785774803.739906:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.739909:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739914:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09edb7 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739926:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739931:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739937:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739942:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.739945:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739951:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739958:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:0.0:1785774803.739960:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1785774803.739963:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739969:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09edbe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739983:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739989:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739994:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.739998:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740001:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740008:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740015:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7605fd8e00) 00010000:00010000:0.0:1785774803.740018:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.740021:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740026:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09ee20 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740036:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740042:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740048:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740053:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740056:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740063:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740069:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9b7602507100) 00010000:00010000:0.0:1785774803.740072:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1785774803.740074:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740080:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09ee27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1535:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740093:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740099:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740105:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740110:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740113:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740123:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740130:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7605fcb000) 00010000:00010000:0.0:1785774803.740133:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.740135:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740141:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09ee89 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740152:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740197:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740203:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740208:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740211:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740216:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740225:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9b7602507200) 00010000:00010000:0.0:1785774803.740227:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1785774803.740230:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740236:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ee90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740249:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740272:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740279:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740284:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740287:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740293:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740301:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7602507300) 00010000:00010000:0.0:1785774803.740304:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.740307:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740312:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09eef2 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740331:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740337:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740343:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740348:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740359:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740373:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740381:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:0.0:1785774803.740383:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1785774803.740386:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740392:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09eef9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740406:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740412:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740418:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740423:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740426:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740435:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740443:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7605fcbe00) 00010000:00010000:0.0:1785774803.740445:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.740448:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740453:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09ef5b lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740464:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740469:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740474:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740478:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.740481:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740487:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740494:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:0.0:1785774803.740496:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1785774803.740498:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.740504:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ef62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1534:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.741635:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.741649:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774803.741677:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00000100:00100000:1.0:1785774803.741726:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249664:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.741779:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.741820:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.745963:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671249664 00000100:00100000:0.0:1785774803.745976:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671249664 00000100:00100000:0.0:1785774803.746038:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:0.0:1785774803.746049:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774803.746205:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249664:12345-0@lo:1000:mdt00_003.0 Request processed in 158us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.746214:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:1.0:1785774803.747408:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983591 gen 2 00000004:00080000:1.0:1785774803.747415:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983591 committed transno 4294983591 00000100:00100000:1.0:1785774803.747438:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249664:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.747681:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249792:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.747719:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.747746:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774803.747763:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671249792 00000100:00100000:1.0:1785774803.747767:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671249792 00000100:00100000:1.0:1785774803.747799:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1785774803.747816:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.747893:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249792:12345-0@lo:1000:mdt00_003.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.747900:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1785774803.747924:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249792:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.747955:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249920:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.747973:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.747987:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774803.747997:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671249920 00000100:00100000:1.0:1785774803.748000:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671249920 00000100:00100000:1.0:1785774803.748022:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:1.0:1785774803.748028:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.748089:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671249920:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774803.748095:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:1.0:1785774803.748118:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671249920:0@lo:1000:mdt00_003.0 00000004:00080000:1.0:1785774803.748137:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:1.0:1785774803.748146:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.748202:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.748211:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.748235:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774803.748241:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:1.0:1785774803.748245:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.748252:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.748258:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749345:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774803.749597:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18381:x1872519648499456:12345-192.168.202.31@tcp:36:rm.0 Request processed in 71527us (74871us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774803.749606:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23805 00010000:00010000:1.0:1785774803.749635:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774803.749642:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749652:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774803.749658:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.749667:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749695:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749702:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774803.749719:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749727:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09f209 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f210 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749745:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774803.749749:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749755:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774803.749758:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.749766:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749782:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749787:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774803.749792:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.749799:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f217 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f21e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.750207:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.750209:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.750210:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.750216:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774803.750228:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671250048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.750436:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671250176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774803.750883:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774803.751008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.751193:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.752416:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250048 00000100:00100000:0.0:1785774803.752425:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250048 00000100:00100000:0.0:1785774803.752471:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250176 00000100:00100000:0.0:1785774803.752474:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250176 00000100:00100000:2.0:1785774803.752618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1785774803.752630:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+16:3653:x1872519671250048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774803.752645:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774803.752667:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f210 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f209 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.752686:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7605fd8c00) 00010000:00010000:2.0:1785774803.752697:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774803.752744:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671250048:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.752751:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1785774803.752911:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1785774803.752919:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3654:x1872519671250176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.752927:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.752940:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f21e lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f217 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.752952:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x391d5834 (ffff9b7605fcb500) 00010000:00010000:0.0:1785774803.752959:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774803.752988:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671250176:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.752995:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1785774803.753062:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671250176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774803.753228:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671250048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.769899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774803.769990:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648499840 00000100:00100000:0.0:1785774803.770000:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648499840 00000100:00100000:0.0:1785774803.770063:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23806 00000100:00100000:0.0:1785774803.770073:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18381:x1872519648499840:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774803.770127:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.770154:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09efa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf00 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770222:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774803.770234:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774803.770445:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770459:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770470:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770575:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770585:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770592:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770656:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770664:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770671:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774803.770909:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1785774803.770918:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1045621756843ns, next at 1046621754987ns, rc = 0 00010000:00010000:0.0:1785774803.770957:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770967:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770976:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770984:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770990:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.770997:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771009:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774803.771025:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771031:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771036:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771042:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.771046:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771053:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771062:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:0.0:1785774803.771065:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774803.771069:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771075:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f233 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771091:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771098:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771103:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771108:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771113:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774803.771115:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771124:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771131:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774803.771134:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.771136:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771142:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f225 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774803.771153:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f12931b9 reply state 000000008ad96e7c transno 4294968496 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771223:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.771229:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x391d5834 (ffff9b7702bc0000) 00010000:00010000:0.0:1785774803.771231:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774803.771234:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774803.771362:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774803.771375:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.771381:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774803.771385:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.771391:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.771401:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:2.0:1785774803.771403:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774803.771406:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 1/0,0 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.771412:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f23a lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.771425:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774803.771427:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774803.771428:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774803.772616:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18381:x1872519648499840:12345-192.168.202.31@tcp:36:rm.0 Request processed in 2540us (2721us total) trans 4294968496 rc 0/0 00000100:00100000:0.0:1785774803.772626:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23806 00000100:00100000:0.0:1785774803.828976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.829121:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648500096 00000100:00100000:3.0:1785774803.829130:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648500096 00000100:00100000:3.0:1785774803.829228:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23807 00000100:00100000:3.0:1785774803.829239:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18381:x1872519648500096:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774803.829296:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774803.829322:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f07a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf46 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.829342:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:3.0:1785774803.829352:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774803.829397:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.829406:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.829416:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.829547:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250304:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1785774803.829595:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774803.829697:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.830328:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250304 00000100:00100000:0.0:1785774803.830333:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250304 00000100:00100000:0.0:1785774803.830369:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:0.0:1785774803.830376:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:8627:x1872519671250304:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774803.830388:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.830404:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f248 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f241 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.830437:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f248 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f241 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.830450:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f248 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f241 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.830458:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774803.830461:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.830464:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2800, rc 0) 00000100:00100000:0.0:1785774803.830508:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:8627:x1872519671250304:12345-0@lo:101:mdt00_004.0 Request processed in 132us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.830514:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1785774803.833269:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250304:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774803.833298:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.833312:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774803.833336:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.833378:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.833386:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.833395:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.833412:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250432:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774803.834598:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.834639:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.836565:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250432 00000100:00100000:0.0:1785774803.836577:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250432 00000100:00100000:0.0:1785774803.836639:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:0.0:1785774803.836649:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:8627:x1872519671250432:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774803.836668:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.836690:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f256 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f24f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.836716:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f256 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f24f expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.836729:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f256 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f24f expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.836740:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774803.836743:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.836746:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3200, rc 0) 00000100:00100000:0.0:1785774803.836806:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671250432:12345-0@lo:101:mdt00_004.0 Request processed in 159us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.836812:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1785774803.837001:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250432:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774803.837018:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.837040:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774803.837059:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00000100:00100000:2.0:1785774803.837102:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250560:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774803.837132:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.837190:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.837327:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250560 00000100:00100000:0.0:1785774803.837331:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250560 00000100:00100000:0.0:1785774803.837359:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:0.0:1785774803.837365:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671250560:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774803.837574:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671250560:12345-0@lo:1000:mdt00_004.0 Request processed in 208us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.837582:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:2.0:1785774803.838563:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250560:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774803.838609:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250688:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774803.838638:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.838669:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.839100:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250688 00000100:00100000:0.0:1785774803.839106:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250688 00000100:00100000:0.0:1785774803.841606:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:0.0:1785774803.841626:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671250688:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774803.841768:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671250688:12345-0@lo:1000:mdt00_004.0 Request processed in 150us (3129us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774803.841777:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:2.0:1785774803.841878:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671250688:0@lo:1000:mdt00_004.0 00000004:00080000:2.0:1785774803.841911:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.841919:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.841929:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.841936:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.841966:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774803.841971:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.841975:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.841981:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.841986:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.842001:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774803.842068:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18381:x1872519648500096:12345-192.168.202.31@tcp:36:rm.0 Request processed in 12830us (13099us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774803.842075:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23807 00010000:00010000:3.0:1785774803.843972:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774803.843983:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.843993:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774803.844000:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774803.844008:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.844055:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.844060:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774803.844091:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.844097:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f241 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f248 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.844114:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774803.844117:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.844121:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774803.844124:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774803.844130:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.844143:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.844148:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774803.844152:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.845207:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671250816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.845266:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.845312:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774803.845318:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671250944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.845340:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.845365:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250816 00000100:00100000:2.0:1785774803.845372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250816 00000100:00100000:2.0:1785774803.845429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671250944 00000100:00100000:2.0:1785774803.845432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671250944 00000100:00100000:2.0:1785774803.845454:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1785774803.845461:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+16:3655:x1872519671250816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774803.845484:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774803.845504:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f248 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f241 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.845520:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:2.0:1785774803.845529:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774803.845558:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+15:3655:x1872519671250816:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.845565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1785774803.845580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1785774803.845585:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706103850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671250944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774803.845592:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774803.845601:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f256 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f24f expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.845611:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xdcc87686 (ffff9b7702bc0300) 00010000:00010000:2.0:1785774803.845618:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774803.845639:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706103850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671250944:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.845645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1785774803.845701:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671250944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.845710:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671250816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774803.846287:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f24f lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.846303:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.846305:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.846307:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774803.850346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:1.0:1785774803.850600:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774803.850617:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648500352 00000100:00100000:1.0:1785774803.850626:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648500352 00000100:00100000:1.0:1785774803.850683:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23808 00000100:00100000:1.0:1785774803.850693:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18381:x1872519648500352:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774803.850767:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850783:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850794:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850805:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850812:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850818:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850878:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850887:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.850893:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774803.851123:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00010000:00010000:1.0:1785774803.851197:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851206:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851213:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851220:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851226:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851232:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851249:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774803.851265:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851274:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851280:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851286:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.851290:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851296:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851306:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff9b7605fcc200) 00010000:00010000:1.0:1785774803.851310:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774803.851314:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851321:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f26b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851337:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851343:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851350:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851356:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851362:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.851365:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851370:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851376:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7605fcca00) 00010000:00010000:1.0:1785774803.851378:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.851380:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 3/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851385:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f25d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.851395:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000476d886e reply state 00000000efc37354 transno 4294968497 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851405:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.851410:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xdcc87686 (ffff9b7605fcc000) 00010000:00010000:1.0:1785774803.851413:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774803.851415:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774803.851617:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18381:x1872519648500352:12345-192.168.202.31@tcp:36:rm.0 Request processed in 924us (1278us total) trans 4294968497 rc 0/0 00000100:00100000:1.0:1785774803.851624:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23808 00010000:00010000:3.0:1785774803.851690:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774803.851697:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.851704:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774803.851707:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.851715:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.851724:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff9b7605fcc200) 00010000:00010000:3.0:1785774803.851726:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774803.851729:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.851739:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09f272 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.851752:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.851753:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.851755:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774803.883417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.883588:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648500608 00000100:00100000:3.0:1785774803.883599:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648500608 00000100:00100000:3.0:1785774803.883666:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23809 00000100:00100000:3.0:1785774803.883677:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18381:x1872519648500608:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774803.883748:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774803.883776:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f1a0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfee expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.883817:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff9b7602507c00) 00010000:00010000:3.0:1785774803.884040:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774803.884088:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.884098:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.884108:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.884130:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251072:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774803.884394:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774803.884427:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251072 00000100:00100000:3.0:1785774803.884432:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251072 00000100:00100000:3.0:1785774803.884462:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1785774803.884469:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671251072:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774803.884479:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.884494:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f280 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f279 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.884517:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f280 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f279 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.884531:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f280 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f279 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.884538:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507600) 00010000:00010000:3.0:1785774803.884541:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.884543:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745400, rc 0) 00000100:00100000:3.0:1785774803.884576:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6530:x1872519671251072:12345-0@lo:101:mdt00_001.0 Request processed in 107us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.884582:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1785774803.884633:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774803.884660:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251072:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774803.884675:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.884686:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774803.884708:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:3.0:1785774803.886278:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.886291:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.886301:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774803.886319:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251200:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774803.886371:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774803.886408:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774803.886471:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251200 00000100:00100000:1.0:1785774803.886477:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251200 00000100:00100000:1.0:1785774803.886522:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1785774803.886532:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6530:x1872519671251200:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1785774803.886555:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774803.886571:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f28e lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f287 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.886593:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f28e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f287 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.886606:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f28e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f287 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.886613:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7605fcca00) 00010000:00010000:1.0:1785774803.886616:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.886618:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774803.886657:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671251200:12345-0@lo:101:mdt00_001.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.886663:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1785774803.887118:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251200:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774803.887133:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.887143:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774803.887192:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00000100:00100000:3.0:1785774803.887237:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251328:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774803.887265:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774803.887295:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.887329:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251328 00000100:00100000:0.0:1785774803.887335:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251328 00000100:00100000:0.0:1785774803.887373:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:0.0:1785774803.887381:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671251328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774803.887468:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671251328:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.887484:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1785774803.887533:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785774803.887604:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251456:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785774803.887632:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.887655:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.887741:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251456 00000100:00100000:0.0:1785774803.887746:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251456 00000100:00100000:0.0:1785774803.887779:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:0.0:1785774803.887786:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671251456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774803.887861:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671251456:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (228us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774803.887869:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:2.0:1785774803.888015:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671251456:0@lo:1000:mdt00_001.0 00000004:00080000:2.0:1785774803.888044:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.888050:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888060:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888068:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888090:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774803.888095:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.888099:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888105:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888112:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888126:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1785774803.888147:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774803.888186:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.888196:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774803.888202:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774803.888212:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.888266:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18381:x1872519648500608:12345-192.168.202.31@tcp:36:rm.0 Request processed in 4589us (4855us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774803.888273:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23809 00010000:00010000:3.0:1785774803.888298:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.888307:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774803.888328:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.888336:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711744c00/0x7b7109e1d09f279 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f280 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.888346:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671251584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.888376:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.888414:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251584 00000100:00100000:2.0:1785774803.888418:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251584 00000100:00100000:2.0:1785774803.888457:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1785774803.888463:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671251584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774803.888469:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774803.888475:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888482:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774803.888483:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774803.888490:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774803.888499:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888500:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f280 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f279 expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888530:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7602507600) 00010000:00010000:3.0:1785774803.888533:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.888538:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774803.888544:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785774803.889010:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671251584:12345-0@lo:103:ldlm_bl.0 Request processed in 546us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.889028:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1785774803.889067:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671251712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.889095:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.889183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251712 00000100:00100000:1.0:1785774803.889199:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251712 00000100:00100000:1.0:1785774803.889229:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1785774803.889237:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3654:x1872519671251712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774803.889247:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774803.889259:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f28e lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f287 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.889271:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x18618557 (ffff9b7605fcca00) 00010000:00010000:1.0:1785774803.889279:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774803.889308:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671251712:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.889314:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00010000:00010000:0.0:1785774803.889418:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.889960:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.889970:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f287 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f28e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.889982:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.889984:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.889986:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774803.890544:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671251712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.895629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774803.895679:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648500864 00000100:00100000:3.0:1785774803.895690:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648500864 00000100:00100000:1.0:1785774803.895965:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23810 00000100:00100000:1.0:1785774803.895977:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18381:x1872519648500864:12345-192.168.202.31@tcp:36:rm.0 00000100:00100000:2.0:1785774803.896649:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671251584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774803.896764:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.896781:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.896794:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.897418:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.897429:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.897438:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.897502:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.897511:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.897520:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774803.897797:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1785774803.899328:0:8469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1045748657470ns, next at 1046748654790ns, rc = 0 00010000:00010000:1.0:1785774803.899411:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 3/0,1 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899424:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899435:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899444:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899451:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899458:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899477:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774803.899497:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899504:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899510:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899517:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.899522:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899529:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899541:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff9b7605fcc900) 00010000:00010000:1.0:1785774803.899555:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774803.899561:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774803.899561:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899570:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899572:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f2a3 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899587:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774803.899593:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899601:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899603:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899615:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899617:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff9b7605fcc900) 00010000:00010000:2.0:1785774803.899624:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774803.899626:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899630:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 1/0,0 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899637:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899641:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09f2aa lrc: 0/0,0 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899646:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774803.899651:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899662:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.899663:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.899666:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774803.899671:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.899677:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7605fcc500) 00010000:00010000:1.0:1785774803.899681:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.899684:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899690:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f295 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.899702:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000238f1a94 reply state 00000000a6b1883c transno 4294968498 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899714:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.899740:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x18618557 (ffff9b7605fcce00) 00010000:00010000:1.0:1785774803.899743:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774803.899746:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774803.900618:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18381:x1872519648500864:12345-192.168.202.31@tcp:36:rm.0 Request processed in 4638us (4990us total) trans 4294968498 rc 0/0 00000100:00100000:0.0:1785774803.900628:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23810 00000100:00100000:3.0:1785774803.920881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774803.921515:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648501120 00000100:00100000:2.0:1785774803.921525:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648501120 00000100:00100000:2.0:1785774803.921584:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23811 00000100:00100000:2.0:1785774803.921594:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18381:x1872519648501120:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774803.921648:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774803.921675:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f0ce lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf93 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.921692:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff9b7605fccc00) 00010000:00010000:2.0:1785774803.921702:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774803.921746:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.921755:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.921764:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.921783:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671251840:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774803.921826:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.921896:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.922810:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251840 00000100:00100000:0.0:1785774803.922816:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251840 00000100:00100000:0.0:1785774803.922860:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:0.0:1785774803.922868:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6529:x1872519671251840:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774803.922879:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.922901:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f2b8 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f2b1 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.922928:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f2b8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f2b1 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.922940:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f2b8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f2b1 expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.922948:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774803.922951:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.922954:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3c00, rc 0) 00000100:00100000:0.0:1785774803.923009:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671251840:12345-0@lo:101:mdt00_000.0 Request processed in 142us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.923016:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1785774803.925758:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671251840:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774803.925787:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.925801:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774803.925823:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:1.0:1785774803.925871:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.925880:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.925890:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774803.925908:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671251968:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1785774803.925961:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.926009:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cecd80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774803.926140:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671251968 00000100:00100000:3.0:1785774803.926147:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671251968 00000100:00100000:3.0:1785774803.926238:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:3.0:1785774803.926248:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671251968:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774803.926265:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.926283:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f2c6 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f2bf expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.926306:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f2c6 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f2bf expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.926318:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f2c6 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f2bf expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.926326:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7602507d00) 00010000:00010000:3.0:1785774803.926329:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.926332:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:3.0:1785774803.926377:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671251968:12345-0@lo:101:mdt00_000.0 Request processed in 131us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.926382:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1785774803.926659:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671251968:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774803.926673:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.926682:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774803.926697:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00000100:00100000:2.0:1785774803.926733:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671252096:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774803.926763:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.926783:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b300 going to sleep for 11 seconds 00000100:00100000:1.0:1785774803.926838:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252096 00000100:00100000:1.0:1785774803.926842:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252096 00000100:00100000:1.0:1785774803.926876:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1785774803.926883:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671252096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785774803.926962:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671252096:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.926968:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1785774803.926995:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671252096:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785774803.927047:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671252224:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785774803.927071:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774803.927083:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cecd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774803.927531:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252224 00000100:00100000:2.0:1785774803.927536:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252224 00000100:00100000:2.0:1785774803.927573:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:2.0:1785774803.927580:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671252224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774803.927653:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671252224:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (579us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774803.927660:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1785774803.927788:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671252224:0@lo:1000:mdt00_000.0 00000004:00080000:0.0:1785774803.927820:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:0.0:1785774803.927825:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927834:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927842:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927867:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774803.927872:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:0.0:1785774803.927876:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927883:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927890:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927906:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1785774803.927933:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774803.927939:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927948:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774803.927953:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774803.927962:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927987:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.927994:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774803.928013:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928021:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044c00/0x7b7109e1d09f2b1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928051:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774803.928055:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928062:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774803.928067:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774803.928074:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928091:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928097:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774803.928103:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928111:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09f2bf lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2c6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928123:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774803.928124:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774803.928126:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774803.928137:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671252352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.928212:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.928241:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774803.928247:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671252480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.928269:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.928296:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252352 00000100:00100000:0.0:1785774803.928301:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252352 00000100:00100000:0.0:1785774803.928327:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252480 00000100:00100000:0.0:1785774803.928330:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252480 00000100:00100000:0.0:1785774803.928349:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:0.0:1785774803.928355:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+16:3655:x1872519671252352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.928366:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.928382:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f2b8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f2b1 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.928393:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774803.928403:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774803.928665:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1785774803.928674:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3655:x1872519671252480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774803.928683:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774803.928697:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f2c6 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f2bf expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.928719:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xbc0ca3a9 (ffff9b7602507d00) 00010000:00010000:1.0:1785774803.928726:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774803.928785:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774803.929574:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671252352:12345-0@lo:103:ldlm_bl.0 Request processed in 1217us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.929582:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1785774803.934664:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18381:x1872519648501120:12345-192.168.202.31@tcp:36:rm.0 Request processed in 13058us (13778us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774803.934677:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23811 00000100:00100000:1.0:1785774803.939621:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671252480:12345-0@lo:103:ldlm_bl.0 Request processed in 10938us (11340us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.939635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1785774803.944624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774803.944763:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648501376 00000100:00100000:2.0:1785774803.944773:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648501376 00000100:00100000:2.0:1785774803.944829:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23812 00000100:00100000:2.0:1785774803.944840:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18381:x1872519648501376:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774803.944919:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.944936:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.944948:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.944960:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.944966:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.944973:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945034:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945042:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945049:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774803.945326:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00010000:00010000:2.0:1785774803.945373:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945383:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945390:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945398:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945405:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945411:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945433:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774803.945449:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945455:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945461:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945466:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774803.945470:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.945573:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774803.945579:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.945586:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774803.945589:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.945597:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.945610:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff9b760572bd00) 00010000:00010000:1.0:1785774803.945612:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774803.945617:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.945623:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f2e2 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.945640:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.945642:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.945643:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774803.945673:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945681:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff9b760572bd00) 00010000:00010000:2.0:1785774803.945683:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774803.945686:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945694:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f2db lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945714:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945718:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945723:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945728:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945732:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774803.945734:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945739:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945743:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b760572bf00) 00010000:00010000:2.0:1785774803.945745:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774803.945747:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 3/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945751:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f2cd lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774803.945759:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001328c141 reply state 0000000071c8833b transno 4294968499 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945768:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.945774:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xbc0ca3a9 (ffff9b760572b800) 00010000:00010000:2.0:1785774803.945776:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774803.945778:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774803.945847:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18381:x1872519648501376:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1009us (1232us total) trans 4294968499 rc 0/0 00000100:00100000:2.0:1785774803.945854:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23812 00000100:00100000:0.0:1785774803.952427:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671252480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774803.952503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774803.952568:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671252352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.952669:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648501632 00000100:00100000:0.0:1785774803.952676:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648501632 00000100:00100000:0.0:1785774803.952730:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23813 00000100:00100000:0.0:1785774803.952739:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18381:x1872519648501632:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774803.952794:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.952822:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f10d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfa8 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.952840:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774803.952851:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774803.952896:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.952905:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.952914:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.952933:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252608:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774803.952976:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.953027:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095600 going to sleep for 11 seconds 00000100:00100000:2.0:1785774803.953069:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252608 00000100:00100000:2.0:1785774803.953074:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252608 00000100:00100000:2.0:1785774803.953103:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:2.0:1785774803.953109:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:8469:x1872519671252608:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774803.953119:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774803.953134:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f2f0 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f2e9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.953183:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f2f0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f2e9 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.953199:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f2f0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f2e9 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.953207:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b760572b000) 00010000:00010000:2.0:1785774803.953210:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774803.953213:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044800, rc 0) 00000100:00100000:2.0:1785774803.953249:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:8469:x1872519671252608:12345-0@lo:101:mdt00_003.0 Request processed in 140us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.953257:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1785774803.954304:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252608:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774803.954324:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.954337:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774803.954355:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:0.0:1785774803.954382:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.954389:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.954397:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774803.954411:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252736:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774803.954454:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.954486:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774803.954664:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252736 00000100:00100000:3.0:1785774803.954670:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252736 00000100:00100000:3.0:1785774803.954710:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:3.0:1785774803.954717:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:8469:x1872519671252736:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774803.954728:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774803.954741:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09f2fe lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f2f7 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.954758:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09f2fe lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f2f7 expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.954769:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09f2fe lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f2f7 expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.954776:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7602507e00) 00010000:00010000:3.0:1785774803.954779:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.954782:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745600, rc 0) 00000100:00100000:3.0:1785774803.954819:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671252736:12345-0@lo:101:mdt00_003.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774803.954825:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:0.0:1785774803.956316:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252736:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774803.956334:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.956343:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774803.956360:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00000100:00100000:0.0:1785774803.956396:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774803.956442:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.956470:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606095540 going to sleep for 11 seconds 00000100:00100000:2.0:1785774803.956543:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252864 00000100:00100000:2.0:1785774803.956548:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252864 00000100:00100000:2.0:1785774803.956576:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1785774803.956582:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671252864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774803.956638:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671252864:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774803.956644:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1785774803.956729:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774803.956761:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785774803.956781:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.956806:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774803.956847:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671252992 00000100:00100000:1.0:1785774803.956852:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671252992 00000100:00100000:1.0:1785774803.956886:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:1.0:1785774803.956893:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671252992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774803.956977:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671252992:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774803.956984:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:2.0:1785774803.957041:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671252992:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1785774803.957057:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.957063:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.957071:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.957078:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.957103:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774803.957107:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.957111:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.957118:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.957131:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.957141:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774803.957257:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18381:x1872519648501632:12345-192.168.202.31@tcp:36:rm.0 Request processed in 4517us (4754us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774803.957263:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23813 00010000:00010000:1.0:1785774803.957323:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774803.957328:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957335:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774803.957340:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.957347:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957371:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957377:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774803.957400:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957408:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f2e9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2f0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957433:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774803.957436:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957443:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774803.957447:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.957453:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957469:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957484:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774803.957489:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957496:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2000/0x7b7109e1d09f2f7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f2fe expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.957507:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.957509:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.957510:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774803.957766:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671253120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.957796:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.957830:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774803.957836:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671253248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.957859:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.958075:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671253120 00000100:00100000:0.0:1785774803.958080:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671253120 00000100:00100000:0.0:1785774803.958115:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671253248 00000100:00100000:0.0:1785774803.958118:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671253248 00000100:00100000:0.0:1785774803.958140:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1785774803.958146:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+16:3653:x1872519671253120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.958178:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.958194:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d09f2f0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f2e9 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.958208:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b760572b000) 00010000:00010000:0.0:1785774803.958216:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774803.958239:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671253120:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.958246:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1785774803.958257:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1785774803.958262:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671253248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.958270:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.958279:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d09f2fe lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f2f7 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.958292:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x84832a57 (ffff9b7602507e00) 00010000:00010000:0.0:1785774803.958297:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774803.958313:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671253248:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.958318:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00010000:00010000:0.0:1785774803.958330:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774803.958388:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671253248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774803.958395:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671253120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774803.962812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774803.963284:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648501888 00000100:00100000:2.0:1785774803.963293:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648501888 00000100:00100000:2.0:1785774803.963351:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23814 00000100:00100000:2.0:1785774803.963361:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18381:x1872519648501888:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774803.963458:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963612:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963626:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963642:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963649:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963656:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963716:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963724:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.963730:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774803.963956:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00010000:00010000:2.0:1785774803.964004:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964013:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964021:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964027:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964033:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964039:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964053:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774803.964070:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964076:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964082:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964088:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774803.964092:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964099:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964109:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff9b760572b600) 00010000:00010000:2.0:1785774803.964112:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774803.964116:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964122:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d09f313 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964142:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964148:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964184:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964191:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964195:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774803.964198:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964204:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964210:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b760572bf00) 00010000:00010000:2.0:1785774803.964212:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774803.964215:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964220:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d09f305 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774803.964233:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076afc6a0 reply state 000000003900a781 transno 4294968500 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964243:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.964248:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x84832a57 (ffff9b760572bd00) 00010000:00010000:2.0:1785774803.964251:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774803.964253:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774803.964321:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18381:x1872519648501888:12345-192.168.202.31@tcp:36:rm.0 Request processed in 960us (1517us total) trans 4294968500 rc 0/0 00000100:00100000:2.0:1785774803.964329:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23814 00010000:00010000:3.0:1785774803.968383:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774803.968397:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.968413:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774803.968418:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.968438:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.968457:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff9b760572b600) 00010000:00010000:3.0:1785774803.968460:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774803.968465:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 1/0,0 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.968478:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f31a lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.968501:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.968503:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.968505:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774803.974501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774803.974625:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648502144 00000100:00100000:2.0:1785774803.974634:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648502144 00000100:00100000:2.0:1785774803.974689:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23815 00000100:00100000:2.0:1785774803.974699:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18381:x1872519648502144:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774803.974754:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774803.974779:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f1df lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c003 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.974796:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff9b7702bc0600) 00010000:00010000:2.0:1785774803.974807:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774803.974857:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.974866:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.974891:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.974911:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253376:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774803.974957:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.975017:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.975073:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671253376 00000100:00100000:0.0:1785774803.975079:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671253376 00000100:00100000:0.0:1785774803.975113:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1785774803.975120:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:8627:x1872519671253376:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1785774803.975130:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774803.975145:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f328 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f321 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.975198:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f328 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f321 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.975212:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f328 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f321 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.975219:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774803.975221:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774803.975224:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2e00, rc 0) 00000100:00100000:0.0:1785774803.975264:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:8627:x1872519671253376:12345-0@lo:101:mdt00_004.0 Request processed in 145us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.975272:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:2.0:1785774803.975520:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253376:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774803.975536:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.975546:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774803.975565:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.975583:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.975590:0:8627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.975596:0:8627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774803.975608:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253504:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1785774803.975630:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.975659:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:1.0:1785774803.975792:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671253504 00000100:00100000:1.0:1785774803.975797:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671253504 00000100:00100000:1.0:1785774803.975831:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1785774803.975838:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:8627:x1872519671253504:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1785774803.975847:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774803.975861:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f336 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f32f expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.975889:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f336 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f32f expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.975901:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f336 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f32f expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.975907:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7605fcca00) 00010000:00010000:1.0:1785774803.975910:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774803.975912:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce000, rc 0) 00000100:00100000:1.0:1785774803.975952:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671253504:12345-0@lo:101:mdt00_004.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774803.975958:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:2.0:1785774803.976114:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253504:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1785774803.976125:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.976134:0:8627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774803.976145:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00000100:00100000:2.0:1785774803.976209:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253632:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774803.976232:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.976247:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.976291:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671253632 00000100:00100000:0.0:1785774803.976295:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671253632 00000100:00100000:0.0:1785774803.976322:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1785774803.976329:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671253632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774803.976393:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671253632:12345-0@lo:1000:mdt00_004.0 Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.976401:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:2.0:1785774803.976575:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253632:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774803.976612:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253760:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1785774803.976637:0:8627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774803.976657:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774803.976698:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671253760 00000100:00100000:0.0:1785774803.976703:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671253760 00000100:00100000:0.0:1785774803.976731:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:0.0:1785774803.976737:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671253760:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1785774803.976805:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8627:x1872519671253760:12345-0@lo:1000:mdt00_004.0 Request processed in 68us (167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774803.976811:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1785774803.976946:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:8627:1872519671253760:0@lo:1000:mdt00_004.0 00000004:00080000:2.0:1785774803.976962:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.976967:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.976976:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.976985:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.977006:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774803.977011:0:8627:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774803.977014:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.977022:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.977030:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.977047:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774803.977104:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18381:x1872519648502144:12345-192.168.202.31@tcp:36:rm.0 Request processed in 2405us (2612us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774803.977111:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23815 00010000:00010000:1.0:1785774803.977319:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774803.977326:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977335:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774803.977341:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.977350:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977374:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977380:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774803.977405:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977413:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742044000/0x7b7109e1d09f321 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f328 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977436:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774803.977440:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977445:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774803.977449:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774803.977455:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977469:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977483:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774803.977488:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977495:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7742045600/0x7b7109e1d09f32f lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774803.977508:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.977509:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774803.977511:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774803.977649:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671253888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.977683:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.977718:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774803.977724:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671254016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.977743:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774803.977763:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671253888 00000100:00100000:0.0:1785774803.977767:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671253888 00000100:00100000:0.0:1785774803.977788:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671254016 00000100:00100000:0.0:1785774803.977790:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671254016 00000100:00100000:0.0:1785774803.977805:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1785774803.977812:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706102c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+16:3655:x1872519671253888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.977825:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.977840:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f328 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f321 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.977854:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774803.977862:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774803.977893:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706102c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3655:x1872519671253888:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.977898:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1785774803.977932:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1785774803.977937:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671254016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774803.977943:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774803.977952:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f336 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f32f expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.977961:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0xb62e0cbf (ffff9b7605fcca00) 00010000:00010000:0.0:1785774803.977966:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774803.977983:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671254016:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774803.977987:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1785774803.978008:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671254016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774803.978014:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671253888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774803.978908:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774803.984751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774803.984861:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648502400 00000100:00100000:2.0:1785774803.984881:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648502400 00000100:00100000:2.0:1785774803.984945:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23816 00000100:00100000:2.0:1785774803.984954:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18381:x1872519648502400:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774803.985038:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985054:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985067:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985081:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985089:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985095:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985152:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985199:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774803.985207:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774803.985435:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00010000:00010000:3.0:1785774803.989699:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.989724:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.989736:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.989745:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.989756:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.989761:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.989791:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774803.989878:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774803.989886:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.989897:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774803.989901:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.989908:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.989922:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff9b760572b100) 00010000:00010000:0.0:1785774803.989925:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774803.989930:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 3/0,0 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774803.989938:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774803.989940:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774803.989942:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774803.989969:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d09f352 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990011:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990018:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990023:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990029:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.990033:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990038:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990047:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff9b760572b100) 00010000:00010000:3.0:1785774803.990050:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774803.990053:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990058:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d09f34b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990087:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990093:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990098:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990104:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990109:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774803.990111:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990118:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990125:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b760572b700) 00010000:00010000:3.0:1785774803.990127:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774803.990130:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 3/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990135:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d09f33d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774803.990148:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f670b6ad reply state 0000000024c54893 transno 4294968501 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990206:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774803.990213:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xb62e0cbf (ffff9b760572bc00) 00010000:00010000:3.0:1785774803.990216:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774803.990219:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774803.990304:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18381:x1872519648502400:12345-192.168.202.31@tcp:36:rm.0 Request processed in 5348us (5560us total) trans 4294968501 rc 0/0 00000100:00100000:3.0:1785774803.990313:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23816 00000100:00100000:0.0:1785774804.006089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774804.006358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648502528 00000100:00100000:1.0:1785774804.006370:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648502528 00000100:00100000:1.0:1785774804.006465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1456 00000100:00100000:1.0:1785774804.006482:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648502528:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:1.0:1785774804.006501:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774804.006527:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ecb4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be9e expref: 11 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.006546:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7702bc0b00) 00010000:00010000:1.0:1785774804.006556:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774804.006614:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648502528:12345-192.168.202.31@tcp:103:rm.0 Request processed in 133us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774804.006622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1456 00000100:00080000:0.0:1785774804.006808:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774804.007976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774804.008051:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648502784 00000100:00100000:2.0:1785774804.008057:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648502784 00000100:00100000:2.0:1785774804.008106:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5098 00000100:00100000:2.0:1785774804.008115:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18381:x1872519648502784:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:2.0:1785774804.008370:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18381:x1872519648502784:12345-192.168.202.31@tcp:35:rm.0 Request processed in 256us (397us total) trans 4294968502 rc 0/0 00000100:00100000:2.0:1785774804.008378:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5098 00000100:00100000:3.0:1785774804.017226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774804.037145:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648503040 00000100:00100000:2.0:1785774804.037185:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648503040 00000100:00100000:3.0:1785774804.041261:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23817 00000100:00100000:3.0:1785774804.041275:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18381:x1872519648503040:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774804.041336:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1785774804.041362:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09efc4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf0e expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.041388:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09ef9a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bef9 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.041399:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:3.0:1785774804.041409:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774804.041451:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.041459:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.041468:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774804.041488:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254144:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1785774804.041547:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774804.041590:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a8920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774804.041642:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671254144 00000100:00100000:0.0:1785774804.041648:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671254144 00000100:00100000:0.0:1785774804.041683:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1785774804.041690:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6529:x1872519671254144:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774804.041699:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774804.041712:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f359 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.041733:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.041747:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f359 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.041768:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.041780:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 9 pid: 8469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774804.041792:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671254272:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774804.041852:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774804.049514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774804.049583:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648503168 00000100:00100000:3.0:1785774804.049593:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648503168 00010000:00010000:3.0:1785774804.049632:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 10 pid: 8469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774804.049679:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1646 00000100:00100000:3.0:1785774804.049691:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648503168:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774804.049705:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774804.049712:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 10 pid: 8469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.049726:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 10 pid: 8469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.049747:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774804.049754:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f359 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.049767:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09f359 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.049776:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09f359 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.049821:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f359 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774804.049840:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671254400:0@lo:105: 00000100:00100000:3.0:1785774804.049897:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774804.049941:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892240 going to sleep for 11 seconds 00010000:00010000:2.0:1785774804.050094:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09ec98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259be97 expref: 10 pid: 8469 timeout: 1145 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774804.050116:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671254272:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774804.050139:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f359 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.050146:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774804.050149:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774804.050151:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2c00, rc 0) 00000100:00100000:2.0:1785774804.050226:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671254144:12345-0@lo:101:mdt00_000.0 Request processed in 8536us (8679us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774804.050235:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1785774804.050351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671254400 00000100:00100000:1.0:1785774804.050357:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671254400 00000100:00100000:1.0:1785774804.050394:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1785774804.050402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671254400:12345-0@lo:105: 00010000:00010000:1.0:1785774804.050414:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.050423:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.050432:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.050439:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.050447:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.050454:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.050468:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7711745200) 00000100:00100000:1.0:1785774804.050509:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671254400:12345-0@lo:105: Request processed in 108us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774804.050516:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1785774804.050586:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671254400:0@lo:105: 00010000:00010000:0.0:1785774804.050600:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774804.050645:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648503168:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 957us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774804.050652:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1646 00000100:00100000:3.0:1785774804.050733:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254144:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774804.050746:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774804.050764:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1785774804.050796:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.050813:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.050822:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774804.050836:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254528:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1785774804.050861:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774804.050889:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a8920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774804.051023:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671254528 00000100:00100000:0.0:1785774804.051027:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671254528 00000100:00100000:0.0:1785774804.051059:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1785774804.051065:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671254528:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774804.051079:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774804.051095:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f36e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f367 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.051117:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f36e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f367 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.051129:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f36e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f367 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.051135:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774804.051138:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774804.051140:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2600, rc 0) 00000100:00100000:0.0:1785774804.051201:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671254528:12345-0@lo:101:mdt00_000.0 Request processed in 135us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774804.051207:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1785774804.051692:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254528:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774804.051705:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.051714:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774804.051732:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1785774804.051764:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254656:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774804.051791:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774804.051819:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892240 going to sleep for 11 seconds 00000100:00100000:1.0:1785774804.051971:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671254656 00000100:00100000:1.0:1785774804.051976:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671254656 00000100:00100000:1.0:1785774804.052010:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:1.0:1785774804.052017:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671254656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785774804.052091:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671254656:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774804.052098:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1785774804.052308:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254656:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774804.052344:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254784:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774804.052366:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774804.052376:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774804.052970:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671254784 00000100:00100000:0.0:1785774804.052975:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671254784 00000100:00100000:0.0:1785774804.053007:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:0.0:1785774804.053014:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671254784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785774804.053115:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671254784:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (748us total) trans 0 rc 1/1 00000100:00100000:0.0:1785774804.053122:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:1.0:1785774804.053312:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254784:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1785774804.053361:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053370:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053381:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774804.053397:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254912:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1785774804.053421:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774804.053443:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774804.053490:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671254912 00000100:00100000:3.0:1785774804.053495:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671254912 00000100:00100000:3.0:1785774804.053523:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1785774804.053529:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671254912:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774804.053538:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774804.053554:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f37c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f375 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.053573:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f37c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f375 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.053586:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f37c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f375 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774804.053595:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:3.0:1785774804.053597:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774804.053601:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:3.0:1785774804.053634:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6529:x1872519671254912:12345-0@lo:101:mdt00_000.0 Request processed in 104us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774804.053640:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:1.0:1785774804.053723:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671254912:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774804.053735:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053744:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053766:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053774:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053782:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053797:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053814:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053821:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053839:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053847:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.053854:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774804.053864:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671255040:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1785774804.053959:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774804.053978:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774804.054067:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671255040 00000100:00100000:0.0:1785774804.054071:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671255040 00000100:00100000:0.0:1785774804.054098:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1785774804.054105:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:6529:x1872519671255040:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774804.054113:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774804.054124:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f398 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f391 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.054145:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f398 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f391 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.054194:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f398 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f391 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.054203:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774804.054206:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774804.054208:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2e00, rc 0) 00000100:00100000:0.0:1785774804.054234:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671255040:12345-0@lo:101:mdt00_000.0 Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774804.054240:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:1.0:1785774804.054328:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671255040:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774804.054338:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774804.054347:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774804.056401:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671255168:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1785774804.056462:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774804.056496:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774804.056625:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671255168 00000100:00100000:3.0:1785774804.056632:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671255168 00000100:00100000:3.0:1785774804.056986:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:3.0:1785774804.056996:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671255168:12345-0@lo:403:mdt00_000.0 00000100:00100000:3.0:1785774804.059647:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671255168:12345-0@lo:403:mdt00_000.0 Request processed in 2647us (3177us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774804.059661:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:1.0:1785774804.059763:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671255168:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1785774804.065447:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].404, 960 off605864 00000040:00080000:1.0:1785774804.065619:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].403, 1040 off652280 00000004:00080000:1.0:1785774804.065626:0:6529:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605cec300 with version 773 00000004:00080000:0.0:1785774804.065711:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 773 rpc_version 773 00000020:00100000:0.0:1785774804.065745:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774804.065755:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76056d6d80 x1872519671255424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2624/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774804.065778:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671255424:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774804.065858:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774804.066122:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093adc00 going to sleep for 11 seconds 00000100:00100000:2.0:1785774804.073569:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671255424 00000100:00100000:2.0:1785774804.073585:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671255424 00000100:00100000:0.0:1785774804.075996:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:0.0:1785774804.076011:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:7474:x1872519671255424:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774804.076610:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:7474:x1872519671255424:12345-0@lo:1000:osp_up0-1.0 Request processed in 601us (10750us total) trans 4294983592 rc 0/0 00000100:00100000:0.0:1785774804.076618:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:0.0:1785774804.076679:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671255424:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1785774804.077324:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:2.0:1785774804.077347:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077357:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077364:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077369:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774804.077373:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077379:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077392:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9b7605fccd00) 00010000:00010000:2.0:1785774804.077394:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774804.077398:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 2/0,0 mode: --/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077403:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f38a lrc: 0/0,0 mode: --/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077420:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077427:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077432:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077454:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774804.077462:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd1:0x0] 00010000:00010000:2.0:1785774804.077469:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077475:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077480:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077484:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774804.077486:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077491:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077496:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:2.0:1785774804.077499:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774804.077501:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077505:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09f383 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077516:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077521:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077527:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077549:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1785774804.077558:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1785774804.077562:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077568:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077573:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077582:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1785774804.077584:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1785774804.077588:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774804.077594:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774804.077652:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18381:x1872519648503040:12345-192.168.202.31@tcp:36:rm.0 Request processed in 36378us (60432us total) trans 4294968503 rc 0/0 00000100:00100000:2.0:1785774804.077659:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23817 00010000:00010000:0.0:1785774804.078989:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785774804.078999:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079009:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774804.079015:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774804.079024:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079059:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079065:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774804.079089:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 1/0,0 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079097:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfc00/0x7b7109e1d09f391 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f398 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079114:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774804.079117:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079123:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774804.079126:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774804.079138:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079175:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079183:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774804.079189:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079195:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09f375 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f37c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079206:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774804.079210:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079216:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774804.079220:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774804.079226:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079240:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079246:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774804.079261:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079268:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d09f359 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f360 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079276:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774804.079278:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774804.079280:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774804.079294:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671255680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774804.079339:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774804.079370:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774804.079376:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671255552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774804.079392:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774804.079411:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774804.079418:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671255808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774804.079437:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774804.079460:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671255680 00000100:00100000:0.0:1785774804.079467:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671255680 00000100:00100000:0.0:1785774804.079500:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671255552 00000100:00100000:0.0:1785774804.079503:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671255552 00000100:00100000:0.0:1785774804.079516:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671255808 00000100:00100000:0.0:1785774804.079518:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671255808 00000100:00100000:0.0:1785774804.079532:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1785774804.079540:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+20:3654:x1872519671255680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774804.079553:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774804.079570:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f37c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f375 expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079593:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:0.0:1785774804.079601:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774804.079627:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+19:3654:x1872519671255680:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774804.079634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1785774804.079649:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:0.0:1785774804.079655:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+18:3654:x1872519671255552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774804.079661:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774804.079671:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f398 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f391 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079681:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9b7702bc0300) 00010000:00010000:0.0:1785774804.079686:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774804.079703:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+17:3654:x1872519671255552:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774804.079709:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:0.0:1785774804.079720:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1785774804.079726:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+16:3656:x1872519671255808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774804.079732:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774804.079741:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f360 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f359 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774804.079750:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774804.079754:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774804.079773:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3656:x1872519671255808:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774804.079779:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1785774804.079935:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671255808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774804.079964:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671255552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774804.079971:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671255680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774804.083300:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774804.083539:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774804.133135:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671255936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774804.133236:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774804.133389:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671255936 00000100:00100000:2.0:1785774804.133397:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671255936 00000100:00100000:2.0:1785774804.133451:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1785774804.133460:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671255936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785774804.133488:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42335680 pending 86016 free 3923480576 avail 3691958272 00000100:00100000:2.0:1785774804.133532:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671255936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774804.133539:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1785774804.133587:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671256064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774804.133612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785774804.133815:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774804.133827:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256064 00000100:00100000:0.0:1785774804.133831:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256064 00000100:00100000:0.0:1785774804.133877:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1785774804.133884:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3653:x1872519671256064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774804.133895:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42335680 pending 86016 free 3923480576 avail 3691958272 00000100:00100000:0.0:1785774804.133927:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3653:x1872519671256064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774804.133933:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1785774804.133971:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671256064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774804.134066:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671255936:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1785774804.134212:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785774804.773425:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774805.161426:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774805.161458:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671256192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774805.161548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774805.161630:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256192 00000100:00100000:2.0:1785774805.161639:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256192 00000100:00100000:2.0:1785774805.161701:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:2.0:1785774805.161711:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671256192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774805.161762:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445109760 avail 1298870272 00000100:00100000:2.0:1785774805.161814:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671256192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774805.161821:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:2.0:1785774805.161870:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968479 gen 2 00000004:00080000:2.0:1785774805.161877:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968473 committed transno 4294968479 00000004:00080000:2.0:1785774805.161900:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968474 committed transno 4294968479 00000020:00080000:2.0:1785774805.161907:0:3653:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b760368c780 refcount 2 committed 0 result 0 batchid 409 00000020:00080000:2.0:1785774805.161912:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605fd0180 00000020:00080000:2.0:1785774805.161916:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760368cb40 00000020:00080000:2.0:1785774805.161919:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].396 00000020:00080000:2.0:1785774805.161922:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ecf800 00000020:00080000:2.0:1785774805.161925:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].397 00000004:00080000:2.0:1785774805.161944:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968475 committed transno 4294968479 00000020:00080000:2.0:1785774805.161949:0:3653:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605d0e600 refcount 2 committed 0 result 0 batchid 410 00000020:00080000:2.0:1785774805.161952:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7735b70b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77012edc00 00000020:00080000:2.0:1785774805.161955:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7735b70e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605d0e480 00000020:00080000:2.0:1785774805.161958:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].397 00000020:00080000:2.0:1785774805.161960:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7735b97b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603611c00 00000020:00080000:2.0:1785774805.161963:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].398 00000004:00080000:2.0:1785774805.161976:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968476 committed transno 4294968479 00000020:00080000:2.0:1785774805.161980:0:3653:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605fd0e40 refcount 2 committed 0 result 0 batchid 411 00000020:00080000:2.0:1785774805.161982:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cec900 00000020:00080000:2.0:1785774805.161985:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605fd09c0 00000020:00080000:2.0:1785774805.161988:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].398 00000020:00080000:2.0:1785774805.161990:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7602585400 00000020:00080000:2.0:1785774805.161993:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].399 00000004:00080000:2.0:1785774805.162005:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968477 committed transno 4294968479 00000020:00080000:2.0:1785774805.162008:0:3653:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605ebb480 refcount 2 committed 0 result 0 batchid 412 00000020:00080000:2.0:1785774805.162011:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054ab900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ebb000 00000020:00080000:2.0:1785774805.162014:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054abb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ebb0c0 00000020:00080000:2.0:1785774805.162017:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].399 00000020:00080000:2.0:1785774805.162019:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054aba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76044a9400 00000020:00080000:2.0:1785774805.162022:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].400 00000004:00080000:2.0:1785774805.162050:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968478 committed transno 4294968479 00000020:00080000:2.0:1785774805.162054:0:3653:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7606095e40 refcount 2 committed 0 result 0 batchid 413 00000020:00080000:2.0:1785774805.162057:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7606095000 00000020:00080000:2.0:1785774805.162060:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7606095d80 00000020:00080000:2.0:1785774805.162063:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].400 00000020:00080000:2.0:1785774805.162065:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76054c7000 00000020:00080000:2.0:1785774805.162067:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].401 00000004:00080000:2.0:1785774805.162083:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968479 committed transno 4294968479 00000020:00080000:2.0:1785774805.162086:0:3653:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605ebb540 refcount 2 committed 0 result 0 batchid 414 00000020:00080000:2.0:1785774805.162089:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054ab800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760632b000 00000020:00080000:2.0:1785774805.162092:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054ab500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ebb240 00000020:00080000:2.0:1785774805.162094:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].401 00000020:00080000:2.0:1785774805.162096:0:3653:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054abd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b760602ba00 00000020:00080000:2.0:1785774805.162098:0:3653:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].402 00000100:00100000:2.0:1785774805.162119:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671256192:0@lo:41:osp-pre-1-0.0 00000020:00080000:2.0:1785774805.162139:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 414 committed batchid 408 00000020:00080000:2.0:1785774805.162344:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 408 00000004:00080000:0.0:1785774805.166666:0:9844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1047017502561ns, next at 1048017498726ns, rc = 0 00000100:00100000:3.0:1785774805.167182:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671256448:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167332:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167382:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671256960:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167412:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167430:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671257472:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167451:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167479:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1785774805.167485:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671256320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774805.167513:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167533:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671256832:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167555:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167571:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671257344:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167593:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167611:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671257856:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167631:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774805.167649:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256448 00000100:00100000:3.0:1785774805.167656:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671256704:0@lo:400:kworker.0 00000100:00100000:0.0:1785774805.167659:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256448 00000100:00100000:3.0:1785774805.167682:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167698:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671257216:0@lo:400:kworker.0 00000100:00100000:0.0:1785774805.167712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1785774805.167717:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774805.167723:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671256448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167731:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671257728:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167748:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167765:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1785774805.167770:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671256576:0@lo:400:kworker.0 00000100:00100000:0.0:1785774805.167779:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671256448:12345-0@lo:400:kworker.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774805.167787:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1785774805.167789:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167805:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671257088:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.167824:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167837:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671257600:0@lo:400:kworker.0 00000100:00100000:0.0:1785774805.167849:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256960 00000100:00100000:0.0:1785774805.167853:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256960 00000100:00100000:3.0:1785774805.167857:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.167876:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256320 00000100:00100000:3.0:1785774805.167879:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256320 00000100:00100000:0.0:1785774805.167900:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257472 00000100:00100000:0.0:1785774805.167903:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257472 00000100:00100000:3.0:1785774805.167909:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1785774805.167915:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671256320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774805.167927:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256832 00000100:00100000:0.0:1785774805.167930:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256832 00002000:00000024:3.0:1785774805.167940:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42368448 pending 86016 free 3923513344 avail 3691991040 00000100:00100000:0.0:1785774805.167945:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256576 00000100:00100000:0.0:1785774805.167946:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256576 00000100:00100000:0.0:1785774805.167956:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257088 00000100:00100000:0.0:1785774805.167958:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257088 00000100:00100000:0.0:1785774805.167969:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257600 00000100:00100000:0.0:1785774805.167971:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257600 00000100:00100000:3.0:1785774805.167974:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671256320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.167981:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1785774805.167984:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1785774805.167990:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671256960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168000:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1785774805.168005:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671257472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774805.168023:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671256960:12345-0@lo:400:kworker.0 Request processed in 33us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.168029:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671257472:12345-0@lo:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774805.168029:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:3.0:1785774805.168038:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1785774805.168042:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1785774805.168047:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671256832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168049:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1785774805.168053:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671256576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774805.168073:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671256832:12345-0@lo:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.168079:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671256576:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774805.168079:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1785774805.168085:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1785774805.168090:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1785774805.168093:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1785774805.168095:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671257088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168098:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671257600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168121:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671257600:12345-0@lo:400:kworker.0 Request processed in 21us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774805.168121:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671257088:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.168126:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1785774805.168203:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257344 00000100:00100000:2.0:1785774805.168207:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257344 00000100:00100000:2.0:1785774805.168250:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257856 00000100:00100000:2.0:1785774805.168254:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257856 00000100:00100000:2.0:1785774805.168274:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257216 00000100:00100000:2.0:1785774805.168276:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257216 00000100:00100000:2.0:1785774805.168295:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257728 00000100:00100000:2.0:1785774805.168298:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257728 00000100:00100000:2.0:1785774805.168318:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1785774805.168325:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671257344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774805.168342:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:0.0:1785774805.168361:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774805.168362:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671257344:12345-0@lo:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00080000:0.0:1785774805.168366:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774805.168368:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774805.168369:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1785774805.168383:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1785774805.168389:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671257856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774805.168416:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671257856:12345-0@lo:400:kworker.0 Request processed in 27us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774805.168422:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1785774805.168432:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1785774805.168438:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671257216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774805.168463:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671257216:12345-0@lo:400:kworker.0 Request processed in 25us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774805.168469:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1785774805.168477:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1785774805.168483:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671257728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774805.168502:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671257728:12345-0@lo:400:kworker.0 Request processed in 20us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774805.168508:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1785774805.168631:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671256704 00000100:00100000:3.0:1785774805.168636:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671256704 00000100:00100000:3.0:1785774805.168674:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:3.0:1785774805.168681:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671256704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168716:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671256704:12345-0@lo:400:kworker.0 Request processed in 36us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.168721:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:3.0:1785774805.168780:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671256576:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168790:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671257088:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168799:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671257600:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168809:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671256704:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168817:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671257216:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168826:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671257728:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168862:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671256320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774805.168871:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671256832:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168879:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671257344:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168888:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671257856:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168896:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671256448:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168904:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671256960:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.168913:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671257472:0@lo:400:kworker.0 00000100:00100000:3.0:1785774805.506478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.515052:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648503296 00000100:00100000:2.0:1785774805.515071:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648503296 00000100:00100000:2.0:1785774805.521425:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23818 00000100:00100000:2.0:1785774805.521454:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18392:x1872519648503296:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774805.521484:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774805.521512:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f39f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c049 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.521592:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f3a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.521611:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.521627:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774805.521690:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774805.521694:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774805.521717:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.521745:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f39f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c049 expref: 11 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.521767:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c049 expref: 10 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.521777:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774805.521780:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774805.521784:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044c00, rc 0) 00000100:00100000:2.0:1785774805.521886:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18392:x1872519648503296:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 445us (15423us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774805.521894:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23818 00000100:00100000:2.0:1785774805.543110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.543251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.543707:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648503552 00000100:00100000:3.0:1785774805.543723:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648503552 00000100:00100000:2.0:1785774805.543890:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3821 00000100:00100000:2.0:1785774805.543911:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2418:x1872519648503552:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:2.0:1785774805.544023:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774805.544049:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f3ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c057 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544205:0:20645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544224:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544239:0:20645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544258:0:20645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544265:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544272:0:20645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544337:0:20645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544345:0:20645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544353:0:20645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544359:0:20645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774805.544365:0:20645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544374:0:20645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544388:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774805.544968:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774805.544976:0:20645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.544984:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f3b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545000:0:20645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545007:0:20645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545013:0:20645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545019:0:20645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774805.545022:0:20645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545028:0:20645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545036:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x861f4748 (ffff9b7605dfe500) 00010000:00010000:2.0:1785774805.545039:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774805.545042:0:20645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545049:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545082:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f3ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c057 expref: 11 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545093:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774805.545095:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774805.545099:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f3ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c057 expref: 11 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.545109:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045000, rc -2) 00000100:00100000:2.0:1785774805.546523:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2418:x1872519648503552:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 2615us (3421us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774805.546537:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3821 00000100:00100000:1.0:1785774805.549094:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648503424 00000100:00100000:1.0:1785774805.549110:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648503424 00000100:00100000:1.0:1785774805.549215:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23819 00000100:00100000:1.0:1785774805.549228:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18392:x1872519648503424:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774805.549256:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774805.549281:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f3c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c050 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549361:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549378:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549464:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549486:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549494:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549502:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549576:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549584:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549590:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549601:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549608:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774805.549613:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549622:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549636:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774805.549640:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774805.549645:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549652:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f3c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549662:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549667:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549673:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549679:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774805.549681:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549691:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549698:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774805.549700:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774805.549703:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549709:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f3d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549742:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f3c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c050 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549754:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774805.549756:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774805.549760:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f3c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c050 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.549769:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:1.0:1785774805.559553:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18392:x1872519648503424:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 10308us (16282us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774805.559570:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23819 00000100:00100000:0.0:1785774805.575570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.575932:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648503808 00000100:00100000:3.0:1785774805.575946:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648503808 00000100:00100000:3.0:1785774805.576016:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23820 00000100:00100000:3.0:1785774805.576029:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18392:x1872519648503808:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1785774805.576106:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774805.576150:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f3a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c049 expref: 10 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.576264:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774805.576271:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774805.576367:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.576388:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.576506:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.576526:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.576533:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.576540:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:02000000:3.0:1785774805.576699:0:6531:0:(lod_object.c:2112:lod_mdt_alloc_specific()) *** cfs_fail_loc=189, val=0*** 00010000:00010000:3.0:1785774805.589248:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589273:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589288:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589309:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589316:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589323:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774805.589333:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8c94b5f reply state 000000002c9d5ddf transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589345:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589353:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774805.589356:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774805.589361:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00010000:3.0:1785774805.589368:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8c94b5f reply state 000000002c9d5ddf transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589375:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589380:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774805.589382:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774805.589384:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1785774805.589390:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153a:0x0]: returning size 4096 00010000:00010000:3.0:1785774805.589411:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589418:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589425:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589433:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589439:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774805.589446:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589454:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589466:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774805.589468:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774805.589472:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589479:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f3d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774805.589499:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8c94b5f reply state 000000002c9d5ddf transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589507:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.589513:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7602507400) 00010000:00010000:3.0:1785774805.589515:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774805.589518:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1785774805.589635:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18392:x1872519648503808:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 13605us (14072us total) trans 4294983593 rc 0/0 00000100:00100000:3.0:1785774805.589645:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23820 00000100:00100000:0.0:1785774805.601951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.602038:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648503936 00000100:00100000:2.0:1785774805.602053:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648503936 00000100:00100000:2.0:1785774805.602125:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23821 00000100:00100000:2.0:1785774805.602145:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18204:x1872519648503936:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774805.602242:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774805.602270:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f3f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c05e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.602354:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.602376:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.602389:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774805.602457:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774805.602461:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774805.602489:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.602516:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f3f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c05e expref: 13 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.602538:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c05e expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.602548:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774805.602551:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774805.602555:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044000, rc 0) 00000100:00100000:2.0:1785774805.602621:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18204:x1872519648503936:12345-192.168.202.31@tcp:101:bash.0 Request processed in 487us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774805.602629:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23821 00000100:00100000:3.0:1785774805.608089:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774805.608307:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648504064 00000100:00100000:1.0:1785774805.608321:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648504064 00000100:00100000:1.0:1785774805.608407:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23822 00000100:00100000:1.0:1785774805.608421:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18204:x1872519648504064:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774805.608454:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774805.608484:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c065 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608562:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608578:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608592:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608604:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608612:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608618:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608701:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608709:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608716:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774805.608808:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153a:0x0]: returning size 4096 00000004:00200000:1.0:1785774805.608815:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1785774805.608839:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608854:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608862:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608869:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608876:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608883:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774805.608887:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608895:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608909:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774805.608912:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774805.608916:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608923:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608937:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608947:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608966:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608972:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774805.608977:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608983:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.608991:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7602507400) 00010000:00010000:1.0:1785774805.608994:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774805.608997:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.609002:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f40f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.609029:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c065 expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.609042:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c065 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.609049:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9b7602507500) 00010000:00010000:1.0:1785774805.609052:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785774805.609055:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:1.0:1785774805.609123:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18204:x1872519648504064:12345-192.168.202.31@tcp:101:bash.0 Request processed in 706us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774805.609130:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23822 00000100:00100000:1.0:1785774805.614970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.615060:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648504192 00000100:00100000:3.0:1785774805.615073:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648504192 00000100:00100000:3.0:1785774805.615179:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23823 00000100:00100000:3.0:1785774805.615191:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18204:x1872519648504192:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.615221:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.615246:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f41d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c06c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.615323:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f424 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.615342:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f424 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.615354:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f424 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774805.615425:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd2:0x0]: returning size 4096 00000004:00200000:3.0:1785774805.615431:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1785774805.615472:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f41d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c06c expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.615501:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f424 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c06c expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.615510:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774805.615513:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774805.615516:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744000, rc 0) 00000100:00100000:3.0:1785774805.615586:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18204:x1872519648504192:12345-192.168.202.31@tcp:101:bash.0 Request processed in 397us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.615594:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23823 00000100:00100000:3.0:1785774805.627238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.627346:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648504448 00000100:00100000:2.0:1785774805.627359:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648504448 00000100:00100000:2.0:1785774805.627435:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23824 00000100:00100000:2.0:1785774805.627446:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18204:x1872519648504448:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774805.627477:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774805.627482:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785774805.627516:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f424 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c06c expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.627546:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:2.0:1785774805.627552:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774805.627569:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f42b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c073 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.627736:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.627753:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.627765:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.627784:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.627791:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.627798:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774805.628242:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cb:0x0], index 0: 0 00010000:00010000:2.0:1785774805.628414:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09f440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628425:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09f440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628434:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09f440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628475:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628483:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628490:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628497:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628504:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774805.628508:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628517:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628526:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:2.0:1785774805.628529:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774805.628533:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628539:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09f432 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774805.628554:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e13f670 reply state 0000000078079075 transno 4294983594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628567:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628573:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7605dfe500) 00010000:00010000:2.0:1785774805.628576:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774805.628579:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774805.628607:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09f42b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c073 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628623:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09f440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c073 expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.628630:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774805.628633:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774805.628635:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35be00, rc 0) 00000100:00100000:2.0:1785774805.628712:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18204:x1872519648504448:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1267us (1487us total) trans 4294983594 rc 0/0 00000100:00100000:2.0:1785774805.628720:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23824 00000100:00100000:3.0:1785774805.646951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774805.647223:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648504576 00000100:00100000:1.0:1785774805.647237:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648504576 00000100:00100000:1.0:1785774805.647313:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5207 00000100:00100000:1.0:1785774805.647324:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18204:x1872519648504576:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774805.647348:0:14719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774805.647373:0:14719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c07a expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785774805.647482:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1785774805.647542:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774805.647573:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=1047s v=(0 0) 00010000:00010000:1.0:1785774805.647578:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774805.647590:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 17 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.647612:0:14719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 17 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774805.647627:0:14719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:1.0:1785774805.647727:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18204:x1872519648504576:12345-192.168.202.31@tcp:101:bash.0 Request processed in 404us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774805.647735:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5207 00000100:00100000:1.0:1785774805.668257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.668365:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648504832 00000100:00100000:2.0:1785774805.668378:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648504832 00000100:00100000:2.0:1785774805.668466:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5099 00000100:00100000:2.0:1785774805.668478:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18204:x1872519648504832:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774805.668855:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18204:x1872519648504832:12345-192.168.202.31@tcp:35:bash.0 Request processed in 378us (610us total) trans 4294983595 rc 0/0 00000100:00100000:2.0:1785774805.668864:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5099 00000100:00100000:3.0:1785774805.670306:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671257984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774805.670377:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774805.670485:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671257984 00000100:00100000:3.0:1785774805.670493:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671257984 00000100:00100000:3.0:1785774805.670539:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1785774805.670547:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671257984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774805.670573:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42368448 pending 86016 free 3923513344 avail 3691991040 00000100:00100000:3.0:1785774805.670616:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671257984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.670623:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1785774805.670682:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671257984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774805.678062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.678374:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648505088 00000100:00100000:3.0:1785774805.678388:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648505088 00000100:00100000:3.0:1785774805.678477:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23825 00000100:00100000:3.0:1785774805.678490:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18204:x1872519648505088:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.678522:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.678550:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09f455 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c081 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.678679:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.678698:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.678711:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.678730:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.678738:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.678745:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774805.679451:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cb:0x0], index 1: 0 00010000:00010000:3.0:1785774805.683704:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f46a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683733:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f46a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683748:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f46a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683798:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683806:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683811:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683818:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683824:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774805.683830:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683838:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683853:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774805.683857:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774805.683862:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683870:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f45c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774805.683894:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000635f64e1 reply state 000000006f90be1a transno 4294983596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683908:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683914:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b7602507800) 00010000:00010000:3.0:1785774805.683917:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774805.683920:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774805.683962:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09f455 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c081 expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683980:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f46a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c081 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.683989:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:3.0:1785774805.683991:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774805.683994:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:3.0:1785774805.685584:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18204:x1872519648505088:12345-192.168.202.31@tcp:101:bash.0 Request processed in 7087us (7526us total) trans 4294983596 rc 0/0 00000100:00100000:3.0:1785774805.685598:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23825 00000100:00100000:0.0:1785774805.706614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774805.706654:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648505216 00000100:00100000:0.0:1785774805.706665:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648505216 00000100:00100000:0.0:1785774805.706733:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5208 00000100:00100000:0.0:1785774805.706743:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18204:x1872519648505216:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774805.706767:0:14530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774805.706796:0:14530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c088 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774805.706829:0:14530:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774805.706857:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=1047s v=(0 0) 00010000:00010000:0.0:1785774805.706862:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774805.706874:0:14530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 16 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774805.706896:0:14530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 16 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774805.706923:0:14530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2400, rc 0) 00000100:00100000:0.0:1785774805.706986:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18204:x1872519648505216:12345-192.168.202.31@tcp:101:bash.0 Request processed in 244us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774805.706995:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5208 00000100:00080000:0.0:1785774805.707298:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774805.726587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.726668:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648505472 00000100:00100000:2.0:1785774805.726681:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648505472 00000100:00100000:2.0:1785774805.726753:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5100 00000100:00100000:2.0:1785774805.726766:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732244450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18204:x1872519648505472:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774805.727195:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732244450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18204:x1872519648505472:12345-192.168.202.31@tcp:35:bash.0 Request processed in 430us (617us total) trans 4294983597 rc 0/0 00000100:00100000:2.0:1785774805.727204:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5100 00000100:00100000:1.0:1785774805.744448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.744528:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648505728 00000100:00100000:3.0:1785774805.744541:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648505728 00000100:00100000:3.0:1785774805.744638:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23826 00000100:00100000:3.0:1785774805.744649:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18204:x1872519648505728:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.744680:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.744706:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09f47f lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c08f expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.744828:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.744845:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.744857:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.744872:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.744879:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.744885:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774805.745386:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cc:0x0], index 0: 0 00010000:00010000:3.0:1785774805.745558:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f494 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745569:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745577:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745619:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745626:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745633:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745640:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745646:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774805.745651:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745659:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745672:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774805.745676:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774805.745682:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745694:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f486 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774805.745716:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a19c4e25 reply state 00000000d5d94bf9 transno 4294983598 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745729:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745735:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7602507e00) 00010000:00010000:3.0:1785774805.745738:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774805.745741:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774805.745772:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09f47f lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c08f expref: 24 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745788:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c08f expref: 23 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.745796:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:3.0:1785774805.745799:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774805.745801:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744800, rc 0) 00000100:00100000:3.0:1785774805.745881:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:18204:x1872519648505728:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1233us (1444us total) trans 4294983598 rc 0/0 00000100:00100000:3.0:1785774805.745889:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23826 00000100:00100000:1.0:1785774805.773106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774805.774027:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648505856 00000100:00100000:0.0:1785774805.774041:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648505856 00000100:00100000:0.0:1785774805.774109:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5209 00000100:00100000:0.0:1785774805.774120:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18204:x1872519648505856:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774805.774155:0:8661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774805.774200:0:8661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c096 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774805.774232:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774805.774260:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=1047s v=(0 0) 00010000:00010000:0.0:1785774805.774265:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774805.774276:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 18 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774805.774297:0:8661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 18 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774805.774313:0:8661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3800, rc 0) 00000100:00100000:0.0:1785774805.774377:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18204:x1872519648505856:12345-192.168.202.31@tcp:101:bash.0 Request processed in 260us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774805.774384:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5209 00000100:00100000:1.0:1785774805.792313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774805.792356:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648506112 00000100:00100000:1.0:1785774805.792368:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648506112 00000100:00100000:1.0:1785774805.792424:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5101 00000100:00100000:1.0:1785774805.792436:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:18204:x1872519648506112:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774805.792806:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18204:x1872519648506112:12345-192.168.202.31@tcp:35:bash.0 Request processed in 372us (506us total) trans 4294983599 rc 0/0 00000100:00100000:1.0:1785774805.792815:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5101 00010000:00010000:1.0:1785774805.801047:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774805.804113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.804231:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648506368 00000100:00100000:3.0:1785774805.804245:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648506368 00000100:00100000:3.0:1785774805.804319:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23827 00000100:00100000:3.0:1785774805.804330:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18204:x1872519648506368:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.804367:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.804395:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09f4a9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c09d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.804531:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.804764:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.804781:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.804799:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.804806:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.804813:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774805.805306:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cc:0x0], index 1: 0 00010000:00010000:3.0:1785774805.805469:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f4be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805479:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f4be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805486:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f4be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805527:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805535:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805541:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805548:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805554:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774805.805559:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805566:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805578:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774805.805581:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774805.805585:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805591:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4b0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774805.805612:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023ab1d92 reply state 00000000c86a7b41 transno 4294983600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805625:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805631:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b7602507600) 00010000:00010000:3.0:1785774805.805633:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774805.805637:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774805.805666:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d09f4a9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c09d expref: 28 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805682:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f4be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c09d expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.805690:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774805.805692:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774805.805694:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:3.0:1785774805.805772:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:18204:x1872519648506368:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1443us (1669us total) trans 4294983600 rc 0/0 00000100:00100000:3.0:1785774805.805781:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23827 00000100:00100000:0.0:1785774805.825712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.827896:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648506496 00000100:00100000:2.0:1785774805.828271:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648506496 00000100:00100000:3.0:1785774805.835580:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5210 00000100:00100000:3.0:1785774805.835598:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18204:x1872519648506496:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.835625:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.835655:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0a4 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774805.835687:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774805.835716:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=1047s v=(0 0) 00010000:00010000:3.0:1785774805.835722:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774805.835735:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.835759:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.835775:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745e00, rc 0) 00000100:00100000:3.0:1785774805.836022:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18204:x1872519648506496:12345-192.168.202.31@tcp:101:bash.0 Request processed in 426us (10322us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.836030:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5210 00000100:00100000:2.0:1785774805.846400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.846462:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648506752 00000100:00100000:2.0:1785774805.846474:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648506752 00000100:00100000:2.0:1785774805.846539:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5102 00000100:00100000:2.0:1785774805.846549:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:18204:x1872519648506752:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774805.846933:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18204:x1872519648506752:12345-192.168.202.31@tcp:35:bash.0 Request processed in 384us (547us total) trans 4294983601 rc 0/0 00000100:00100000:2.0:1785774805.846942:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5102 00000100:00100000:2.0:1785774805.874982:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.875073:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648507008 00000100:00100000:3.0:1785774805.875086:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648507008 00000100:00100000:3.0:1785774805.875198:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23828 00000100:00100000:3.0:1785774805.875210:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18204:x1872519648507008:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.875242:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.875269:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4d3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0ab expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.875409:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.875427:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.875440:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.875459:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.875471:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.875478:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774805.875862:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cd:0x0], index 0: 0 00010000:00010000:3.0:1785774805.877467:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f4e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877491:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877505:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877554:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877562:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877569:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877577:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877584:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774805.877589:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877603:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877617:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:3.0:1785774805.877621:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774805.877626:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877633:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d09f4da lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774805.877656:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7b8ab59 reply state 000000009d4544df transno 4294983602 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877670:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877677:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7602507f00) 00010000:00010000:3.0:1785774805.877680:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774805.877683:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774805.877725:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d09f4d3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ab expref: 32 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877742:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ab expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.877751:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9b7709388300) 00010000:00010000:3.0:1785774805.877753:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774805.877756:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:3.0:1785774805.877859:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:18204:x1872519648507008:12345-192.168.202.31@tcp:101:bash.0 Request processed in 2651us (2954us total) trans 4294983602 rc 0/0 00000100:00100000:3.0:1785774805.877869:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23828 00000100:00100000:1.0:1785774805.888713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.888827:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648507136 00000100:00100000:3.0:1785774805.888841:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648507136 00000100:00100000:3.0:1785774805.889046:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5211 00000100:00100000:3.0:1785774805.889059:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18204:x1872519648507136:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.889087:0:14730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.889116:0:14730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0b2 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774805.889199:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774805.889234:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=1047s v=(0 0) 00010000:00010000:3.0:1785774805.889240:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774805.889252:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 19 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.889272:0:14730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 19 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.889286:0:14730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:3.0:1785774805.889367:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18204:x1872519648507136:12345-192.168.202.31@tcp:101:bash.0 Request processed in 311us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.889374:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5211 00000100:00100000:2.0:1785774805.904609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.905015:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648507392 00000100:00100000:3.0:1785774805.905028:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648507392 00000100:00100000:3.0:1785774805.905194:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5103 00000100:00100000:3.0:1785774805.905208:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:18204:x1872519648507392:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774805.905640:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:18204:x1872519648507392:12345-192.168.202.31@tcp:35:bash.0 Request processed in 434us (1044us total) trans 4294983603 rc 0/0 00000100:00100000:3.0:1785774805.905649:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5103 00000100:00100000:2.0:1785774805.916654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.916762:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648507648 00000100:00100000:3.0:1785774805.916775:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648507648 00000100:00100000:3.0:1785774805.918043:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23829 00000100:00100000:3.0:1785774805.918062:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:18204:x1872519648507648:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774805.918100:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774805.918131:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f4fd lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0b9 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.918321:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.918338:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.918352:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.918369:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.918377:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774805.918383:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774805.918799:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cd:0x0], index 1: 0 00010000:00010000:2.0:1785774805.920278:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09f512 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920297:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09f512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920310:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09f512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920354:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920363:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920370:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920378:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920384:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774805.920389:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920397:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920411:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:2.0:1785774805.920415:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774805.920420:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920427:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f504 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774805.920452:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000162b0d62 reply state 00000000e27d8e86 transno 4294983604 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920464:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920471:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7709388400) 00010000:00010000:2.0:1785774805.920473:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774805.920476:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774805.920510:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f4fd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b9 expref: 36 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920527:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09f512 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b9 expref: 35 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.920535:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:2.0:1785774805.920538:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774805.920540:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774805.920630:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:18204:x1872519648507648:12345-192.168.202.31@tcp:101:bash.0 Request processed in 2576us (3992us total) trans 4294983604 rc 0/0 00000100:00100000:2.0:1785774805.920639:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23829 00000100:00100000:0.0:1785774805.931114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.933095:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648507776 00000100:00100000:3.0:1785774805.933109:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648507776 00000100:00100000:2.0:1785774805.933288:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5212 00000100:00100000:2.0:1785774805.933300:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18204:x1872519648507776:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774805.933324:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774805.933350:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0c0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774805.933381:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774805.933410:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=1047s v=(0 0) 00010000:00010000:2.0:1785774805.933416:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774805.933427:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 18 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.933452:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 18 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774805.933466:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a800, rc 0) 00000100:00100000:2.0:1785774805.933549:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18204:x1872519648507776:12345-192.168.202.31@tcp:101:bash.0 Request processed in 251us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774805.933557:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5212 00000100:00100000:1.0:1785774805.942056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774805.942904:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648508032 00000100:00100000:2.0:1785774805.942982:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648508032 00000100:00100000:2.0:1785774805.943071:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5104 00000100:00100000:2.0:1785774805.943083:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:18204:x1872519648508032:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774805.943934:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:18204:x1872519648508032:12345-192.168.202.31@tcp:35:bash.0 Request processed in 850us (1887us total) trans 4294983605 rc 0/0 00000100:00100000:2.0:1785774805.943944:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5104 00000100:00100000:3.0:1785774805.985898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774805.986104:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648508288 00000100:00100000:0.0:1785774805.986120:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648508288 00000100:00100000:0.0:1785774805.986254:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23830 00000100:00100000:0.0:1785774805.986266:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+37:18393:x1872519648508288:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774805.986298:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774805.986326:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774805.986531:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153a:0x0]: returning size 4096 00010000:00010000:0.0:1785774805.986649:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f527 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c7 expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774805.986667:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774805.986670:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774805.986676:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c7 expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774805.986691:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2200, rc 0) 00000100:00100000:0.0:1785774805.986770:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:18393:x1872519648508288:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 506us (885us total) trans 4294983606 rc 301/301 00000100:00100000:0.0:1785774805.986778:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23830 00000100:00100000:2.0:1785774805.993622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774805.993713:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648508416 00000100:00100000:3.0:1785774805.993725:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648508416 00000100:00100000:3.0:1785774805.993800:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5105 00000100:00100000:3.0:1785774805.993811:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:18393:x1872519648508416:12345-192.168.202.31@tcp:33:lfs.0 00000004:00200000:3.0:1785774805.993990:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153a:0x0]: returning size 4096 00000004:00200000:3.0:1785774805.993996:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1785774805.994102:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:18393:x1872519648508416:12345-192.168.202.31@tcp:33:lfs.0 Request processed in 292us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774805.994110:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5105 00000100:00100000:2.0:1785774806.013679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.013811:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648508672 00000100:00100000:1.0:1785774806.013825:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648508672 00000100:00100000:1.0:1785774806.013911:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5106 00000100:00100000:1.0:1785774806.013924:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732246850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:18393:x1872519648508672:12345-192.168.202.31@tcp:35:lfs.0 00000100:00080000:0.0:1785774806.014150:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774806.014548:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732246850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:18393:x1872519648508672:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 625us (880us total) trans 4294983607 rc 0/0 00000100:00100000:1.0:1785774806.014556:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5106 00000100:00100000:2.0:1785774806.042538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.042621:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648508928 00000100:00100000:3.0:1785774806.042636:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648508928 00000100:00100000:3.0:1785774806.042705:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23831 00000100:00100000:3.0:1785774806.042716:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:18394:x1872519648508928:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774806.042747:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.042772:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0ce expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.042971:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f53c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.042989:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f53c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x153a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.043008:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f53c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x153a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774806.043021:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153a:0x0]: returning size 4096 00010000:00010000:3.0:1785774806.043147:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ce expref: 42 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.043411:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f53c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x153a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ce expref: 41 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.043422:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9b7602507500) 00010000:00010000:3.0:1785774806.043425:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785774806.043429:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:2.0:1785774806.043650:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:18394:x1872519648508928:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 933us (1122us total) trans 4294983608 rc 0/0 00000100:00100000:2.0:1785774806.043659:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23831 00000100:00100000:2.0:1785774806.055403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.055505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648509056 00000100:00100000:0.0:1785774806.055518:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648509056 00000100:00100000:0.0:1785774806.055610:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1460 00000100:00100000:0.0:1785774806.055623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706100c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:2417:x1872519648509056:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:0.0:1785774806.055646:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774806.055678:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09f3fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c05e expref: 41 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.055703:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774806.055709:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774806.055783:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706100c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:2417:x1872519648509056:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 163us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.055800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1460 00000100:00100000:1.0:1785774806.061903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.063270:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648509312 00000100:00100000:2.0:1785774806.063285:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648509312 00000100:00100000:2.0:1785774806.063361:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5107 00000100:00100000:2.0:1785774806.063374:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:18394:x1872519648509312:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1785774806.063675:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:18394:x1872519648509312:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 303us (1783us total) trans 4294983609 rc 0/0 00000100:00100000:2.0:1785774806.063685:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5107 00000100:00100000:2.0:1785774806.073322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.073653:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648509440 00000100:00100000:0.0:1785774806.073667:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648509440 00000100:00100000:0.0:1785774806.073752:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1461 00000100:00100000:0.0:1785774806.073763:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:2416:x1872519648509440:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:0.0:1785774806.073784:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1785774806.073816:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f53c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ce expref: 41 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.073849:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c065 expref: 40 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.073861:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9b7602507500) 00010000:00010000:0.0:1785774806.073866:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774806.073936:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:2416:x1872519648509440:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 174us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.073945:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1461 00000100:00100000:1.0:1785774806.089327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.089507:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648509696 00000100:00100000:0.0:1785774806.089521:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648509696 00000100:00100000:0.0:1785774806.089622:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:0.0:1785774806.089635:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18394:x1872519648509696:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1785774806.089772:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.089795:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.089807:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.089832:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258112:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1785774806.089893:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.089951:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.090060:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671258112 00000100:00100000:3.0:1785774806.090065:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671258112 00000100:00100000:3.0:1785774806.090105:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1785774806.090112:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6544:x1872519671258112:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774806.090124:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.090154:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f551 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f54a expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.090205:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f551 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f54a expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.090220:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f551 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f54a expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.090233:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7709388e00) 00010000:00010000:3.0:1785774806.090237:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774806.090241:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1c00, rc 0) 00000100:00100000:3.0:1785774806.090287:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258112:12345-0@lo:101:mdt_io00_002.0 Request processed in 174us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.090295:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1785774806.090340:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258112:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774806.090357:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.090368:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774806.090391:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:3.0:1785774806.090407:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1785774806.090448:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258240:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.090477:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.090493:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.090511:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671258240 00000100:00100000:3.0:1785774806.090514:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671258240 00000100:00100000:3.0:1785774806.090540:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1785774806.090547:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258240:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.090618:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258240:12345-0@lo:1000:mdt_io00_002.0 Request processed in 72us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.090625:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1785774806.090650:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258240:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.090696:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258368:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.090716:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.090728:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.090738:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671258368 00000100:00100000:3.0:1785774806.090741:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671258368 00000100:00100000:3.0:1785774806.090758:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1785774806.090763:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258368:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091051:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258368:12345-0@lo:1000:mdt_io00_002.0 Request processed in 286us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.091057:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1785774806.091083:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258368:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091121:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258496:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091154:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.091190:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.091201:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671258496 00000100:00100000:3.0:1785774806.091204:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671258496 00000100:00100000:3.0:1785774806.091225:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1785774806.091231:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258496:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091328:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258496:12345-0@lo:1000:mdt_io00_002.0 Request processed in 96us (173us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774806.091334:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1785774806.091360:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258496:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091427:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258624:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091451:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.091465:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.091476:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671258624 00000100:00100000:3.0:1785774806.091479:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671258624 00000100:00100000:3.0:1785774806.091499:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1785774806.091505:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258624:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091557:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258624:12345-0@lo:1000:mdt_io00_002.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.091562:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1785774806.091585:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258624:0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1785774806.091636:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.091646:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.091655:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.091666:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258752:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1785774806.091689:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.091703:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.091714:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671258752 00000100:00100000:3.0:1785774806.091717:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671258752 00000100:00100000:3.0:1785774806.091737:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1785774806.091743:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6544:x1872519671258752:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774806.091751:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.091765:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f55f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f558 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785774806.092347:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1785774806.097684:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f55f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f558 expref: 17 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.097727:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f55f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f558 expref: 17 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.097741:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774806.097744:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774806.097748:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774806.097887:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6544:x1872519671258752:12345-0@lo:101:mdt_io00_002.0 Request processed in 6142us (6195us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.097898:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:1.0:1785774806.098374:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258752:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774806.098405:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.098421:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.098456:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1785774806.098522:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.098530:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.098541:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.098567:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258880:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1785774806.098618:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.098659:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.100141:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671258880 00000100:00100000:2.0:1785774806.100157:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671258880 00000100:00100000:2.0:1785774806.100242:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1785774806.100254:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6544:x1872519671258880:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774806.100278:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774806.100303:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f566 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.100333:0:20645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.100345:0:20645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 18 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.100364:0:20645:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1785774806.100410:0:20645:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1785774806.100876:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 18 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.100888:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7602507400) 00010000:00010000:2.0:1785774806.100891:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774806.100896:0:20645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 18 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.100904:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a600, rc 0) 00000100:00100000:2.0:1785774806.100974:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671258880:12345-0@lo:101:mdt_io00_002.0 Request processed in 722us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.100981:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:1.0:1785774806.101196:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671258880:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774806.101216:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.101227:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774806.104780:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983609 is committed 00000020:00080000:3.0:1785774806.104835:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 414 batchid updated 00000001:00080000:3.0:1785774806.104851:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983592 is committed 00000020:00080000:2.0:1785774806.104913:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 414 00000004:00080000:2.0:1785774806.104995:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605ebb0c0 with version 762 00000020:00080000:2.0:1785774806.105023:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 409 cancel update log [0x240000401:0x3:0x0].396: rc = 0 00000020:00080000:2.0:1785774806.105113:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 409 cancel update log [0x200000400:0x3:0x0].397: rc = 0 00000004:00080000:2.0:1785774806.105146:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b77093ad240 with version 763 00000020:00080000:2.0:1785774806.105149:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 410 cancel update log [0x240000401:0x3:0x0].397: rc = 0 00000020:00080000:2.0:1785774806.105199:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 410 cancel update log [0x200000400:0x3:0x0].398: rc = 0 00000004:00080000:2.0:1785774806.105222:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b771202b480 with version 764 00000020:00080000:2.0:1785774806.105225:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 411 cancel update log [0x240000401:0x3:0x0].398: rc = 0 00000020:00080000:2.0:1785774806.105240:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 411 cancel update log [0x200000400:0x3:0x0].399: rc = 0 00000004:00080000:2.0:1785774806.105256:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7735a4d600 with version 765 00000020:00080000:2.0:1785774806.105258:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 412 cancel update log [0x240000401:0x3:0x0].399: rc = 0 00000020:00080000:2.0:1785774806.105271:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 412 cancel update log [0x200000400:0x3:0x0].400: rc = 0 00000004:00080000:2.0:1785774806.105286:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7735a4d9c0 with version 766 00000020:00080000:2.0:1785774806.105289:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 413 cancel update log [0x240000401:0x3:0x0].400: rc = 0 00000020:00080000:2.0:1785774806.105301:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 413 cancel update log [0x200000400:0x3:0x0].401: rc = 0 00000004:00080000:2.0:1785774806.105321:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7735a4d300 with version 767 00000020:00080000:2.0:1785774806.105324:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 414 cancel update log [0x240000401:0x3:0x0].401: rc = 0 00000020:00080000:2.0:1785774806.105338:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 414 cancel update log [0x200000400:0x3:0x0].402: rc = 0 00000020:00080000:2.0:1785774806.105343:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 414 00000004:00080000:1.0:1785774806.105441:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 762 rpc_version 762 00000020:00100000:1.0:1785774806.105487:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774806.105498:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760471d500 x1872519671259136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774806.105533:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259136:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774806.105623:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.105677:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.106154:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671259136 00000100:00100000:2.0:1785774806.106194:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671259136 00000100:00100000:2.0:1785774806.106249:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1785774806.106258:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7689:x1872519671259136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774806.106428:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671259136:12345-0@lo:1000:osp_up1-0.0 Request processed in 170us (805us total) trans 4294968504 rc 0/0 00000100:00100000:2.0:1785774806.106437:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:1.0:1785774806.106543:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259136:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1785774806.106555:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 763 rpc_version 763 00000020:00100000:1.0:1785774806.106568:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774806.106574:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760471ea00 x1872519671259392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774806.106587:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259392:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774806.106614:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.106643:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.106714:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671259392 00000100:00100000:3.0:1785774806.106719:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671259392 00000100:00100000:3.0:1785774806.106757:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1785774806.106765:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671259392:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.106865:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671259392:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (249us total) trans 4294968505 rc 0/0 00000100:00100000:3.0:1785774806.106872:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1785774806.106903:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259392:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1785774806.106910:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 764 rpc_version 764 00000020:00100000:3.0:1785774806.106921:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774806.106926:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb4a680 x1872519671259648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774806.106939:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259648:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.106968:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.106982:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774806.107146:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671259648 00000100:00100000:1.0:1785774806.107151:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671259648 00000100:00100000:1.0:1785774806.107213:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1785774806.107221:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671259648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774806.107316:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671259648:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (347us total) trans 4294968506 rc 0/0 00000100:00100000:1.0:1785774806.107322:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:3.0:1785774806.107602:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259648:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1785774806.107610:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 765 rpc_version 765 00000020:00100000:3.0:1785774806.107623:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774806.107628:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb49180 x1872519671259904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774806.107641:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259904:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.107671:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.107699:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.107710:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671259904 00000100:00100000:3.0:1785774806.107713:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671259904 00000100:00100000:3.0:1785774806.107732:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:3.0:1785774806.107737:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671259904:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.108456:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671259904:12345-0@lo:1000:osp_up1-0.0 Request processed in 716us (782us total) trans 4294968507 rc 0/0 00000100:00100000:3.0:1785774806.108465:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:3.0:1785774806.108501:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671259904:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1785774806.108509:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 766 rpc_version 766 00000020:00100000:3.0:1785774806.108524:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774806.108529:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760307d880 x1872519671260160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774806.108542:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671260160:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.108575:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.108597:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.108609:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671260160 00000100:00100000:3.0:1785774806.108614:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671260160 00000100:00100000:3.0:1785774806.108634:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:3.0:1785774806.108640:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671260160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.108723:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671260160:12345-0@lo:1000:osp_up1-0.0 Request processed in 82us (146us total) trans 4294968508 rc 0/0 00000100:00100000:3.0:1785774806.108730:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:3.0:1785774806.108758:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671260160:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1785774806.108766:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 767 rpc_version 767 00000020:00100000:3.0:1785774806.108778:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774806.108796:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760307d500 x1872519671260416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774806.108812:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671260416:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.108838:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.108851:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.108862:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671260416 00000100:00100000:3.0:1785774806.108866:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671260416 00000100:00100000:3.0:1785774806.108884:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1785774806.108890:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671260416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.108957:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7689:x1872519671260416:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (118us total) trans 4294968509 rc 0/0 00000100:00100000:3.0:1785774806.108965:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1785774806.108994:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671260416:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1785774806.113460:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113485:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113495:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113502:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.113508:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113518:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113543:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7602507400) 00010000:00010000:0.0:1785774806.113547:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.113557:0:3640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113572:0:3640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113583:0:3640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.113651:0:3640:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.113670:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3640:1872519671260544:0@lo:105: 00000100:00100000:0.0:1785774806.113754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.113827:0:3640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.114099:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671260544 00000100:00100000:3.0:1785774806.114109:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671260544 00000100:00100000:3.0:1785774806.114255:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1785774806.114268:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3640:x1872519671260544:12345-0@lo:105: 00010000:00010000:3.0:1785774806.114284:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.114296:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.114305:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.114313:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.114322:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.114331:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.114369:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b76057cfe00) 00000100:00100000:3.0:1785774806.114426:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3640:x1872519671260544:12345-0@lo:105: Request processed in 161us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.114434:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1785774806.114513:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3640:1872519671260544:0@lo:105: 00010000:00010000:0.0:1785774806.114535:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114542:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d09f3de lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114567:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114574:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114580:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114591:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.114594:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114601:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114612:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9b7602507500) 00010000:00010000:0.0:1785774806.114615:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.114618:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114624:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d09f3e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114644:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114651:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114657:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114662:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.114665:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114672:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114685:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7602507700) 00010000:00010000:0.0:1785774806.114688:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.114691:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114696:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d09f3ec lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114716:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114723:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114729:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114734:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.114737:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114743:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114752:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7605dfe500) 00010000:00010000:0.0:1785774806.114754:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.114758:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.114764:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09f439 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.114886:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.114899:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774806.114928:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1785774806.114990:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.115010:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.115023:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.115040:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671260672:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1785774806.115078:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.115102:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d900 going to sleep for 11 seconds 00010000:00010000:0.0:1785774806.117379:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117396:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117404:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117410:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.117415:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117424:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117440:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b7602507800) 00010000:00010000:0.0:1785774806.117444:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.117447:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117454:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d09f463 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117483:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117490:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117496:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117502:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.117505:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117511:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117519:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7602507e00) 00010000:00010000:0.0:1785774806.117522:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.117525:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117531:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d09f48d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117548:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117554:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117561:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117566:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.117569:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117575:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117588:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b7602507600) 00010000:00010000:0.0:1785774806.117590:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.117593:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117599:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d09f4b7 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117613:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117619:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117625:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117631:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.117633:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117639:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117646:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7602507f00) 00010000:00010000:0.0:1785774806.117648:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.117651:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117657:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f4e1 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117671:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117677:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117683:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117688:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.117691:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117697:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117704:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7709388400) 00010000:00010000:0.0:1785774806.117706:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.117709:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.117715:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f50b lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.122473:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671260672 00000100:00100000:0.0:1785774806.122494:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671260672 00000100:00100000:0.0:1785774806.122581:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:0.0:1785774806.122594:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6544:x1872519671260672:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1785774806.122622:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774806.122654:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f57b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f574 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.122692:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f57b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f574 expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.122710:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f57b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f574 expref: 18 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.122720:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774806.122724:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1785774806.122728:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774806.122830:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671260672:12345-0@lo:101:mdt_io00_002.0 Request processed in 239us (7751us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.122837:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1785774806.123118:0:6544:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983592 gen 2 00000004:00080000:2.0:1785774806.123128:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983592 committed transno 4294983592 00000100:00100000:2.0:1785774806.123206:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671260672:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774806.123229:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.123242:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774806.123264:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x153a:0x0] 00000100:00100000:2.0:1785774806.123335:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671260800:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.123383:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.123413:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.124088:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671260800 00000100:00100000:0.0:1785774806.124095:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671260800 00000100:00100000:0.0:1785774806.124131:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:0.0:1785774806.124150:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671260800:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.124248:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671260800:12345-0@lo:1000:mdt_io00_002.0 Request processed in 99us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.124255:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1785774806.124444:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671260800:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1785774806.124473:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x153a:0x0] 00000100:00100000:1.0:1785774806.124507:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671260928:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.124540:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.124561:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.124609:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671260928 00000100:00100000:0.0:1785774806.124613:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671260928 00000100:00100000:0.0:1785774806.124644:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:0.0:1785774806.124652:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671260928:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.124717:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671260928:12345-0@lo:1000:mdt_io00_002.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.124727:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1785774806.124805:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671260928:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.125550:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261056:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774806.125589:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.125610:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.126111:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261056 00000100:00100000:2.0:1785774806.126117:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261056 00000100:00100000:2.0:1785774806.126186:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:2.0:1785774806.126195:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261056:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774806.134958:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261056:12345-0@lo:403:mdt_io00_002.0 Request processed in 8751us (9354us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.134975:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1785774806.135406:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261056:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774806.136235:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261184:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.136493:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.136565:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.136649:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261184 00000100:00100000:2.0:1785774806.136657:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261184 00000100:00100000:0.0:1785774806.140590:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1785774806.140623:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261184:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.144503:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261184:12345-0@lo:1000:mdt_io00_002.0 Request processed in 3883us (7997us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.144523:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1785774806.144670:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261184:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.144774:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261312:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.144854:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.144888:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.144984:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261312 00000100:00100000:0.0:1785774806.144992:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261312 00000100:00100000:0.0:1785774806.145061:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:0.0:1785774806.145071:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261312:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.145209:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261312:12345-0@lo:1000:mdt_io00_002.0 Request processed in 139us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.145216:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1785774806.145454:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261312:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.147605:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261440:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774806.147676:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.147711:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.148109:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261440 00000100:00100000:0.0:1785774806.148117:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261440 00000100:00100000:0.0:1785774806.148205:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:0.0:1785774806.148215:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261440:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1785774806.160433:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261440:12345-0@lo:403:mdt_io00_002.0 Request processed in 12203us (12740us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.160454:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1785774806.165232:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261440:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774806.171522:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261568:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.171629:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.171690:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.174056:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261568 00000100:00100000:2.0:1785774806.174071:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261568 00000100:00100000:2.0:1785774806.174198:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:2.0:1785774806.174211:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261568:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.174390:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261568:12345-0@lo:1000:mdt_io00_002.0 Request processed in 181us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.174402:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:1.0:1785774806.174622:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261568:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.174719:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261696:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.174761:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.174881:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261696 00000100:00100000:0.0:1785774806.174888:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261696 00000100:00100000:0.0:1785774806.174931:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1785774806.174940:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261696:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.182331:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261696:12345-0@lo:1000:mdt_io00_002.0 Request processed in 7374us (7552us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.182353:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:2.0:1785774806.183147:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.183209:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261696:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.183307:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261824:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.183360:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.183384:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4db40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.183447:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261824 00000100:00100000:0.0:1785774806.183456:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261824 00000100:00100000:0.0:1785774806.183557:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:0.0:1785774806.183567:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261824:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.183671:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261824:12345-0@lo:1000:mdt_io00_002.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.183679:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:2.0:1785774806.183730:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261824:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.183769:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261952:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.183801:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.188286:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.192633:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671261952 00000100:00100000:3.0:1785774806.192653:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671261952 00000100:00100000:3.0:1785774806.192751:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1785774806.192762:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261952:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.192968:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671261952:12345-0@lo:1000:mdt_io00_002.0 Request processed in 208us (9165us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.192977:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1785774806.193554:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671261952:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.193645:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262080:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.193688:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.193731:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.193934:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671262080 00000100:00100000:3.0:1785774806.193940:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671262080 00000100:00100000:3.0:1785774806.193979:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1785774806.193987:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262080:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.194060:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262080:12345-0@lo:1000:mdt_io00_002.0 Request processed in 73us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.194069:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:2.0:1785774806.194197:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262080:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.194794:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262208:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774806.194833:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.194861:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.195092:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671262208 00000100:00100000:3.0:1785774806.195097:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671262208 00000100:00100000:3.0:1785774806.195128:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:3.0:1785774806.195143:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262208:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1785774806.197675:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262208:12345-0@lo:403:mdt_io00_002.0 Request processed in 2534us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.197690:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1785774806.198916:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262208:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1785774806.200983:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262336:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.201120:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.201245:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774806.202907:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671262336 00000100:00100000:1.0:1785774806.202920:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671262336 00000100:00100000:2.0:1785774806.204900:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:3.0:1785774806.204991:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262336:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.205404:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262336:12345-0@lo:1000:mdt_io00_002.0 Request processed in 491us (4283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.205415:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1785774806.206123:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262336:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.206353:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262464:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.211280:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.211423:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d780 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.213507:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671262464 00000100:00100000:0.0:1785774806.213527:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671262464 00000100:00100000:0.0:1785774806.213608:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1785774806.213618:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262464:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.213801:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262464:12345-0@lo:1000:mdt_io00_002.0 Request processed in 184us (2526us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.213810:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1785774806.214481:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262464:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.214569:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262592:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.214613:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.214655:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d540 going to sleep for 11 seconds 00000100:00100000:1.0:1785774806.214711:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671262592 00000100:00100000:1.0:1785774806.214716:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671262592 00000100:00100000:1.0:1785774806.214754:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:1.0:1785774806.214762:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262592:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.214847:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6544:x1872519671262592:12345-0@lo:1000:mdt_io00_002.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.214855:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1785774806.215015:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262592:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1785774806.216633:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].405, 2464 off608328 00000040:00080000:2.0:1785774806.216707:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].404, 2544 off654824 00000004:00080000:2.0:1785774806.216714:0:6544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7735a4df00 with version 774 00000004:00080000:0.0:1785774806.216801:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 774 rpc_version 774 00000020:00100000:0.0:1785774806.216842:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774806.216851:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773465a680 x1872519671262848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774806.216871:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671262848:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774806.216930:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.216969:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.217118:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671262848 00000100:00100000:2.0:1785774806.217125:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671262848 00000100:00100000:2.0:1785774806.217252:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1785774806.217261:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:7474:x1872519671262848:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774806.218234:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:7474:x1872519671262848:12345-0@lo:1000:osp_up0-1.0 Request processed in 900us (1229us total) trans 4294983610 rc 0/0 00000100:00100000:2.0:1785774806.218248:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1785774806.218371:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671262848:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1785774806.221865:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.221893:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.221910:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.221940:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.221948:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.221956:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.222100:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.222108:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.222123:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.222178:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262976:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1785774806.222253:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.222305:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84840 going to sleep for 11 seconds 00000100:00100000:1.0:1785774806.222374:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671262976 00000100:00100000:1.0:1785774806.222383:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671262976 00000100:00100000:1.0:1785774806.222444:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1785774806.222454:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:6544:x1872519671262976:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774806.222477:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774806.222497:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f597 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f590 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.222520:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f597 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f590 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.222535:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f597 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f590 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.222545:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:1.0:1785774806.222549:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.222553:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774806.222605:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:6544:x1872519671262976:12345-0@lo:101:mdt_io00_002.0 Request processed in 153us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.222611:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:0.0:1785774806.222712:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6544:1872519671262976:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1785774806.222728:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222740:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774806.222765:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a49d3bb1 reply state 00000000a974e23c transno 4294968510 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222779:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222796:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:0.0:1785774806.222799:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774806.222802:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774806.222810:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222819:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774806.222831:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00000004:00010000:0.0:1785774806.222841:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a49d3bb1 reply state 00000000a974e23c transno 4294968510 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222848:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222854:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:0.0:1785774806.222857:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774806.222859:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1785774806.222869:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x153a:0x0] 00010000:00010000:0.0:1785774806.222875:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222884:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774806.222894:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1785774806.222901:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222909:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222917:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222942:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774806.222946:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1785774806.222951:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222959:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774806.222972:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1785774806.222978:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.222986:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.223108:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774806.223116:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.223125:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774806.223250:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.223262:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.223289:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.223296:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774806.223323:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.223331:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1600/0x7b7109e1d09f558 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f55f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.223345:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774806.223347:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774806.223349:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774806.223357:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774806.223367:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671263104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774806.223400:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.223440:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671263104 00000100:00100000:1.0:1785774806.223445:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671263104 00000100:00100000:1.0:1785774806.223480:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1785774806.223487:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+20:3654:x1872519671263104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774806.223499:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774806.223517:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f55f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f558 expref: 20 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.223537:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774806.223541:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774806.223568:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+19:3654:x1872519671263104:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.223575:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1785774806.223599:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671263104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774806.223714:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.223765:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774806.223848:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:18394:x1872519648509696:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 134214us (134532us total) trans 4294968510 rc 0/0 00000100:00100000:0.0:1785774806.223856:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00010000:00010000:1.0:1785774806.228275:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774806.228292:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.228306:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774806.228314:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.228324:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.228376:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.228383:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785774806.228518:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671263232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774806.228594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.229553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671263232 00000100:00100000:3.0:1785774806.229565:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671263232 00000100:00100000:3.0:1785774806.229640:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1785774806.229651:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+19:3654:x1872519671263232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774806.229670:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774806.229703:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f551 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f54a expref: 19 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.229730:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7709388e00) 00010000:00010000:3.0:1785774806.229743:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774806.229878:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.229894:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09f54a lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f551 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.229912:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774806.229914:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774806.229917:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774806.233206:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+18:3654:x1872519671263232:12345-0@lo:103:ldlm_bl.0 Request processed in 3545us (4599us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.233223:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1785774806.240325:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671263232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774806.242087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.242392:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648509824 00000100:00100000:2.0:1785774806.242404:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648509824 00000100:00100000:2.0:1785774806.242460:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23832 00000100:00100000:2.0:1785774806.242469:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18394:x1872519648509824:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774806.242493:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774806.242513:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09f59e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0d5 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.242574:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.242589:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.242600:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774806.242639:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774806.242642:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774806.242660:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.242679:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09f59e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.242695:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.242702:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774806.242705:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774806.242708:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b200, rc 0) 00000100:00100000:2.0:1785774806.242770:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18394:x1872519648509824:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 302us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.242776:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23832 00000100:00100000:2.0:1785774806.247053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.247222:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648510080 00000100:00100000:1.0:1785774806.247237:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648510080 00000100:00100000:1.0:1785774806.247315:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23833 00000100:00100000:1.0:1785774806.247327:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18394:x1872519648510080:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774806.247355:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774806.247383:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f5ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0dc expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.247477:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.247495:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.247507:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.247518:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.247529:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.247542:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.247581:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.247598:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671263360:0@lo:104: 00000100:00100000:1.0:1785774806.247665:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.247716:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ceca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.247919:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1785774806.247934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671263360 00000100:00100000:0.0:1785774806.247938:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671263360 00000100:00100000:0.0:1785774806.247978:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1785774806.247986:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671263360:12345-0@lo:104: 00010000:00010000:0.0:1785774806.248063:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.248201:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785774806.248209:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773c355c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671263360:12345-0@lo:104: Request processed in 223us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.248217:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00010000:00010000:0.0:1785774806.248272:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774806.248280:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.248290:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774806.248297:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774806.248308:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.248338:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.248345:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774806.248370:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.248379:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfe00/0x7b7109e1d09f566 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f56d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.248399:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774806.248401:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774806.248403:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774806.251188:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671263488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774806.251281:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.251451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671263488 00000100:00100000:2.0:1785774806.251468:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671263488 00010000:00010000:2.0:1785774806.251515:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 18 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.251564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:2.0:1785774806.251575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3655:x1872519671263488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774806.251592:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1785774806.256787:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983610 is committed 00000100:00100000:3.0:1785774806.256920:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671263360:0@lo:104: 00010000:00010000:3.0:1785774806.256954:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.259591:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f56d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f566 expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.259615:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7602507400) 00010000:00010000:2.0:1785774806.259621:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.259630:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.259638:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.259675:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774806.259764:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.259768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3655:x1872519671263488:12345-0@lo:103:ldlm_bl.0 Request processed in 8193us (8484us total) trans 0 rc 0/0 00010000:00010000:3.0:1785774806.259796:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.259799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:3.0:1785774806.260061:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671263616:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774806.260143:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.260207:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.260401:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671263488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774806.260496:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671263616 00000100:00100000:1.0:1785774806.260504:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671263616 00000100:00100000:1.0:1785774806.260562:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:1.0:1785774806.260574:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:8469:x1872519671263616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774806.260708:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:8469:x1872519671263616:12345-0@lo:1000:mdt00_003.0 Request processed in 136us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.260717:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1785774806.261108:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1872519671263616:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785774806.261232:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f5c1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261249:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261267:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261286:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261293:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261299:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261306:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261312:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774806.261317:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261325:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261338:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774806.261341:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774806.261346:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261352:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f5b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261367:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261375:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261381:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261387:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774806.261390:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261396:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261403:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7602507400) 00010000:00010000:3.0:1785774806.261405:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774806.261408:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261413:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f5ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261461:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f5ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0dc expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261476:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0dc expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.261484:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:3.0:1785774806.261487:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774806.261490:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1c00, rc 0) 00000100:00100000:3.0:1785774806.261546:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18394:x1872519648510080:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 14222us (14502us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.261554:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23833 00000100:00100000:1.0:1785774806.274542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.275039:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648510336 00000100:00100000:2.0:1785774806.275050:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648510336 00000100:00100000:2.0:1785774806.275126:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23834 00000100:00100000:2.0:1785774806.275146:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:18394:x1872519648510336:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774806.275211:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.275401:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5c8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0e3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774806.275645:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:3.0:1785774806.276057:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5c8 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0e3 expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.276076:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:3.0:1785774806.276079:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774806.276084:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5c8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0e3 expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.276104:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774806.276219:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648510336:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1083us (1685us total) trans 4294968511 rc 301/301 00000100:00100000:3.0:1785774806.276227:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23834 00000100:00100000:0.0:1785774806.287542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.287846:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648510464 00000100:00100000:2.0:1785774806.287856:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648510464 00000100:00100000:2.0:1785774806.288561:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23835 00000100:00100000:2.0:1785774806.288574:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648510464:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774806.288596:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774806.288617:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09f5d6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.288676:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f5dd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.288690:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f5dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.288702:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f5dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774806.288760:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xd0:0x0]: returning size 4096 00000004:00200000:2.0:1785774806.288764:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1785774806.288805:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09f5d6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ea expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.288824:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ea expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.288833:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:2.0:1785774806.288836:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774806.288840:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b800, rc 0) 00000100:00100000:2.0:1785774806.288909:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:18394:x1872519648510464:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 337us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.288916:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23835 00000100:00100000:1.0:1785774806.296882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.297608:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648510592 00000100:00100000:3.0:1785774806.297618:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648510592 00000100:00100000:3.0:1785774806.297666:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23836 00000100:00100000:3.0:1785774806.297676:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18394:x1872519648510592:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774806.297698:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.297719:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f5e4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0f1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.297913:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.297928:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f597 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f590 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.297938:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 4/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.297970:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f597 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f590 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.297986:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671263744:0@lo:104: 00000100:00100000:3.0:1785774806.298034:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.298070:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.298089:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671263744 00000100:00100000:3.0:1785774806.298092:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671263744 00000100:00100000:3.0:1785774806.298129:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1785774806.298147:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671263744:12345-0@lo:104: 00010000:00010000:3.0:1785774806.298184:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.298239:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774806.298245:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8469:x1872519671263744:12345-0@lo:104: Request processed in 100us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.298252:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00010000:00010000:1.0:1785774806.298266:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774806.298275:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.298286:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774806.298292:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.298306:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.298333:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.298340:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774806.298430:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.298438:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0600/0x7b7109e1d09f590 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f597 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.298456:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774806.298458:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774806.298460:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774806.298489:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1872519671263744:0@lo:104: 00010000:00010000:1.0:1785774806.298510:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.298572:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774806.298584:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671263872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774806.298615:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.299194:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671263872 00000100:00100000:1.0:1785774806.299201:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671263872 00010000:00010000:1.0:1785774806.299223:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f597 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f590 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.299251:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:1.0:1785774806.299258:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+16:3655:x1872519671263872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774806.299268:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774806.299743:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d09f597 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f590 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.299755:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:1.0:1785774806.299759:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.299766:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.299772:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.299849:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774806.299893:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3655:x1872519671263872:12345-0@lo:103:ldlm_bl.0 Request processed in 636us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.299900:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:0.0:1785774806.299967:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671263872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774806.299968:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.299983:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774806.300027:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd2:0x0]: returning size 4096 00000004:00200000:3.0:1785774806.300032:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1785774806.300067:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f5e4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0f1 expref: 19 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.300085:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0f1 expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.300093:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:3.0:1785774806.300096:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785774806.300099:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774806.300156:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18394:x1872519648510592:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 2482us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.300186:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23836 00000100:00100000:1.0:1785774806.313719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.313869:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648510720 00000100:00100000:3.0:1785774806.313882:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648510720 00000100:00100000:3.0:1785774806.313948:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23837 00000100:00100000:3.0:1785774806.313958:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:18394:x1872519648510720:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774806.313978:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.314002:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f5f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0f8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.314071:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.314091:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.314104:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774806.314323:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00000004:00200000:0.0:1785774806.314329:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:0.0:1785774806.314351:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.314378:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f5f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0f8 expref: 28 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.314408:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0f8 expref: 27 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.314417:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:0.0:1785774806.314419:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785774806.314423:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:0.0:1785774806.314682:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648510720:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 724us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.314690:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23837 00000100:00100000:0.0:1785774806.322373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.323591:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648510848 00000100:00100000:1.0:1785774806.323603:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648510848 00000100:00100000:1.0:1785774806.323666:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5108 00000100:00100000:1.0:1785774806.323677:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648510848:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:0.0:1785774806.336395:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648510848:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 12708us (14019us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.336410:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5108 00000100:00100000:3.0:1785774806.342102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.342258:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648510976 00000100:00100000:1.0:1785774806.342267:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648510976 00000100:00100000:1.0:1785774806.342322:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5109 00000100:00100000:1.0:1785774806.342331:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18394:x1872519648510976:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:1.0:1785774806.351230:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18394:x1872519648510976:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 8888us (9127us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.351246:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5109 00000100:00100000:0.0:1785774806.383226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.383588:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648511104 00000100:00100000:1.0:1785774806.383600:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648511104 00000100:00100000:1.0:1785774806.383665:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23838 00000100:00100000:1.0:1785774806.383676:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18394:x1872519648511104:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:1.0:1785774806.383767:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383784:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383795:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383809:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383815:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383822:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383899:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383908:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383915:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.383967:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383983:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383991:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.383997:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384004:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384011:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.384016:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384025:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384037:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:1.0:1785774806.384041:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.384045:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384051:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d09f600 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384064:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384070:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384076:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384081:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.384084:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384090:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384098:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7702c6a600) 00010000:00010000:1.0:1785774806.384100:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.384103:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384107:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09f607 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384120:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384126:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384801:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384808:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.384810:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384822:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384832:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:1.0:1785774806.384834:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.384837:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.384842:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f60e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.384941:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18394:x1872519648511104:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 1266us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.384950:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23838 00000100:00100000:3.0:1785774806.388701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.389461:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648511360 00000100:00100000:1.0:1785774806.389470:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648511360 00000100:00100000:1.0:1785774806.389525:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23839 00000100:00100000:1.0:1785774806.389535:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18394:x1872519648511360:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774806.389570:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774806.389590:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09f615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c0ff expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.389686:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.389699:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.389709:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774806.389719:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153d:0x0]: returning size 2 00010000:00010000:1.0:1785774806.389833:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09f615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 21 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.389849:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 20 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.389857:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:1.0:1785774806.389860:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785774806.389863:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cea00, rc 0) 00000100:00100000:1.0:1785774806.389922:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18394:x1872519648511360:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 389us (1230us total) trans 4294983611 rc 0/0 00000100:00100000:1.0:1785774806.389929:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23839 00000100:00100000:1.0:1785774806.398705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.398820:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648511488 00000100:00100000:3.0:1785774806.398829:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648511488 00000100:00100000:3.0:1785774806.398886:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5213 00000100:00100000:3.0:1785774806.398895:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648511488:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:3.0:1785774806.398936:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.398954:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 19 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.398962:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cc:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785774806.398966:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774806.398970:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.399002:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 19 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.399018:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 19 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.399033:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1872519671264000:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774806.399155:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.417688:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1872519671264000:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774806.417717:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.431750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.437383:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648511616 00000100:00100000:3.0:1785774806.437399:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648511616 00002000:00100000:3.0:1785774806.437452:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff9b773fa83b80 x1872519648511616/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/0 e 0 to 0 dl 1785774817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774806.437463:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa83b80 with x1872519648511616 ext(0->1) 00010000:00010000:3.0:1785774806.437472:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 20 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.437486:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 20 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774806.437493:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b773fa83b80 00000100:00100000:3.0:1785774806.437528:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:3.0:1785774806.437535:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648511616:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:1.0:1785774806.439209:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2416:x1872519648511616:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1667us (7462us total) trans 4294969886 rc 0/0 00000100:00100000:1.0:1785774806.439219:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 6 00002000:00100000:1.0:1785774806.439230:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff9b773fa83b80 x1872519648511616/t4294969886(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/448 e 0 to 0 dl 1785774817 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774806.439239:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa83b80 with x1872519648511616 ext(0->1) 00010000:00010000:1.0:1785774806.439247:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 22 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.439262:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 22 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774806.439270:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b773fa83b80 00000001:00080000:0.0:1785774806.440220:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969886 is committed 00000001:00080000:0.0:1785774806.440231:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969885 is committed 00000100:00100000:0.0:1785774806.448747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.448893:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648511744 00000100:00100000:3.0:1785774806.448903:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648511744 00010000:00010000:3.0:1785774806.448947:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 14 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.448993:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1649 00000100:00100000:3.0:1785774806.449004:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2419:x1872519648511744:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774806.449020:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1785774806.449038:0:19895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1785774806.449041:0:19895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1785774804 00002000:00010000:3.0:1785774806.449043:0:19895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1785774804 00002000:00010000:3.0:1785774806.449045:0:19895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1785774806.449052:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 14 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.449067:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 14 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.449094:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8af9bef/0x7b7109e1d09f4a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c096 expref: 14 pid: 8661 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.449111:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774806.449115:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774806.449121:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.449140:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.449225:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774806.449280:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2419:x1872519648511744:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 277us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.449288:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1649 00010000:00010000:0.0:1785774806.449763:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.449774:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.449981:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.449989:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.449996:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.450004:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774806.450008:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.450016:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.450028:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.450035:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfad9511/0x7b7109e1d09f62a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.450101:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648511488:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 51206us (51403us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.450109:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5213 00000100:00100000:0.0:1785774806.464400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.464438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.464633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648511872 00000100:00100000:2.0:1785774806.464644:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648511872 00000100:00100000:2.0:1785774806.464697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648512000 00000100:00100000:2.0:1785774806.464700:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648512000 00000100:00100000:2.0:1785774806.464727:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1464 00000100:00100000:2.0:1785774806.464736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706102050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:2417:x1872519648511872:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:2.0:1785774806.464753:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774806.464785:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09f5f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0f8 expref: 27 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.464811:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:2.0:1785774806.464815:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774806.464860:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706102050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:2417:x1872519648511872:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 125us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.464868:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1464 00000100:00100000:2.0:1785774806.464909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1465 00000100:00100000:2.0:1785774806.464915:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648512000:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:2.0:1785774806.464922:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774806.464934:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f5eb lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0f1 expref: 20 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.464946:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:2.0:1785774806.464955:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774806.464969:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648512000:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 55us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.464975:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1465 00000100:00100000:3.0:1785774806.472916:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.475243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.475342:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648512384 00000100:00100000:0.0:1785774806.475352:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648512384 00000100:00100000:0.0:1785774806.475434:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:0.0:1785774806.475445:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18394:x1872519648512384:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1785774806.475498:0:6542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774806.475528:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d09f494 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c08f expref: 19 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.475552:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:0.0:1785774806.475557:0:6542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774806.475583:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.475596:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.475605:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774806.475624:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:0.0:1785774806.475679:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264128:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.475729:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.475772:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.475913:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671264128 00000100:00100000:3.0:1785774806.475918:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671264128 00000100:00100000:3.0:1785774806.475955:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:3.0:1785774806.475963:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671264128:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.476054:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671264128:12345-0@lo:1000:mdt_io00_000.0 Request processed in 91us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.476062:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:0.0:1785774806.478547:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264128:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.479147:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264256:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1785774806.479234:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.479269:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.479389:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671264256 00000100:00100000:3.0:1785774806.479395:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671264256 00000100:00100000:3.0:1785774806.479442:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1785774806.479450:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671264256:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1785774806.489426:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648512128 00000100:00100000:1.0:1785774806.489441:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648512128 00000100:00100000:1.0:1785774806.489514:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1466 00000100:00100000:1.0:1785774806.489523:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:2417:x1872519648512128:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:1.0:1785774806.489540:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774806.489564:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f5dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ea expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.489587:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:1.0:1785774806.489592:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774806.489648:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:2417:x1872519648512128:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 126us (16743us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.489655:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1466 00000100:00100000:2.0:1785774806.492200:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671264256:12345-0@lo:403:mdt_io00_000.0 Request processed in 12744us (12959us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.492213:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1785774806.501279:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264256:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1785774806.502055:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264384:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.502120:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.502215:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.502457:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671264384 00000100:00100000:3.0:1785774806.502464:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671264384 00000100:00100000:3.0:1785774806.502516:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1785774806.502527:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671264384:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.502615:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671264384:12345-0@lo:1000:mdt_io00_000.0 Request processed in 90us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.502623:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:1.0:1785774806.502704:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264384:0@lo:1000:mdt_io00_000.0 00010000:00010000:1.0:1785774806.502765:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.502775:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.502785:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.502798:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264512:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1785774806.502826:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.502850:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.502900:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671264512 00000100:00100000:3.0:1785774806.502905:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671264512 00000100:00100000:3.0:1785774806.502939:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1785774806.502946:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671264512:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774806.502956:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.502972:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f638 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.502992:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.503002:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 4/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.503016:0:6534:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1785774806.503046:0:6534:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:3.0:1785774806.503087:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.503097:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:3.0:1785774806.503100:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774806.503103:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.503111:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774806.503554:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6542:x1872519671264512:12345-0@lo:101:mdt_io00_000.0 Request processed in 608us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.503560:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:1.0:1785774806.503704:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671264512:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1785774806.503718:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.503727:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.509199:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774806.509222:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.509266:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.509273:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774806.509292:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09f574 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f57b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.509314:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774806.509322:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.509340:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.509347:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774806.509353:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745600/0x7b7109e1d09f367 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f36e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.512532:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671264640:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1785774806.512607:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.512662:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774806.512669:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671264768:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1785774806.512690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.512725:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671264640 00000100:00100000:2.0:1785774806.512732:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671264640 00000100:00100000:2.0:1785774806.512777:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671264768 00000100:00100000:2.0:1785774806.512779:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671264768 00000100:00100000:2.0:1785774806.512799:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1785774806.512807:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+16:3653:x1872519671264640:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1785774806.512821:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774806.512843:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f57b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f574 expref: 16 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.512859:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:2.0:1785774806.512869:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774806.512902:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671264640:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.512908:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1785774806.512923:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1785774806.512929:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671264768:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1785774806.512937:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774806.512947:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f36e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f367 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.512957:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9b7702bc0500) 00010000:00010000:2.0:1785774806.512963:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774806.512983:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671264768:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 54us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.512989:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1785774806.513022:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671264768:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1785774806.513031:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671264640:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:3.0:1785774806.513232:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968511 is committed 00000001:00080000:3.0:1785774806.513249:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968509 is committed 00000004:00080000:3.0:1785774806.513262:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00000020:00080000:3.0:1785774806.513280:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7605cec000 refcount 2 committed 0 result 0 batchid 405 00000020:00080000:3.0:1785774806.513285:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cec300 00000020:00080000:3.0:1785774806.513288:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].403 00000020:00080000:3.0:1785774806.513291:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b76061ea600 00000020:00080000:3.0:1785774806.513293:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].404 00000004:00080000:3.0:1785774806.513309:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000004:00080000:3.0:1785774806.513316:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000020:00080000:3.0:1785774806.513338:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 405 committed batchid 404 00000020:00080000:3.0:1785774806.513425:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 404 00000100:00100000:3.0:1785774806.513503:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774806.513511:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671264896:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1785774806.513548:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774806.513704:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513714:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513722:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513729:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.513734:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513742:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513753:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x391d5834 (ffff9b7702bc0000) 00010000:00010000:0.0:1785774806.513757:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.513760:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513768:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f22c lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513799:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513811:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513818:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513823:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.513826:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513832:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513840:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xdcc87686 (ffff9b7605fcc000) 00010000:00010000:0.0:1785774806.513843:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.513846:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513853:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d09f264 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513868:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513875:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513881:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513887:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.513890:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513895:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513903:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x18618557 (ffff9b7605fcce00) 00010000:00010000:0.0:1785774806.513905:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.513908:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513913:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f29c lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513925:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513930:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513935:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513940:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.513942:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513948:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513955:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xbc0ca3a9 (ffff9b760572b800) 00010000:00010000:0.0:1785774806.513957:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.513960:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513967:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d09f2d4 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513980:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513986:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513992:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.513998:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.514001:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514006:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514013:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x84832a57 (ffff9b760572bd00) 00010000:00010000:0.0:1785774806.514015:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.514018:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514024:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d09f30c lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514035:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514045:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514052:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514057:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.514060:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514066:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514072:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0xb62e0cbf (ffff9b760572bc00) 00010000:00010000:0.0:1785774806.514075:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.514077:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514082:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d09f344 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.514234:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671264896 00000100:00100000:0.0:1785774806.514241:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671264896 00000100:00100000:0.0:1785774806.514287:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5214 00000100:00100000:0.0:1785774806.514295:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671264896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1785774806.514319:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2505 count 1 00010000:00010000:0.0:1785774806.514341:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514377:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 11 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514387:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1785774806.514391:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774806.514395:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514421:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 11 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.514435:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 11 pid: 14712 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.514446:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1872519671265024:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774806.514506:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8840 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.514698:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774806.514708:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671265152:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1785774806.514741:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.514771:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671265152 00000100:00100000:2.0:1785774806.514775:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671265152 00000100:00100000:2.0:1785774806.514811:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215 00000100:00100000:2.0:1785774806.514817:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671265152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1785774806.514831:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2505 count 1 00010000:00010000:2.0:1785774806.514845:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.514858:0:14712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 17 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.514865:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1785774806.514869:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774806.514873:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.514892:0:14712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 17 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.514902:0:14712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 17 pid: 14729 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.514913:0:14712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14712:1872519671265536:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774806.514936:0:14712:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d540 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.514955:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671265280:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1785774806.514979:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.515000:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774806.515005:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671265408:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1785774806.515026:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.515048:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671265280 00000100:00100000:2.0:1785774806.515053:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671265280 00000100:00100000:2.0:1785774806.515074:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671265408 00000100:00100000:2.0:1785774806.515077:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671265408 00000100:00100000:2.0:1785774806.515091:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5216 00000100:00100000:2.0:1785774806.515097:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671265280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1785774806.515108:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2504 count 1 00010000:00010000:2.0:1785774806.515119:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515144:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 17 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515151:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1785774806.515154:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774806.515177:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515199:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 17 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515208:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 17 pid: 8447 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.515217:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8448:1872519671265664:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774806.515241:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d780 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.515258:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5217 00000100:00100000:2.0:1785774806.515265:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671265408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1785774806.515277:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2506 count 1 00010000:00010000:2.0:1785774806.515289:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515300:0:14725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 17 pid: 8661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515312:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1785774806.515314:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774806.515318:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515339:0:14725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 17 pid: 8661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.515348:0:14725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 17 pid: 8661 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.515358:0:14725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14725:1872519671265792:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774806.516891:0:14725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b772a892e40 going to sleep for 11 seconds 00000100:00080000:3.0:1785774806.516992:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785774806.519466:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519481:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519488:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519495:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.519499:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519508:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519523:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:1.0:1785774806.519526:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.519530:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519535:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f582 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519565:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519572:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519578:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519583:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.519585:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519591:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519598:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:1.0:1785774806.519601:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.519607:0:3640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519617:0:3640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519626:0:3640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.519669:0:3640:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 5 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.519686:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3640:1872519671265920:0@lo:105: 00000100:00100000:1.0:1785774806.519736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.519823:0:3640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.524771:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.524832:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.524949:0:14712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14712:1872519671265536:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774806.524974:0:14712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.525002:0:14725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14725:1872519671265792:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774806.525011:0:14725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.525033:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8448:1872519671265664:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774806.525043:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.525067:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648512512 00000100:00100000:2.0:1785774806.525074:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648512512 00010000:00010000:2.0:1785774806.525107:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 12 pid: 14712 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.525150:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648512640 00000100:00100000:2.0:1785774806.525153:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648512640 00010000:00010000:2.0:1785774806.525187:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 18 pid: 8447 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.525212:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1650 00000100:00100000:2.0:1785774806.525221:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648512512:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774806.525236:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774806.525242:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 12 pid: 14712 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525254:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 12 pid: 14712 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525280:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774806.525285:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774806.525291:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525299:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525316:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774806.525378:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648512512:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 143us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.525386:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1650 00000100:00100000:2.0:1785774806.525403:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1651 00000100:00100000:2.0:1785774806.525410:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648512640:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774806.525420:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774806.525426:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 18 pid: 8447 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525435:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 18 pid: 8447 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525451:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b9d15c/0x7b7109e1d09f0dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf9a expref: 18 pid: 8447 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525466:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774806.525469:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774806.525474:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525481:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525503:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774806.525523:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648512640:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 113us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.525529:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1651 00010000:00010000:2.0:1785774806.525546:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525555:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525564:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525572:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.525592:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774806.525754:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3653:x1872519671265280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10656us (10773us total) trans 4294969887 rc 0/0 00000100:00100000:2.0:1785774806.525762:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5216 00010000:00010000:2.0:1785774806.526021:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774806.526027:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.526035:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774806.526040:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.526050:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.526062:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.526070:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f654 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.526085:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774806.526087:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774806.526089:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774806.526117:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76056d7100/2, rc 0, transno 4294969887 00000100:00100000:2.0:1785774806.526123:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671265280:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1785774806.526902:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7500a11/0x7b7109e1d09f15a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfe0 expref: 11 pid: 14712 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.526918:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1872519671265024:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774806.526935:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.526945:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.526953:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.526964:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.526972:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.527001:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774806.527127:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1872519671264896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12833us (13578us total) trans 4294969887 rc 0/0 00000100:00100000:1.0:1785774806.527148:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5214 00000004:00080000:1.0:1785774806.527204:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471ca80/2, rc 0, transno 4294969887 00000100:00100000:1.0:1785774806.527217:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671264896:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1785774806.532499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.532531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.532567:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648512768 00000100:00100000:1.0:1785774806.532575:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648512768 00010000:00010000:1.0:1785774806.532608:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 17 pid: 14729 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.532633:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648512896 00000100:00100000:1.0:1785774806.532636:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648512896 00010000:00010000:1.0:1785774806.532644:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 18 pid: 8661 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.532662:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1652 00000100:00100000:1.0:1785774806.532670:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706100450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648512768:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774806.532684:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774806.532689:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 18 pid: 14729 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532700:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 18 pid: 14729 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532719:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09f1ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bff5 expref: 18 pid: 14729 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532736:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774806.532740:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774806.532745:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532753:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532775:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774806.532827:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706100450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648512768:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.532834:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1652 00000100:00100000:1.0:1785774806.532875:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1653 00000100:00100000:1.0:1785774806.532881:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648512896:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774806.532888:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774806.532893:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 16 pid: 8661 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532903:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 16 pid: 8661 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532916:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f11b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bfaf expref: 16 pid: 8661 timeout: 1148 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532933:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774806.532936:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774806.532941:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532950:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.532963:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774806.532979:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2419:x1872519648512896:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 98us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.532985:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1653 00010000:00010000:1.0:1785774806.533004:0:14712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.533013:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.533022:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.533030:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.533047:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785774806.533945:0:14725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.533957:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.533966:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.533974:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.533989:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1785774806.534122:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3653:x1872519671265408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 18856us (19093us total) trans 4294969888 rc 0/0 00000100:00100000:2.0:1785774806.534140:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5217 00010000:00010000:2.0:1785774806.534182:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774806.534190:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534198:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774806.534202:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534211:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534225:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534232:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d09f646 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534249:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774806.534253:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534265:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774806.534269:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534275:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534284:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534289:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09f64d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534300:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774806.534303:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534309:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774806.534311:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534316:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534323:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534329:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b21e443/0x7b7109e1d09f65b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.534338:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774806.534339:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774806.534341:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774806.534347:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774806.534391:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76056d4380/2, rc 0, transno 4294969888 00000100:00100000:2.0:1785774806.534397:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671265408:0@lo:6:osp-syn-1-1.0 00000001:00080000:3.0:1785774806.535245:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969887 is committed 00000001:00080000:3.0:1785774806.535254:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969886 is committed 00000001:00080000:3.0:1785774806.535258:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969885 is committed 00000100:00100000:1.0:1785774806.535421:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3655:x1872519671265152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 20603us (20678us total) trans 4294969889 rc 0/0 00000100:00100000:1.0:1785774806.535429:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215 00000100:00100000:2.0:1785774806.535871:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969887 gen 2 00000004:00080000:2.0:1785774806.535876:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76056d7100, transno 4294969887 00000100:00100000:2.0:1785774806.535897:0:3655:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b76056d4380 x1872519671265408/t4294969888(4294969888) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774822 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1785774806.535906:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76056d5500/2, rc 0, transno 4294969889 00000100:00100000:2.0:1785774806.535911:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671265152:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1785774806.536094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671265920 00000100:00100000:0.0:1785774806.536101:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671265920 00010000:00010000:0.0:1785774806.536116:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774806.536207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1785774806.536214:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:3640:x1872519671265920:12345-0@lo:105: 00010000:00010000:0.0:1785774806.536227:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.536236:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.536246:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.536254:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 5/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.536262:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.536270:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.536290:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b76057cfa00) 00000100:00100000:0.0:1785774806.536324:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:3640:x1872519671265920:12345-0@lo:105: Request processed in 111us (16589us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.536330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00010000:00010000:1.0:1785774806.536561:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.536570:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.536588:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.536621:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.536628:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.536638:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.536655:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266048:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1785774806.536685:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.536738:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774806.536759:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3640:1872519671265920:0@lo:105: 00010000:00010000:1.0:1785774806.536774:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.536791:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f589 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.544516:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671266048 00000100:00100000:3.0:1785774806.544533:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671266048 00000100:00100000:3.0:1785774806.544739:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1785774806.544750:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671266048:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774806.544772:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.544862:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f669 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f662 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.544895:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f662 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.544915:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f662 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.544923:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x391d5834 (ffff9b77199f5400) 00010000:00010000:3.0:1785774806.544926:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774806.544930:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774806.545050:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266048:12345-0@lo:101:mdt_io00_000.0 Request processed in 302us (8363us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.545058:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:1.0:1785774806.553958:0:6542:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968509 gen 2 00000004:00080000:1.0:1785774806.553969:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968504 committed transno 4294968509 00000004:00080000:1.0:1785774806.553989:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968505 committed transno 4294968509 00000004:00080000:1.0:1785774806.553997:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968506 committed transno 4294968509 00000004:00080000:1.0:1785774806.554005:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968507 committed transno 4294968509 00000004:00080000:1.0:1785774806.554014:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968508 committed transno 4294968509 00000004:00080000:1.0:1785774806.554022:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968509 committed transno 4294968509 00000100:00100000:1.0:1785774806.554037:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266048:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1785774806.554064:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.554079:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.554098:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:0.0:1785774806.554311:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554324:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554337:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554350:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554356:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554378:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554434:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554445:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554452:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554488:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.554506:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 18 pid: 8469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.554518:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671266176:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774806.554601:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8840 going to sleep for 11 seconds 00010000:00010000:0.0:1785774806.561301:0:6542:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000a49852a3 x1872519671266176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 18 pid: 8469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.561327:0:6542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 18 pid: 8469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.561353:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f61c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ff expref: 18 pid: 8469 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.561441:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671266176:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774806.561461:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:0.0:1785774806.561467:0:6542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.561478:0:6542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.561486:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.561506:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.561514:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.561519:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.561660:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266304:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.561707:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.561772:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8000 going to sleep for 11 seconds 00000100:00100000:1.0:1785774806.569493:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671266304 00000100:00100000:1.0:1785774806.569511:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671266304 00000100:00100000:0.0:1785774806.569642:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1785774806.569654:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266304:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.569878:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266304:12345-0@lo:1000:mdt_io00_000.0 Request processed in 226us (8170us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774806.569890:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:1.0:1785774806.570081:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266304:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.570225:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266432:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.570268:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.570349:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.577482:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671266432 00000100:00100000:3.0:1785774806.577498:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671266432 00000100:00100000:3.0:1785774806.577620:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:3.0:1785774806.577632:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266432:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.577774:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266432:12345-0@lo:1000:mdt_io00_000.0 Request processed in 144us (7505us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.577898:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266432:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.578056:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266560:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.578096:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.578121:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:1.0:1785774806.589449:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.589587:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671266560 00000100:00100000:3.0:1785774806.589597:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671266560 00000100:00100000:3.0:1785774806.589662:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1785774806.589671:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266560:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.589800:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266560:12345-0@lo:1000:mdt_io00_000.0 Request processed in 130us (11703us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.589807:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1785774806.589932:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266560:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.590032:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266688:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.590069:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.590091:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b771202b480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.590882:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671266688 00000100:00100000:3.0:1785774806.590888:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671266688 00000100:00100000:3.0:1785774806.590929:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:3.0:1785774806.590937:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266688:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.591005:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671266688:12345-0@lo:1000:mdt_io00_000.0 Request processed in 69us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.591013:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:1.0:1785774806.591095:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266688:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.591219:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266816:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.591250:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.591264:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b771202b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.591320:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671266816 00000100:00100000:3.0:1785774806.591324:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671266816 00000100:00100000:3.0:1785774806.591435:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:3.0:1785774806.591443:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1872519671266816:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.591498:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6542:x1872519671266816:12345-0@lo:1000:mdt_io00_000.0 Request processed in 57us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.591505:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00080000:1.0:1785774806.591590:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774806.591608:0:6542:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969885 gen 2 00000004:00080000:1.0:1785774806.591613:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969881 committed transno 4294969885 00000004:00080000:1.0:1785774806.591626:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969883 committed transno 4294969885 00000004:00080000:1.0:1785774806.591633:0:6542:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969885 committed transno 4294969885 00000100:00100000:1.0:1785774806.591645:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266816:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1785774806.593056:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].403, 1264 off601368 00000040:00080000:1.0:1785774806.593120:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].403, 1344 off656704 00000100:00100000:1.0:1785774806.593200:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266944:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.593242:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.593261:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7701359600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.597062:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671266944 00000100:00100000:0.0:1785774806.597077:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671266944 00000100:00100000:0.0:1785774806.597208:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1785774806.597220:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6542:x1872519671266944:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.597437:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671266944:12345-0@lo:1000:mdt_io00_000.0 Request processed in 220us (4193us total) trans 4294969888 rc 0/0 00000100:00100000:0.0:1785774806.597445:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:1.0:1785774806.597596:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671266944:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1785774806.597612:0:6542:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cec0c0 with version 768 00000004:00080000:0.0:1785774806.601253:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 768 rpc_version 768 00000020:00100000:0.0:1785774806.601302:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774806.601313:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7734659f80 x1872519671267200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3592/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774806.601337:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671267200:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774806.601409:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.601437:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.601540:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671267200 00000100:00100000:3.0:1785774806.601547:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671267200 00000100:00100000:3.0:1785774806.601599:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:3.0:1785774806.601607:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671267200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.602076:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671267200:12345-0@lo:1000:osp_up1-0.0 Request processed in 469us (666us total) trans 4294968512 rc 0/0 00000100:00100000:3.0:1785774806.602085:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:0.0:1785774806.602337:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671267200:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1785774806.602472:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093b50798 reply state 000000009632bfb2 transno 4294983612 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602493:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602502:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:1.0:1785774806.602505:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1785774806.602509:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774806.602518:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602524:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602530:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602536:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602541:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.602546:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602553:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602562:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7706383500) 00010000:00010000:1.0:1785774806.602564:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.602567:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602574:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09f670 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.602592:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093b50798 reply state 000000009632bfb2 transno 4294983612 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602601:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602609:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7706383700) 00010000:00010000:1.0:1785774806.602611:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774806.602613:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774806.602618:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.602626:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602633:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602640:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602658:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774806.602663:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.602668:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602675:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.602688:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:1.0:1785774806.602694:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602699:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602704:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602710:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.602713:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602718:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602725:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7706383100) 00010000:00010000:1.0:1785774806.602727:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.602730:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.602737:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f631 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.602830:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18394:x1872519648512384:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 127385us (127593us total) trans 4294983612 rc 0/0 00000100:00100000:1.0:1785774806.602837:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00010000:00010000:3.0:1785774806.603932:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774806.603941:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.603950:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774806.603955:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774806.603963:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.603996:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.604003:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774806.604035:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.604043:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f638 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f63f expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.604059:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774806.604061:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774806.604063:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774806.604099:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774806.604115:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671267328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774806.604205:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.604521:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671267328 00000100:00100000:3.0:1785774806.604529:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671267328 00000100:00100000:3.0:1785774806.604583:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1785774806.604592:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671267328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774806.604604:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774806.604623:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f63f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f638 expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.604642:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:3.0:1785774806.604650:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774806.604693:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3656:x1872519671267328:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.604700:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1785774806.604863:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671267328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774806.621509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.621593:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648513024 00000100:00100000:0.0:1785774806.621602:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648513024 00000100:00100000:0.0:1785774806.621658:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23840 00000100:00100000:0.0:1785774806.621667:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18394:x1872519648513024:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:0.0:1785774806.621738:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621755:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621766:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621778:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621784:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621791:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621842:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621850:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621855:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774806.621899:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621912:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621919:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621926:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621937:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621944:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.621947:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621955:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621966:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7706383f00) 00010000:00010000:0.0:1785774806.621969:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.621972:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621979:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f685 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.621996:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622002:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622008:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622013:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.622016:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622026:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622033:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7706383a00) 00010000:00010000:0.0:1785774806.622035:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.622037:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622043:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f68c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622052:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622058:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622064:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622069:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774806.622072:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622078:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622084:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:0.0:1785774806.622086:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.622089:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.622097:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f693 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.625517:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18394:x1872519648513024:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 3839us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.625530:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23840 00000100:00100000:0.0:1785774806.631757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.631848:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648513280 00000100:00100000:1.0:1785774806.631859:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648513280 00000100:00100000:1.0:1785774806.631922:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23841 00000100:00100000:1.0:1785774806.631934:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18394:x1872519648513280:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774806.631956:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774806.631978:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f69a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c106 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.632084:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.632097:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.632108:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774806.632118:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1540:0x0]: returning size 3 00010000:00010000:1.0:1785774806.632251:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f69a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1540:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 22 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.632268:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.632275:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:1.0:1785774806.632278:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785774806.632282:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:1.0:1785774806.632338:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18394:x1872519648513280:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 408us (590us total) trans 4294983613 rc 0/0 00000100:00100000:1.0:1785774806.632344:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23841 00000100:00100000:1.0:1785774806.640614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.640710:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648513408 00000100:00100000:3.0:1785774806.640721:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648513408 00000100:00100000:3.0:1785774806.640778:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5218 00000100:00100000:3.0:1785774806.640795:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648513408:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:3.0:1785774806.640840:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.640861:0:14719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 9 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.640870:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785774806.640875:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774806.640880:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.640916:0:14719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 9 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.640931:0:14719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 9 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.640946:0:14719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14719:1872519671267456:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774806.641047:0:14719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.651988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.654590:0:14719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14719:1872519671267456:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774806.654619:0:14719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.660918:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648513536 00000100:00100000:0.0:1785774806.660932:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648513536 00002000:00100000:0.0:1785774806.660988:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->2) req@ffff9b774183f480 x1872519648513536/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/0 e 0 to 0 dl 1785774817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774806.660999:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b774183f480 with x1872519648513536 ext(0->2) 00010000:00010000:0.0:1785774806.661008:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 10 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.661023:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 10 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774806.661031:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b774183f480 00000100:00100000:0.0:1785774806.661063:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:0.0:1785774806.661071:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648513536:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774806.664191:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648513536:12345-192.168.202.31@tcp:4:bash.0 Request processed in 3112us (12204us total) trans 4294969890 rc 0/0 00000100:00100000:3.0:1785774806.664205:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00002000:00100000:3.0:1785774806.664216:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->2) req@ffff9b774183f480 x1872519648513536/t4294969890(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/448 e 0 to 0 dl 1785774817 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774806.664226:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b774183f480 with x1872519648513536 ext(0->2) 00010000:00010000:3.0:1785774806.664236:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 12 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.664255:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 12 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774806.664263:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b774183f480 00000100:00100000:1.0:1785774806.668947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.669086:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648513664 00000100:00100000:3.0:1785774806.669096:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648513664 00010000:00010000:3.0:1785774806.669143:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 12 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.669223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1654 00000100:00100000:3.0:1785774806.669234:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648513664:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774806.669252:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1785774806.669269:0:6515:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:3.0:1785774806.669272:0:6515:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb mtime from disk: 0 -> 1785774804 00002000:00010000:3.0:1785774806.669275:0:6515:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb ctime from disk: 0 -> 1785774804 00002000:00010000:3.0:1785774806.669278:0:6515:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1785774806.669285:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 12 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.669298:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 12 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.669319:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8677fbb/0x7b7109e1d09f520 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0c0 expref: 12 pid: 14725 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.669336:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774806.669341:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774806.669347:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.669357:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.669519:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774806.669609:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648513664:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 377us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.669617:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1654 00010000:00010000:1.0:1785774806.670625:0:14719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670645:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670666:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670674:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670683:0:14719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670691:0:14719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774806.670695:0:14719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670704:0:14719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670718:0:14719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.670726:0:14719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005455c973/0x7b7109e1d09f6af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.670799:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648513408:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 30005us (30196us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.670807:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5218 00000100:00100000:1.0:1785774806.694196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.694275:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648513920 00000100:00100000:0.0:1785774806.694285:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648513920 00000100:00100000:0.0:1785774806.694352:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:0.0:1785774806.694372:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18394:x1872519648513920:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1785774806.694428:0:6544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774806.694457:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09f512 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b9 expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.694474:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:0.0:1785774806.694478:0:6544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774806.694502:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.694515:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.694524:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774806.694542:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:0.0:1785774806.694595:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267584:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.694648:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.694683:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.694803:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671267584 00000100:00100000:3.0:1785774806.694808:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671267584 00000100:00100000:3.0:1785774806.694844:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:3.0:1785774806.694852:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671267584:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.694947:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671267584:12345-0@lo:1000:mdt_io00_002.0 Request processed in 95us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.694955:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:1.0:1785774806.695085:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267584:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.695729:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267712:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774806.695763:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.695869:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.708230:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671267712 00000100:00100000:3.0:1785774806.708247:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671267712 00000100:00100000:1.0:1785774806.708379:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1785774806.708389:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671267712:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774806.712524:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671267712:12345-0@lo:403:mdt_io00_002.0 Request processed in 4127us (16750us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.712540:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1785774806.718183:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267712:0@lo:403:mdt_io00_002.0 00010000:00010000:2.0:1785774806.722706:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.722722:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.722733:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.722755:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267840:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1785774806.725141:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.725219:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d780 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.726604:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671267840 00000100:00100000:3.0:1785774806.726614:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671267840 00000100:00100000:3.0:1785774806.726672:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:3.0:1785774806.726680:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671267840:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774806.726699:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774806.726722:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f6c4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f6bd expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.726750:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f6c4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f6bd expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.726764:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f6c4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f6bd expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.726772:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b77199f5d00) 00010000:00010000:3.0:1785774806.726775:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774806.726778:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774806.726840:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671267840:12345-0@lo:101:mdt_io00_002.0 Request processed in 160us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.726846:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1785774806.726891:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267840:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774806.726909:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.726919:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.726940:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.726973:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.726980:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.726989:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.727019:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267968:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1785774806.727055:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.727144:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.736743:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671267968 00000100:00100000:0.0:1785774806.736759:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671267968 00000100:00100000:1.0:1785774806.737350:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:1.0:1785774806.737372:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671267968:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774806.737392:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774806.737417:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f6d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f6cb expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.737449:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f6d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f6cb expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.737464:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f6d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f6cb expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.737473:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x84832a57 (ffff9b7702c6a000) 00010000:00010000:1.0:1785774806.737477:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.737481:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cee00, rc 0) 00000100:00100000:1.0:1785774806.737561:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6544:x1872519671267968:12345-0@lo:101:mdt_io00_002.0 Request processed in 201us (10504us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.737568:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1785774806.737894:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671267968:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1785774806.737916:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.737927:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774806.737951:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:0.0:1785774806.737974:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.737982:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.737990:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738014:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738021:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738028:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738073:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738085:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 20 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738093:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738257:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 20 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.738273:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 20 pid: 8627 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.738294:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671268096:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774806.738381:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8900 going to sleep for 11 seconds 00010000:00010000:0.0:1785774806.741529:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000e0dd0cb7 x1872519671268096) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 20 pid: 8627 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.741552:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 20 pid: 8627 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.741573:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f6a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c106 expref: 20 pid: 8627 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.741588:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671268096:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774806.741606:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:0.0:1785774806.741611:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.741621:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.741628:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.741644:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.741653:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.741660:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.752330:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268224:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.753114:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.753253:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671268224 00000100:00100000:3.0:1785774806.753263:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671268224 00000100:00100000:3.0:1785774806.753330:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1785774806.753340:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6544:x1872519671268224:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.753613:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.765879:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6544:x1872519671268224:12345-0@lo:1000:mdt_io00_002.0 Request processed in 12529us (12754us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774806.765899:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:1.0:1785774806.771471:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268224:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.771563:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268352:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.771618:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.771651:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77093ad000 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.771749:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671268352 00000100:00100000:3.0:1785774806.771755:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671268352 00000100:00100000:3.0:1785774806.771809:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1785774806.771817:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6544:x1872519671268352:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.771889:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6544:x1872519671268352:12345-0@lo:1000:mdt_io00_002.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.771896:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:1.0:1785774806.776324:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268352:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.776491:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268480:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.776546:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.776577:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec540 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.777112:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671268480 00000100:00100000:2.0:1785774806.777121:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671268480 00000100:00100000:2.0:1785774806.777213:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:2.0:1785774806.777224:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6544:x1872519671268480:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.777315:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6544:x1872519671268480:12345-0@lo:1000:mdt_io00_002.0 Request processed in 93us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.777322:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:1.0:1785774806.778236:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268480:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.778350:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268608:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.778392:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.778416:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b840 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.778508:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671268608 00000100:00100000:0.0:1785774806.778513:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671268608 00000100:00100000:0.0:1785774806.778549:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:0.0:1785774806.778556:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6544:x1872519671268608:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.778623:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6544:x1872519671268608:12345-0@lo:1000:mdt_io00_002.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.778629:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1785774806.780085:0:6544:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969886 gen 2 00000004:00080000:1.0:1785774806.780093:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969882 committed transno 4294969886 00000004:00080000:1.0:1785774806.780111:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969884 committed transno 4294969886 00000004:00080000:1.0:1785774806.780119:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969886 committed transno 4294969886 00000100:00100000:1.0:1785774806.780142:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268608:0@lo:1000:mdt_io00_002.0 00000040:00080000:1.0:1785774806.780537:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].404, 1264 off602632 00000040:00080000:1.0:1785774806.780582:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].404, 1344 off658048 00000100:00100000:1.0:1785774806.780609:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268736:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.780647:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.780840:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.790057:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671268736 00000100:00100000:2.0:1785774806.790071:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671268736 00000100:00100000:2.0:1785774806.790151:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1785774806.790191:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6544:x1872519671268736:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.791416:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671268736:12345-0@lo:1000:mdt_io00_002.0 Request processed in 1195us (10707us total) trans 4294969891 rc 0/0 00000100:00100000:2.0:1785774806.791427:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1785774806.791539:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671268736:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1785774806.791555:0:6544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605ceca80 with version 769 00000004:00080000:0.0:1785774806.791609:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 769 rpc_version 769 00000020:00100000:0.0:1785774806.791642:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774806.791649:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b7bb80 x1872519671268992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774806.791671:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671268992:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774806.791711:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.791743:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.791815:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671268992 00000100:00100000:3.0:1785774806.791822:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671268992 00000100:00100000:3.0:1785774806.791860:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:3.0:1785774806.791868:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671268992:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774806.792238:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671268992:12345-0@lo:1000:osp_up1-0.0 Request processed in 370us (525us total) trans 4294968513 rc 0/0 00000100:00100000:0.0:1785774806.792490:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671268992:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1785774806.792588:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000692d02e6 reply state 00000000a185ad57 transno 4294983614 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792609:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792618:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:1.0:1785774806.792621:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1785774806.792624:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774806.792633:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792640:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792647:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792654:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792660:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.792665:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792674:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792683:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7706383f00) 00010000:00010000:1.0:1785774806.792686:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.792690:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792701:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09f6d9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.792720:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000692d02e6 reply state 00000000a185ad57 transno 4294983614 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792729:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792735:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7706383200) 00010000:00010000:1.0:1785774806.792737:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774806.792739:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774806.792743:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.792750:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792757:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792763:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792799:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774806.792805:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.792810:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792818:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.792837:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:1.0:1785774806.792844:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792851:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792856:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792861:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.792863:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792868:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792876:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7706383a00) 00010000:00010000:1.0:1785774806.792878:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.792881:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.792886:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09f6b6 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.792957:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18394:x1872519648513920:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 98594us (98794us total) trans 4294983614 rc 0/0 00000100:00100000:1.0:1785774806.792965:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00010000:00010000:0.0:1785774806.793448:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774806.793455:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.793462:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a000 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774806.793467:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774806.793480:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.793507:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.793513:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774806.793536:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.793543:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35a000/0x7b7109e1d09f6bd lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f6c4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.793558:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774806.793560:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774806.793562:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774806.793570:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774806.793582:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671269120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774806.793615:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.793647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671269120 00000100:00100000:0.0:1785774806.793653:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671269120 00000100:00100000:0.0:1785774806.793690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1785774806.793697:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3655:x1872519671269120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774806.793709:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774806.793726:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f6c4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f6bd expref: 11 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.793742:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b77199f5d00) 00010000:00010000:0.0:1785774806.793750:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774806.793793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3655:x1872519671269120:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.793800:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1785774806.793834:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671269120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774806.794850:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1785774806.804514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.804690:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648514048 00000100:00100000:2.0:1785774806.804700:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648514048 00000100:00100000:2.0:1785774806.804745:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23842 00000100:00100000:2.0:1785774806.804754:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18394:x1872519648514048:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1785774806.804825:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804839:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804852:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804864:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804871:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804877:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804924:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804931:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804937:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774806.804977:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804989:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.804995:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805002:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805011:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805016:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774806.805020:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805026:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805037:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfef00) 00010000:00010000:2.0:1785774806.805040:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774806.805044:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805050:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f6ee lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805065:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805069:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805074:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805079:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774806.805081:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805089:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805094:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b7605dfe600) 00010000:00010000:2.0:1785774806.805096:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774806.805098:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805103:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09f6f5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805110:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805115:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805119:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805123:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774806.805125:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805141:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805149:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:2.0:1785774806.805151:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774806.805154:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.805188:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f6fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.805271:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18394:x1872519648514048:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 516us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.805279:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23842 00000100:00100000:1.0:1785774806.811534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.811606:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648514304 00000100:00100000:2.0:1785774806.811616:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648514304 00000100:00100000:2.0:1785774806.811670:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23843 00000100:00100000:2.0:1785774806.811679:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18394:x1872519648514304:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774806.811699:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774806.811719:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f703 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c10d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.811812:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.811827:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.811837:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774806.811848:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153c:0x0]: returning size 2 00010000:00010000:2.0:1785774806.811948:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f703 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.811964:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.811974:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:2.0:1785774806.811977:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785774806.811980:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ae00, rc 0) 00000100:00100000:2.0:1785774806.812037:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18394:x1872519648514304:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 360us (515us total) trans 4294983615 rc 0/0 00000100:00100000:2.0:1785774806.812043:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23843 00000100:00100000:1.0:1785774806.818589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.818689:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648514432 00000100:00100000:0.0:1785774806.818699:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648514432 00000100:00100000:0.0:1785774806.818761:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5219 00000100:00100000:0.0:1785774806.818771:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648514432:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:0.0:1785774806.818817:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.818838:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 10 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.818847:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785774806.818851:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774806.818856:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.818893:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 10 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.818909:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 10 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.818924:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1872519671269248:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774806.819019:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8300 going to sleep for 11 seconds 00010000:00010000:2.0:1785774806.822551:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774806.824562:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1872519671269248:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774806.824601:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.834657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.834767:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648514560 00000100:00100000:3.0:1785774806.834784:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648514560 00002000:00100000:3.0:1785774806.834857:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff9b7605c99880 x1872519648514560/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/0 e 0 to 0 dl 1785774817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774806.834871:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c99880 with x1872519648514560 ext(0->1) 00010000:00010000:3.0:1785774806.834884:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 11 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.834907:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 11 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774806.834926:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7605c99880 00000100:00100000:3.0:1785774806.834974:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:3.0:1785774806.834986:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2416:x1872519648514560:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774806.837941:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648514560:12345-192.168.202.31@tcp:4:bash.0 Request processed in 2946us (3283us total) trans 4294969892 rc 0/0 00000100:00100000:3.0:1785774806.837958:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00002000:00100000:3.0:1785774806.837972:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff9b7605c99880 x1872519648514560/t4294969892(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/448 e 0 to 0 dl 1785774817 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774806.837985:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c99880 with x1872519648514560 ext(0->1) 00010000:00010000:3.0:1785774806.839209:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 13 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.839235:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 13 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774806.839246:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b7605c99880 00000100:00100000:0.0:1785774806.858518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.858680:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648514688 00000100:00100000:1.0:1785774806.858692:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648514688 00010000:00010000:1.0:1785774806.858738:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 13 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.858799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1655 00000100:00100000:1.0:1785774806.858810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648514688:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774806.858828:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1785774806.858846:0:6514:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:1.0:1785774806.858849:0:6514:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1785774804 00002000:00010000:1.0:1785774806.858852:0:6514:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1785774804 00002000:00010000:1.0:1785774806.858854:0:6514:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1785774806.858861:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 13 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.858875:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 13 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.858899:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d09f478 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c088 expref: 13 pid: 14530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.858918:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774806.858922:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774806.858929:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.858946:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.858984:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774806.859045:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648514688:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 236us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.859053:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1655 00010000:00010000:3.0:1785774806.859193:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859217:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859247:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859257:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859264:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859270:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774806.859274:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859283:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859295:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.859302:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a5a8d3e/0x7b7109e1d09f718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.859366:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2416:x1872519648514432:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 40587us (40775us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.859375:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5219 00000100:00100000:1.0:1785774806.870767:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.870854:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648514944 00000100:00100000:2.0:1785774806.870866:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648514944 00000100:00100000:2.0:1785774806.870929:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:2.0:1785774806.870940:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18394:x1872519648514944:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1785774806.870997:0:6542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774806.871027:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d09f46a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c081 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.871052:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:2.0:1785774806.871058:0:6542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774806.871083:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.871095:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.871104:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774806.871121:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:2.0:1785774806.871218:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269376:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774806.871334:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.871411:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.871522:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671269376 00000100:00100000:0.0:1785774806.871527:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671269376 00000100:00100000:0.0:1785774806.871565:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1785774806.871572:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6542:x1872519671269376:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.871652:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6542:x1872519671269376:12345-0@lo:1000:mdt_io00_000.0 Request processed in 81us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.871659:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1785774806.871697:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269376:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.874720:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269504:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1785774806.874791:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.874822:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.874919:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671269504 00000100:00100000:2.0:1785774806.874926:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671269504 00000100:00100000:2.0:1785774806.874980:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1785774806.874989:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6542:x1872519671269504:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1785774806.882073:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6542:x1872519671269504:12345-0@lo:403:mdt_io00_000.0 Request processed in 7075us (7271us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.882086:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1785774806.882227:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269504:0@lo:403:mdt_io00_000.0 00010000:00010000:1.0:1785774806.883019:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.883030:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.883040:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.883060:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269632:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1785774806.883096:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.883150:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.885837:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671269632 00000100:00100000:2.0:1785774806.885848:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671269632 00000100:00100000:2.0:1785774806.885910:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1785774806.885920:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6542:x1872519671269632:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774806.885938:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774806.885960:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09f72d lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f726 expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.885988:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09f72d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f726 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.886002:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09f72d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f726 expref: 10 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.886010:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605dfef00) 00010000:00010000:2.0:1785774806.886013:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774806.886017:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b000, rc 0) 00000100:00100000:2.0:1785774806.886094:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671269632:12345-0@lo:101:mdt_io00_000.0 Request processed in 175us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.886101:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1785774806.887384:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269632:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774806.887407:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.887419:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774806.887441:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:3.0:1785774806.887478:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.887485:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.887494:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.887512:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269760:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785774806.887557:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.887603:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.887720:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671269760 00000100:00100000:0.0:1785774806.887727:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671269760 00000100:00100000:0.0:1785774806.887775:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:0.0:1785774806.887783:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6542:x1872519671269760:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1785774806.887795:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774806.887810:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f73b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f734 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.887830:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f734 expref: 11 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.887841:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f734 expref: 11 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.887847:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xbc0ca3a9 (ffff9b7706383400) 00010000:00010000:0.0:1785774806.887850:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.887853:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2200, rc 0) 00000100:00100000:0.0:1785774806.887886:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671269760:12345-0@lo:101:mdt_io00_000.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.887892:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:3.0:1785774806.889370:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671269760:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774806.889388:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889403:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774806.889418:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:3.0:1785774806.889440:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889448:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889455:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889465:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889470:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889476:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889517:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889529:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889538:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889567:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.889580:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 22 pid: 6530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.889592:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671269888:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774806.889656:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84480 going to sleep for 11 seconds 00010000:00010000:3.0:1785774806.892672:0:6542:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000c4286fea x1872519671269888) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 22 pid: 6530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.892696:0:6542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 22 pid: 6530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.892719:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f70a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c10d expref: 22 pid: 6530 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.892733:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671269888:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774806.892750:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:3.0:1785774806.892756:0:6542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.892766:0:6542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.892772:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.892791:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.892799:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.892806:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774806.892931:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270016:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.892973:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.893001:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.896529:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671270016 00000100:00100000:2.0:1785774806.896544:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671270016 00000100:00100000:2.0:1785774806.896608:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:2.0:1785774806.896618:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671270016:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774806.896790:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671270016:12345-0@lo:1000:mdt_io00_000.0 Request processed in 172us (3815us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774806.896797:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:3.0:1785774806.897461:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270016:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.897538:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270144:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.897577:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.897598:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.897654:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671270144 00000100:00100000:0.0:1785774806.897660:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671270144 00000100:00100000:0.0:1785774806.897702:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1785774806.897709:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671270144:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.897774:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671270144:12345-0@lo:1000:mdt_io00_000.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.897781:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1785774806.897942:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270144:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.898041:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270272:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774806.898066:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774806.898092:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.898145:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671270272 00000100:00100000:0.0:1785774806.898149:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671270272 00000100:00100000:0.0:1785774806.898198:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1785774806.898204:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671270272:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.898262:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6542:x1872519671270272:12345-0@lo:1000:mdt_io00_000.0 Request processed in 57us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.898269:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1785774806.898340:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270272:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.898435:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270400:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.898464:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.898488:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b780 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.898583:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671270400 00000100:00100000:0.0:1785774806.898587:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671270400 00000100:00100000:0.0:1785774806.898619:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:0.0:1785774806.898626:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671270400:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.898684:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671270400:12345-0@lo:1000:mdt_io00_000.0 Request processed in 58us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.898691:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1785774806.898764:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270400:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1785774806.899067:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].405, 1264 off603896 00000040:00080000:1.0:1785774806.899117:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].405, 1344 off659392 00000100:00100000:1.0:1785774806.899150:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270528:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774806.899228:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.899241:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.899288:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671270528 00000100:00100000:0.0:1785774806.899292:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671270528 00000100:00100000:0.0:1785774806.899324:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:0.0:1785774806.899331:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6542:x1872519671270528:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774806.899429:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671270528:12345-0@lo:1000:mdt_io00_000.0 Request processed in 98us (199us total) trans 4294969893 rc 0/0 00000100:00100000:0.0:1785774806.899435:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1785774806.900478:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671270528:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1785774806.900489:0:6542:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b760632b9c0 with version 770 00000004:00080000:0.0:1785774806.900548:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 770 rpc_version 770 00000020:00100000:0.0:1785774806.900575:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774806.900583:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7741b7a300 x1872519671270784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774806.900598:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671270784:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774806.900633:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774806.900658:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774806.901142:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671270784 00000100:00100000:1.0:1785774806.901149:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671270784 00000100:00100000:1.0:1785774806.901229:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:1.0:1785774806.901237:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7689:x1872519671270784:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774806.901599:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7689:x1872519671270784:12345-0@lo:1000:osp_up1-0.0 Request processed in 362us (964us total) trans 4294968514 rc 0/0 00000100:00100000:1.0:1785774806.901607:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:3.0:1785774806.902560:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671270784:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1785774806.903270:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf4bd935 reply state 00000000632965d7 transno 4294983616 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903291:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903300:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:1.0:1785774806.903303:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1785774806.903307:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774806.903317:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903325:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903333:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903340:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903346:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.903351:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903438:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903448:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5700) 00010000:00010000:1.0:1785774806.903450:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.903453:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903458:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f742 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.903482:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf4bd935 reply state 00000000632965d7 transno 4294983616 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903489:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903494:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b77199f5600) 00010000:00010000:1.0:1785774806.903496:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774806.903498:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774806.903503:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.903510:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903517:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903523:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903577:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774806.903581:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.903585:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903592:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.903603:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:1.0:1785774806.903610:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903615:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903620:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903624:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.903627:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903632:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903638:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7605dfe600) 00010000:00010000:1.0:1785774806.903641:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.903643:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.903647:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09f71f lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.903731:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18394:x1872519648514944:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 32791us (32972us total) trans 4294983616 rc 0/0 00000100:00100000:1.0:1785774806.903739:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:3.0:1785774806.915438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.915509:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648515072 00000100:00100000:1.0:1785774806.915519:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648515072 00000100:00100000:1.0:1785774806.915581:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23844 00000100:00100000:1.0:1785774806.915593:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18394:x1872519648515072:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:1.0:1785774806.915695:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915711:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915720:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915731:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915738:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915744:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915811:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915820:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915826:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774806.915886:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915900:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915907:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915913:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915920:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915925:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.915930:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915937:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915950:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7702c6ad00) 00010000:00010000:1.0:1785774806.915953:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.915957:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915973:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f757 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915991:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.915998:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916004:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916009:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.916012:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916018:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916026:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7702c6aa00) 00010000:00010000:1.0:1785774806.916029:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.916032:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916043:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f75e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916054:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916060:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916080:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916085:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774806.916088:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916094:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916102:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9b7709388300) 00010000:00010000:1.0:1785774806.916104:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774806.916107:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.916114:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f765 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.916227:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18394:x1872519648515072:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 636us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.916235:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23844 00010000:00010000:0.0:1785774806.918189:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774806.918200:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.918210:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774806.918216:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774806.918225:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.918264:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.918271:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774806.918299:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.918308:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f726 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f72d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.918327:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774806.918329:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774806.918331:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774806.918430:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671270912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774806.918487:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.918643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671270912 00000100:00100000:1.0:1785774806.918650:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671270912 00000100:00100000:1.0:1785774806.918693:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1785774806.918702:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3653:x1872519671270912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774806.918715:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774806.918732:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09f72d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f726 expref: 12 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.918744:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605dfef00) 00010000:00010000:1.0:1785774806.918754:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774806.918787:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3653:x1872519671270912:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774806.918794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1785774806.918975:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671270912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774806.922370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.922532:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648515328 00000100:00100000:0.0:1785774806.922541:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648515328 00000100:00100000:0.0:1785774806.922605:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23845 00000100:00100000:0.0:1785774806.922615:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18394:x1872519648515328:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774806.922638:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774806.922658:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f76c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c114 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.922762:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.922776:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.922787:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774806.922798:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153f:0x0]: returning size 2 00010000:00010000:0.0:1785774806.922898:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f76c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.922915:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 25 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.922924:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9b7709388300) 00010000:00010000:0.0:1785774806.922926:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785774806.922929:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3800, rc 0) 00000100:00100000:0.0:1785774806.922988:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648515328:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 375us (640us total) trans 4294983617 rc 0/0 00000100:00100000:0.0:1785774806.922995:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23845 00000100:00100000:0.0:1785774806.930967:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774806.931082:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648515456 00000100:00100000:2.0:1785774806.931096:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648515456 00000100:00100000:2.0:1785774806.931209:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5220 00000100:00100000:2.0:1785774806.931223:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648515456:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:2.0:1785774806.931283:0:14729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.931308:0:14729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 11 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.931318:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1785774806.931323:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774806.931329:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.931374:0:14729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 11 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.931391:0:14729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 11 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.931409:0:14729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14729:1872519671271040:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774806.931510:0:14729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.934498:0:14729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14729:1872519671271040:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774806.934531:0:14729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.938598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774806.939775:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648515584 00000100:00100000:3.0:1785774806.939797:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648515584 00002000:00100000:3.0:1785774806.939861:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->1) req@ffff9b7741b7b480 x1872519648515584/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/0 e 0 to 0 dl 1785774817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774806.939882:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7b480 with x1872519648515584 ext(0->1) 00010000:00010000:3.0:1785774806.939899:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 12 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.939921:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 12 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774806.939930:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b7741b7b480 00000100:00100000:3.0:1785774806.939970:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:3.0:1785774806.939981:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648515584:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774806.946250:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648515584:12345-192.168.202.31@tcp:4:bash.0 Request processed in 6253us (7646us total) trans 4294969889 rc 0/0 00000100:00100000:3.0:1785774806.946269:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00002000:00100000:3.0:1785774806.946289:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->1) req@ffff9b7741b7b480 x1872519648515584/t4294969889(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:497/0 lens 496/448 e 0 to 0 dl 1785774817 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774806.946301:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7b480 with x1872519648515584 ext(0->1) 00010000:00010000:3.0:1785774806.946315:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 14 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774806.946344:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 14 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774806.946353:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b7741b7b480 00000100:00100000:3.0:1785774806.949656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774806.949805:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648515712 00000100:00100000:0.0:1785774806.949817:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648515712 00010000:00010000:0.0:1785774806.949867:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 14 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774806.949924:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1656 00000100:00100000:0.0:1785774806.949935:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706103050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648515712:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774806.949956:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1785774806.949977:0:19895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1785774806.949981:0:19895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb mtime from disk: 0 -> 1785774804 00002000:00010000:0.0:1785774806.949984:0:19895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb ctime from disk: 0 -> 1785774804 00002000:00010000:0.0:1785774806.949987:0:19895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1785774806.950004:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 14 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.950019:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 14 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.950047:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09f4f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0b2 expref: 14 pid: 14730 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.950068:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774806.950072:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774806.950079:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.950091:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.950138:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774806.950239:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706103050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648515712:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 305us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.950247:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1656 00010000:00010000:2.0:1785774806.950479:0:14729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950490:0:14729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950514:0:14729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950523:0:14729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950532:0:14729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950540:0:14729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774806.950546:0:14729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950555:0:14729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950568:0:14729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.950576:0:14729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d3aaaf0/0x7b7109e1d09f781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.950654:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648515456:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 19435us (19700us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.950662:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5220 00000100:00100000:3.0:1785774806.957512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774806.961081:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648515968 00000100:00100000:1.0:1785774806.961097:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648515968 00000100:00100000:1.0:1785774806.961237:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:1.0:1785774806.961248:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648515968:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1785774806.961302:0:6544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774806.961329:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f4e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0ab expref: 25 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.961355:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9b7709388300) 00010000:00010000:1.0:1785774806.961360:0:6544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774806.961387:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.961400:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.961414:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.961432:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:1.0:1785774806.961484:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271168:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.961542:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.961572:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b540 going to sleep for 11 seconds 00000100:00100000:3.0:1785774806.961928:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671271168 00000100:00100000:3.0:1785774806.961941:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671271168 00000100:00100000:3.0:1785774806.962013:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1785774806.962024:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6544:x1872519671271168:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774806.962211:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6544:x1872519671271168:12345-0@lo:1000:mdt_io00_002.0 Request processed in 189us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774806.962220:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:1.0:1785774806.962321:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271168:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.962893:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271296:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774806.962937:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.963351:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:2.0:1785774806.971359:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671271296 00000100:00100000:2.0:1785774806.971378:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671271296 00000100:00100000:2.0:1785774806.971451:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:2.0:1785774806.971462:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6544:x1872519671271296:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1785774806.973060:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6544:x1872519671271296:12345-0@lo:403:mdt_io00_002.0 Request processed in 1597us (10118us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774806.973073:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1785774806.973446:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271296:0@lo:403:mdt_io00_002.0 00010000:00010000:1.0:1785774806.974050:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.974061:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.974071:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.974091:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271424:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1785774806.974137:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.974188:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.974215:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671271424 00000100:00100000:0.0:1785774806.974230:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671271424 00000100:00100000:0.0:1785774806.974311:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1785774806.974324:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6544:x1872519671271424:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1785774806.974348:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774806.974376:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f796 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f78f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.974413:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f796 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f78f expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.974431:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f796 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f78f expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.974441:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7706383900) 00010000:00010000:0.0:1785774806.974445:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.974449:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2800, rc 0) 00000100:00100000:0.0:1785774806.974521:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671271424:12345-0@lo:101:mdt_io00_002.0 Request processed in 200us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.974529:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1785774806.975138:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271424:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774806.975193:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.975216:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.975234:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.975257:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.975264:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.975271:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.975283:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271552:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1785774806.975316:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774806.975330:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.975457:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671271552 00000100:00100000:0.0:1785774806.975463:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671271552 00000100:00100000:0.0:1785774806.975508:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1785774806.975516:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6544:x1872519671271552:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1785774806.975530:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774806.975545:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f7a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f79d expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.975564:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f7a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f79d expref: 13 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.975575:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f7a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f79d expref: 13 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774806.975587:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xb62e0cbf (ffff9b7706383600) 00010000:00010000:0.0:1785774806.975590:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774806.975593:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3400, rc 0) 00000100:00100000:0.0:1785774806.975630:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6544:x1872519671271552:12345-0@lo:101:mdt_io00_002.0 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.975636:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:1.0:1785774806.979151:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271552:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774806.979221:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979236:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774806.979257:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774806.979283:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979294:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979304:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979316:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979323:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979330:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979372:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979382:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979390:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979425:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774806.979439:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 24 pid: 6531 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774806.979449:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671271680:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774806.979516:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b180 going to sleep for 11 seconds 00010000:00010000:2.0:1785774806.987328:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000027d7da6 x1872519671271680) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 24 pid: 6531 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.987354:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 24 pid: 6531 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.987380:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f773 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c114 expref: 24 pid: 6531 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.987396:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671271680:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774806.987422:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9b7709388300) 00010000:00010000:2.0:1785774806.987427:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.987436:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.987443:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.987465:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.987474:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774806.987479:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774806.987624:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271808:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.987674:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.987753:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.993577:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671271808 00000100:00100000:0.0:1785774806.993592:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671271808 00000100:00100000:0.0:1785774806.993662:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:0.0:1785774806.993673:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6544:x1872519671271808:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.995635:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6544:x1872519671271808:12345-0@lo:1000:mdt_io00_002.0 Request processed in 1956us (7952us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774806.995647:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1785774806.999327:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271808:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.999420:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271936:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774806.999478:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774806.999503:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774806.999635:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671271936 00000100:00100000:0.0:1785774806.999642:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671271936 00000100:00100000:0.0:1785774806.999690:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:0.0:1785774806.999698:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6544:x1872519671271936:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774806.999780:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6544:x1872519671271936:12345-0@lo:1000:mdt_io00_002.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774806.999788:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1785774806.999863:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671271936:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.999958:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671272064:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774806.999984:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.000111:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.000221:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671272064 00000100:00100000:3.0:1785774807.000233:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671272064 00000100:00100000:3.0:1785774807.000291:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:3.0:1785774807.000303:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6544:x1872519671272064:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774807.000417:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6544:x1872519671272064:12345-0@lo:1000:mdt_io00_002.0 Request processed in 116us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.000426:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:1.0:1785774807.000463:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671272064:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774807.000568:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671272192:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774807.000597:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.000679:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.007292:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671272192 00000100:00100000:0.0:1785774807.007306:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671272192 00000100:00100000:0.0:1785774807.007426:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:0.0:1785774807.007435:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671272192:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774807.007564:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671272192:12345-0@lo:1000:mdt_io00_002.0 Request processed in 130us (6965us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.007572:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1785774807.007653:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671272192:0@lo:1000:mdt_io00_002.0 00000040:00080000:1.0:1785774807.008037:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].406, 1264 off605160 00000040:00080000:1.0:1785774807.008089:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].406, 1344 off660736 00000100:00100000:1.0:1785774807.008145:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671272320:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774807.008227:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.014329:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77087cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1785774807.017749:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671272320 00000100:00100000:2.0:1785774807.017763:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671272320 00000100:00100000:0.0:1785774807.017929:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1785774807.017942:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6544:x1872519671272320:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774807.018153:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671272320:12345-0@lo:1000:mdt_io00_002.0 Request processed in 214us (9924us total) trans 4294969890 rc 0/0 00000100:00100000:0.0:1785774807.018175:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:1.0:1785774807.021496:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671272320:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1785774807.021514:0:6544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b760632b180 with version 771 00000004:00080000:3.0:1785774807.028742:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 771 rpc_version 771 00000020:00100000:3.0:1785774807.033418:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774807.033446:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb49180 x1872519671272576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774807.033482:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671272576:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774807.033590:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.033635:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774807.033660:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671272576 00000100:00100000:1.0:1785774807.033676:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671272576 00000100:00100000:1.0:1785774807.033740:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1785774807.033749:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:7689:x1872519671272576:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774807.035472:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:7689:x1872519671272576:12345-0@lo:1000:osp_up1-0.0 Request processed in 1718us (1877us total) trans 4294968515 rc 0/0 00000100:00100000:1.0:1785774807.035484:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1785774807.036258:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671272576:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1785774807.036352:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef708b96 reply state 00000000453a94ee transno 4294983618 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036381:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036390:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9b7709388300) 00010000:00010000:1.0:1785774807.036393:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1785774807.036397:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774807.036406:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036413:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036419:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036426:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036432:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.036436:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036445:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036455:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774807.036457:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.036461:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036466:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7ab lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774807.036485:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef708b96 reply state 00000000453a94ee transno 4294983618 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036493:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036499:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7702c6a900) 00010000:00010000:1.0:1785774807.036502:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774807.036504:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1785774807.036508:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774807.036518:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036524:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036530:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036562:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774807.036566:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:1.0:1785774807.036571:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036577:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774807.036591:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:1.0:1785774807.036598:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036605:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036610:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036615:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.036618:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036623:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036630:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7702c6aa00) 00010000:00010000:1.0:1785774807.036633:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.036635:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.036640:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f788 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.036773:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648515968:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 75525us (79273us total) trans 4294983618 rc 0/0 00000100:00100000:1.0:1785774807.036781:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00010000:00010000:3.0:1785774807.036928:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774807.036938:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.036956:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774807.036964:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774807.036974:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.037357:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.037365:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774807.037399:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.037408:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf200/0x7b7109e1d09f78f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f796 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.037430:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774807.037432:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774807.037435:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774807.037445:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774807.037463:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671272704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774807.037532:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.037578:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671272704 00000100:00100000:3.0:1785774807.037586:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671272704 00000100:00100000:3.0:1785774807.037643:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:3.0:1785774807.037653:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+14:3653:x1872519671272704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774807.037674:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774807.037703:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f796 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f78f expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.037718:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7706383900) 00010000:00010000:3.0:1785774807.037728:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774807.040251:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+13:3653:x1872519671272704:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.040268:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1785774807.040357:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671272704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774807.046317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.046390:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648516096 00000100:00100000:1.0:1785774807.046408:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648516096 00000100:00100000:1.0:1785774807.046485:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23846 00000100:00100000:1.0:1785774807.046494:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648516096:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:1.0:1785774807.046580:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046597:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046609:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046622:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046628:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046634:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046687:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046693:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046699:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774807.046748:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046761:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.046766:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049222:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049236:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049243:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.049247:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049255:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049269:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7702c6aa00) 00010000:00010000:1.0:1785774807.049271:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.049276:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049282:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f7c0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049304:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049309:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049314:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049318:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.049320:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049326:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049331:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774807.049333:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.049335:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049339:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f7c7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049349:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049353:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049358:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049363:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.049365:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049371:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049377:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9b7602507300) 00010000:00010000:1.0:1785774807.049380:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.049383:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.049388:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.049502:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648516096:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 3006us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.049512:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23846 00000100:00100000:1.0:1785774807.055355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.059985:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648516352 00000100:00100000:3.0:1785774807.060015:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648516352 00000100:00100000:3.0:1785774807.060109:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23847 00000100:00100000:3.0:1785774807.060122:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:18394:x1872519648516352:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774807.060180:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774807.060209:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f7d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c11b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.060360:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.060379:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.060395:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774807.060412:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153e:0x0]: returning size 2 00010000:00010000:3.0:1785774807.060557:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f7d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 28 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.060591:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.060602:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774807.060606:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785774807.060609:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774807.060700:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648516352:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 579us (5353us total) trans 4294983619 rc 0/0 00000100:00100000:3.0:1785774807.060708:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23847 00000100:00100000:3.0:1785774807.067250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.068498:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648516480 00000100:00100000:0.0:1785774807.068515:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648516480 00000100:00100000:0.0:1785774807.068609:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5221 00000100:00100000:0.0:1785774807.068623:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2416:x1872519648516480:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:0.0:1785774807.068673:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.068695:0:14722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 11 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.068704:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cc:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785774807.068708:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785774807.068712:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.068748:0:14722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 11 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.068762:0:14722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 11 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774807.068777:0:14722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14722:1872519671272832:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774807.068880:0:14722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf80c0 going to sleep for 11 seconds 00000100:00080000:1.0:1785774807.069205:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774807.075648:0:14722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14722:1872519671272832:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774807.075698:0:14722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.076726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.076811:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648516608 00000100:00100000:1.0:1785774807.076822:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648516608 00002000:00100000:1.0:1785774807.076882:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff9b773fb4b480 x1872519648516608/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 496/0 e 0 to 0 dl 1785774818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774807.076893:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb4b480 with x1872519648516608 ext(0->1) 00010000:00010000:1.0:1785774807.076901:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 12 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.076917:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 12 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774807.076925:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b773fb4b480 00000100:00100000:1.0:1785774807.077012:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:1.0:1785774807.077022:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648516608:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:1.0:1785774807.080079:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648516608:12345-192.168.202.31@tcp:4:bash.0 Request processed in 3049us (3354us total) trans 4294969894 rc 0/0 00000100:00100000:1.0:1785774807.080093:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00002000:00100000:1.0:1785774807.080106:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff9b773fb4b480 x1872519648516608/t4294969894(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 496/448 e 0 to 0 dl 1785774818 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774807.080116:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb4b480 with x1872519648516608 ext(0->1) 00010000:00010000:1.0:1785774807.080137:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 14 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.080158:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 14 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774807.080320:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b773fb4b480 00000100:00100000:3.0:1785774807.089241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774807.089356:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648516736 00000100:00100000:2.0:1785774807.089372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648516736 00010000:00010000:2.0:1785774807.089423:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 14 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.089474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1657 00000100:00100000:2.0:1785774807.089484:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648516736:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774807.089501:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785774807.089518:0:6516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1785774807.089521:0:6516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1785774804 00002000:00010000:2.0:1785774807.089524:0:6516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1785774804 00002000:00010000:2.0:1785774807.089525:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1785774807.089532:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 14 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.089544:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 14 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.089566:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3b4d7c7/0x7b7109e1d09f4cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0a4 expref: 14 pid: 8448 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.089582:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774807.089586:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774807.089592:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.089601:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.089639:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774807.089707:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648516736:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 225us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774807.089713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1657 00010000:00010000:3.0:1785774807.091969:0:14722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092051:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092096:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092106:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092116:0:14722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092134:0:14722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774807.092139:0:14722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092149:0:14722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092263:0:14722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.092273:0:14722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e63bf2/0x7b7109e1d09f7ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.092419:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648516480:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 23794us (25175us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.092435:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5221 00000100:00100000:3.0:1785774807.099216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.099315:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648516992 00000100:00100000:1.0:1785774807.099330:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648516992 00000100:00100000:1.0:1785774807.099409:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:1.0:1785774807.099421:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648516992:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1785774807.099500:0:6542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774807.099538:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09f4be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c09d expref: 27 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.099568:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9b7602507300) 00010000:00010000:1.0:1785774807.099573:0:6542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774807.099606:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.099622:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.099634:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774807.099661:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:1.0:1785774807.099727:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671272960:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774807.099804:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.099840:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77087cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.100109:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671272960 00000100:00100000:3.0:1785774807.100114:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671272960 00000100:00100000:3.0:1785774807.100204:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:3.0:1785774807.100212:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6542:x1872519671272960:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.100320:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6542:x1872519671272960:12345-0@lo:1000:mdt_io00_000.0 Request processed in 108us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.100329:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:1.0:1785774807.100594:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671272960:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774807.101423:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273088:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1785774807.101473:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.101502:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774807.101528:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671273088 00000100:00100000:2.0:1785774807.101543:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671273088 00000100:00100000:2.0:1785774807.101611:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:2.0:1785774807.101621:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6542:x1872519671273088:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1785774807.109537:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6542:x1872519671273088:12345-0@lo:403:mdt_io00_000.0 Request processed in 7908us (8053us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.109553:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:1.0:1785774807.115851:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273088:0@lo:403:mdt_io00_000.0 00010000:00010000:1.0:1785774807.116795:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.116807:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.116818:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.116837:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273216:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1785774807.116891:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.117133:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.117738:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671273216 00000100:00100000:3.0:1785774807.117747:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671273216 00000100:00100000:2.0:1785774807.117862:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:2.0:1785774807.117871:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6542:x1872519671273216:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1785774807.117889:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774807.117907:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f7ff lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f7f8 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.117932:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f7ff lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f7f8 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.117943:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f7ff lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f7f8 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.117958:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:2.0:1785774807.117961:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774807.117965:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b800, rc 0) 00000100:00100000:2.0:1785774807.118021:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671273216:12345-0@lo:101:mdt_io00_000.0 Request processed in 150us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774807.118027:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:3.0:1785774807.118348:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273216:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774807.118365:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.118514:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774807.118535:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:3.0:1785774807.118564:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.118571:0:6542:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.118580:0:6542:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.118714:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273344:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1785774807.118743:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.118818:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.121685:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671273344 00000100:00100000:0.0:1785774807.121697:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671273344 00000100:00100000:0.0:1785774807.121757:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:0.0:1785774807.121767:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:6542:x1872519671273344:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1785774807.121787:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774807.121810:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f80d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f806 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.121838:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f80d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f806 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.121853:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f80d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f806 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.121861:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x18618557 (ffff9b7706383d00) 00010000:00010000:0.0:1785774807.121865:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.121868:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3600, rc 0) 00000100:00100000:0.0:1785774807.121936:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6542:x1872519671273344:12345-0@lo:101:mdt_io00_000.0 Request processed in 170us (3192us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.121943:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:3.0:1785774807.122273:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273344:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1785774807.122290:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122300:0:6542:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774807.122322:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:3.0:1785774807.122342:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122350:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122357:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122369:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122375:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122381:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122428:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122441:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 26 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122450:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122478:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 26 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.122492:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 26 pid: 6529 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.122511:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671273472:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774807.122580:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84240 going to sleep for 11 seconds 00010000:00010000:3.0:1785774807.126388:0:6542:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@0000000016a8c15a x1872519671273472) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 26 pid: 6529 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.126413:0:6542:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 26 pid: 6529 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.126437:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f7dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c11b expref: 26 pid: 6529 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.126457:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6542:1872519671273472:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774807.126475:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9b7602507300) 00010000:00010000:3.0:1785774807.126480:0:6542:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.126487:0:6542:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.126493:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.126508:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.126516:0:6542:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.126522:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.126649:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273600:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.126693:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.126720:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84180 going to sleep for 11 seconds 00000100:00100000:2.0:1785774807.127316:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671273600 00000100:00100000:2.0:1785774807.127324:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671273600 00000100:00100000:2.0:1785774807.127375:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1785774807.127384:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6542:x1872519671273600:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1785774807.127510:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6542:x1872519671273600:12345-0@lo:1000:mdt_io00_000.0 Request processed in 127us (815us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774807.127518:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1785774807.128500:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273600:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.128561:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273728:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.128593:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.128668:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84180 going to sleep for 11 seconds 00000100:00100000:1.0:1785774807.130107:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671273728 00000100:00100000:1.0:1785774807.130117:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671273728 00000100:00100000:0.0:1785774807.130270:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1785774807.130279:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6542:x1872519671273728:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774807.130367:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6542:x1872519671273728:12345-0@lo:1000:mdt_io00_000.0 Request processed in 89us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.130374:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1785774807.130513:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273728:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.130621:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273856:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.130648:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.130664:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84180 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.130732:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671273856 00000100:00100000:0.0:1785774807.130736:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671273856 00000100:00100000:0.0:1785774807.130765:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1785774807.130771:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6542:x1872519671273856:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774807.130833:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6542:x1872519671273856:12345-0@lo:1000:mdt_io00_000.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.130838:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:3.0:1785774807.130937:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273856:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.131026:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273984:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.131049:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.131068:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84780 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.131225:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671273984 00000100:00100000:0.0:1785774807.131230:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671273984 00000100:00100000:0.0:1785774807.131263:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1785774807.131269:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671273984:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1785774807.131321:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671273984:12345-0@lo:1000:mdt_io00_000.0 Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.131326:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00080000:3.0:1785774807.131452:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774807.131473:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671273984:0@lo:1000:mdt_io00_000.0 00000040:00080000:3.0:1785774807.131916:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].407, 1264 off606424 00000040:00080000:3.0:1785774807.131967:0:6542:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].407, 1344 off662080 00000100:00100000:3.0:1785774807.132323:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671274112:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1785774807.132361:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.132379:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84a80 going to sleep for 11 seconds 00000100:00100000:1.0:1785774807.132450:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671274112 00000100:00100000:1.0:1785774807.132455:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671274112 00000100:00100000:1.0:1785774807.132491:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:1.0:1785774807.132499:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6542:x1872519671274112:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1785774807.132606:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6542:x1872519671274112:12345-0@lo:1000:mdt_io00_000.0 Request processed in 108us (244us total) trans 4294969895 rc 0/0 00000100:00100000:1.0:1785774807.132613:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1785774807.132682:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6542:1872519671274112:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1785774807.132691:0:6542:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605f84cc0 with version 772 00000004:00080000:1.0:1785774807.137532:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 772 rpc_version 772 00000020:00100000:1.0:1785774807.137581:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774807.137592:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76044b1880 x1872519671274368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774807.137615:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671274368:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774807.137680:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.137713:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.138730:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671274368 00000100:00100000:0.0:1785774807.138741:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671274368 00000100:00100000:0.0:1785774807.138809:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1785774807.138818:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:7689:x1872519671274368:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774807.139259:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:7689:x1872519671274368:12345-0@lo:1000:osp_up1-0.0 Request processed in 442us (1578us total) trans 4294968516 rc 0/0 00000100:00100000:0.0:1785774807.139267:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:1.0:1785774807.139533:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671274368:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1785774807.140339:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bd8101e reply state 0000000088be04c2 transno 4294983620 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140362:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140372:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9b7602507300) 00010000:00010000:0.0:1785774807.140375:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1785774807.140379:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774807.140389:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140396:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140403:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140411:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140416:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.140421:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140429:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140443:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5000) 00010000:00010000:0.0:1785774807.140445:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.140448:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140454:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f814 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774807.140479:0:6542:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bd8101e reply state 0000000088be04c2 transno 4294983620 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140487:0:6542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140492:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b77199f5b00) 00010000:00010000:0.0:1785774807.140494:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774807.140496:0:6542:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1785774807.140500:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:0.0:1785774807.140509:0:6542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140517:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140525:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140552:0:6542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774807.140555:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:0.0:1785774807.140560:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140569:0:6542:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774807.140581:0:6542:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:0.0:1785774807.140587:0:6542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140591:0:6542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140596:0:6542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140600:0:6542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.140603:0:6542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140608:0:6542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140614:0:6542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774807.140615:0:6542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.140617:0:6542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.140622:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f7f1 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774807.140703:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648516992:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 41282us (41539us total) trans 4294983620 rc 0/0 00000100:00100000:0.0:1785774807.140713:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 12 00010000:00010000:2.0:1785774807.141756:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774807.141764:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.141786:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774807.141791:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774807.141798:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.141829:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.141839:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774807.141866:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.141872:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cfa00/0x7b7109e1d09f7f8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f7ff expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.141884:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774807.141886:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774807.141887:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774807.141930:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774807.141944:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671274496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774807.141987:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.142387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671274496 00000100:00100000:3.0:1785774807.142395:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671274496 00000100:00100000:3.0:1785774807.142449:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:3.0:1785774807.142457:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671274496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774807.142469:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774807.142485:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09f7ff lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f7f8 expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.142497:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:3.0:1785774807.142503:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774807.142539:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+15:3656:x1872519671274496:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.142545:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1785774807.142611:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671274496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774807.144492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.144596:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648517120 00000100:00100000:1.0:1785774807.144602:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648517120 00000100:00100000:1.0:1785774807.144645:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23848 00000100:00100000:1.0:1785774807.144652:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648517120:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:1.0:1785774807.144720:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144733:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144743:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144757:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144762:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144767:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144825:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144832:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144837:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774807.144885:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144897:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144903:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144908:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144913:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144922:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.144926:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144931:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144939:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7702c6a600) 00010000:00010000:1.0:1785774807.144942:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.144945:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144950:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f829 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144963:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144968:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144973:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144977:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.144979:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.144983:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145004:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7702c6ad00) 00010000:00010000:1.0:1785774807.145006:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.145008:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145014:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09f830 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145023:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145027:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145032:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145036:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.145038:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145043:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145048:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774807.145049:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.145051:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.145056:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.145289:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648517120:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 635us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.145298:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23848 00000100:00100000:3.0:1785774807.155923:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.156018:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648517376 00000100:00100000:1.0:1785774807.156027:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648517376 00000100:00100000:1.0:1785774807.156090:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23849 00000100:00100000:1.0:1785774807.156098:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:18394:x1872519648517376:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774807.156119:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.156150:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f83e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c122 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.156303:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.156316:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.156328:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774807.156339:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153b:0x0]: returning size 2 00010000:00010000:1.0:1785774807.156454:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f83e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 30 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.156473:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.156483:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774807.156487:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785774807.156490:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:1.0:1785774807.156541:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18394:x1872519648517376:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 443us (627us total) trans 4294983621 rc 0/0 00000100:00100000:1.0:1785774807.156547:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23849 00000100:00100000:2.0:1785774807.166729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.166837:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648517504 00000100:00100000:1.0:1785774807.166847:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648517504 00000100:00100000:1.0:1785774807.166916:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5222 00000100:00100000:1.0:1785774807.166927:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2419:x1872519648517504:12345-192.168.202.31@tcp:1:lfs.0 00010000:00010000:1.0:1785774807.166973:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.167008:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 12 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.167017:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cb:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1785774807.167022:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774807.167026:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.167062:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 12 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.167077:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 12 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.167091:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1872519671274624:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774807.167229:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77087cc600 going to sleep for 11 seconds 00000100:00080000:3.0:1785774807.167749:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774807.170577:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1872519671274624:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774807.170604:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.175593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.175691:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648517632 00000100:00100000:3.0:1785774807.175707:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648517632 00002000:00100000:3.0:1785774807.175823:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff9b774183ce00 x1872519648517632/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 496/0 e 0 to 0 dl 1785774818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774807.175837:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b774183ce00 with x1872519648517632 ext(0->1) 00010000:00010000:3.0:1785774807.175859:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 13 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.176103:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 13 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774807.176114:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b774183ce00 00000100:00100000:3.0:1785774807.176212:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:3.0:1785774807.176224:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648517632:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:0.0:1785774807.179570:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648517632:12345-192.168.202.31@tcp:4:bash.0 Request processed in 3331us (3969us total) trans 4294969891 rc 0/0 00000100:00100000:0.0:1785774807.179588:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00002000:00100000:0.0:1785774807.179604:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff9b774183ce00 x1872519648517632/t4294969891(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 496/448 e 0 to 0 dl 1785774818 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774807.179617:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b774183ce00 with x1872519648517632 ext(0->1) 00010000:00010000:0.0:1785774807.179630:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 15 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.179654:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 15 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774807.179664:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b774183ce00 00000100:00100000:2.0:1785774807.194350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.194623:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648517760 00000100:00100000:3.0:1785774807.194637:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648517760 00010000:00010000:3.0:1785774807.194694:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 15 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.194748:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1658 00000100:00100000:3.0:1785774807.194769:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648517760:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774807.194790:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1785774807.194815:0:9541:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1785774807.194818:0:9541:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1785774804 00002000:00010000:3.0:1785774807.194820:0:9541:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1785774804 00002000:00010000:3.0:1785774807.194822:0:9541:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1785774807.194829:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 15 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.194845:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 15 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.194882:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2222c35/0x7b7109e1d09f44e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c07a expref: 15 pid: 14719 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.195002:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774807.195009:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785774807.195017:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.195029:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.196321:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774807.196423:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648517760:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1662us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.196434:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1658 00010000:00010000:1.0:1785774807.202009:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202034:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202075:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202084:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202093:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202100:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774807.202105:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202115:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202215:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.202225:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bafd577c/0x7b7109e1d09f853 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.202408:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2419:x1872519648517504:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 35476us (35682us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.202420:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5222 00000100:00100000:2.0:1785774807.221038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.223620:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648518016 00000100:00100000:1.0:1785774807.223638:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648518016 00000100:00100000:1.0:1785774807.223734:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:1.0:1785774807.223745:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18394:x1872519648518016:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1785774807.223834:0:6544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774807.223872:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09f440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c073 expref: 29 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.223908:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774807.223913:0:6544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774807.223951:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.223965:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.223976:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774807.223999:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00000100:00100000:1.0:1785774807.224070:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671274752:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774807.224228:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.224279:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cec480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.224558:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671274752 00000100:00100000:3.0:1785774807.224565:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671274752 00000100:00100000:3.0:1785774807.224620:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1785774807.224628:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6544:x1872519671274752:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774807.224739:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6544:x1872519671274752:12345-0@lo:1000:mdt_io00_002.0 Request processed in 112us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.224749:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1785774807.224983:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671274752:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774807.230335:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671274880:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1785774807.230806:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.230944:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.245076:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671274880 00000100:00100000:0.0:1785774807.245099:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671274880 00000100:00100000:0.0:1785774807.245234:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:0.0:1785774807.245247:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6544:x1872519671274880:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1785774807.260710:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6544:x1872519671274880:12345-0@lo:403:mdt_io00_002.0 Request processed in 15451us (29938us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.260728:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1785774807.261084:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671274880:0@lo:403:mdt_io00_002.0 00010000:00010000:1.0:1785774807.261918:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.261930:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.261942:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.261965:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275008:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1785774807.262015:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.262073:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760632b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.262251:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671275008 00000100:00100000:3.0:1785774807.262260:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671275008 00000100:00100000:3.0:1785774807.262320:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1785774807.262330:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6544:x1872519671275008:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1785774807.262353:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774807.262374:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f868 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f861 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.262405:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f868 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f861 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.262425:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f868 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f861 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.262435:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:3.0:1785774807.262438:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774807.262443:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774807.262488:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671275008:12345-0@lo:101:mdt_io00_002.0 Request processed in 160us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.262495:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:2.0:1785774807.262635:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275008:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774807.262652:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.262663:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774807.262681:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:2.0:1785774807.262709:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.262716:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.262729:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.262743:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275136:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1785774807.262773:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.262805:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774807.266398:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671275136 00000100:00100000:1.0:1785774807.266421:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671275136 00000100:00100000:1.0:1785774807.266516:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1785774807.266528:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6544:x1872519671275136:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1785774807.266555:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.266588:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09f876 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09f86f expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.266627:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09f876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09f86f expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.266644:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09f876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f86f expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.266653:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xdcc87686 (ffff9b7702c6aa00) 00010000:00010000:1.0:1785774807.266656:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.266661:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce000, rc 0) 00000100:00100000:1.0:1785774807.270211:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6544:x1872519671275136:12345-0@lo:101:mdt_io00_002.0 Request processed in 3668us (7420us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.270228:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:2.0:1785774807.273982:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275136:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1785774807.274025:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274044:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774807.274075:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:2.0:1785774807.274412:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274436:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274447:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274462:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274469:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274474:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274535:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274551:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 28 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274562:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274606:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 28 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.274622:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 28 pid: 8627 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.274637:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671275264:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774807.275013:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1785774807.282256:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@0000000044394bdf x1872519671275264) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 28 pid: 8627 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.282289:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 28 pid: 8627 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.282320:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f845 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c122 expref: 28 pid: 8627 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.282341:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6544:1872519671275264:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774807.282371:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774807.282379:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.282392:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.282402:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.282442:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.282453:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.282458:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.282655:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275392:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774807.282720:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.282752:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.283611:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671275392 00000100:00100000:3.0:1785774807.283621:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671275392 00000100:00100000:3.0:1785774807.283688:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:3.0:1785774807.283699:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6544:x1872519671275392:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774807.284112:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6544:x1872519671275392:12345-0@lo:1000:mdt_io00_002.0 Request processed in 412us (1390us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774807.284131:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1785774807.284368:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275392:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774807.284490:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275520:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774807.284524:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.284541:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.284593:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671275520 00000100:00100000:0.0:1785774807.284598:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671275520 00000100:00100000:0.0:1785774807.284639:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:0.0:1785774807.284647:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6544:x1872519671275520:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774807.284713:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6544:x1872519671275520:12345-0@lo:1000:mdt_io00_002.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.284720:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:2.0:1785774807.285239:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275520:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774807.285354:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275648:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774807.285382:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.285454:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d600 going to sleep for 11 seconds 00000100:00100000:1.0:1785774807.303279:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671275648 00000100:00100000:1.0:1785774807.303299:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671275648 00000100:00100000:2.0:1785774807.305196:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1785774807.305213:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6544:x1872519671275648:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774807.305411:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6544:x1872519671275648:12345-0@lo:1000:mdt_io00_002.0 Request processed in 202us (20026us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774807.305420:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:1.0:1785774807.305559:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275648:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774807.305747:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275776:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1785774807.305810:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.305836:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.305879:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671275776 00000100:00100000:0.0:1785774807.305904:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671275776 00000100:00100000:0.0:1785774807.305947:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:0.0:1785774807.305956:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671275776:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1785774807.306048:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671275776:12345-0@lo:1000:mdt_io00_002.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.306055:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:2.0:1785774807.306540:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275776:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1785774807.307275:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].408, 1264 off607688 00000040:00080000:2.0:1785774807.308301:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].408, 1344 off663424 00000100:00100000:2.0:1785774807.308654:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275904:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1785774807.308733:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.308771:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.309047:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671275904 00000100:00100000:3.0:1785774807.309056:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671275904 00000100:00100000:3.0:1785774807.309140:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1785774807.309153:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6544:x1872519671275904:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1785774807.309543:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6544:x1872519671275904:12345-0@lo:1000:mdt_io00_002.0 Request processed in 392us (809us total) trans 4294969892 rc 0/0 00000100:00100000:3.0:1785774807.309552:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:0.0:1785774807.309654:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6544:1872519671275904:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1785774807.309665:0:6544:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b7605cec480 with version 773 00000004:00080000:3.0:1785774807.309718:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 773 rpc_version 773 00000020:00100000:3.0:1785774807.309746:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774807.309755:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603d7a300 x1872519671276160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774807.309783:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671276160:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774807.309820:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.309937:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.319555:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671276160 00000100:00100000:0.0:1785774807.319579:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671276160 00000100:00100000:0.0:1785774807.319663:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:0.0:1785774807.319676:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7689:x1872519671276160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774807.320312:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:7689:x1872519671276160:12345-0@lo:1000:osp_up1-0.0 Request processed in 638us (10489us total) trans 4294968517 rc 0/0 00000100:00100000:0.0:1785774807.320321:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1785774807.324224:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671276160:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1785774807.324626:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a603256a reply state 0000000060859a0e transno 4294983622 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324657:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324673:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774807.324676:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1785774807.324681:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774807.324694:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324703:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324710:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324719:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324726:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.324731:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324740:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324751:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfed00) 00010000:00010000:0.0:1785774807.324754:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.324758:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324765:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f87d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774807.324789:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a603256a reply state 0000000060859a0e transno 4294983622 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324799:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324806:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7605dfe800) 00010000:00010000:0.0:1785774807.324808:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774807.324810:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1785774807.324817:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:0.0:1785774807.324828:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324836:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324843:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324882:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774807.324980:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd0:0x0] 00010000:00010000:0.0:1785774807.324987:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.324996:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774807.325014:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x192:0x0] 00010000:00010000:0.0:1785774807.325024:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.325030:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.325037:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.325042:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.325045:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.325052:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.325060:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9b7702c6ad00) 00010000:00010000:0.0:1785774807.325063:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.325194:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.325203:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f85a lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774807.325446:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18394:x1872519648518016:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 101699us (104417us total) trans 4294983622 rc 0/0 00000100:00100000:0.0:1785774807.325458:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 13 00010000:00010000:3.0:1785774807.328195:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774807.328212:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.328227:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774807.328236:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774807.328247:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.328310:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.328317:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774807.328358:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.328374:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce200/0x7b7109e1d09f861 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09f868 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.328397:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774807.328399:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774807.328401:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774807.328429:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671276288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774807.328513:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.328583:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671276288 00000100:00100000:3.0:1785774807.328592:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671276288 00000100:00100000:3.0:1785774807.328647:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1785774807.328655:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+18:3656:x1872519671276288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774807.328672:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774807.328692:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f868 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09f861 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.328714:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:3.0:1785774807.328723:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774807.328753:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671276288:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.328761:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1785774807.328831:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671276288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774807.334506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.335153:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648518272 00000100:00100000:0.0:1785774807.335184:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648518272 00000100:00100000:0.0:1785774807.335278:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5110 00000100:00100000:0.0:1785774807.335294:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:18394:x1872519648518272:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1785774807.336259:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18394:x1872519648518272:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 967us (1758us total) trans 4294968518 rc 0/0 00000100:00100000:0.0:1785774807.336270:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5110 00000100:00100000:0.0:1785774807.374930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.375115:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648518528 00000100:00100000:3.0:1785774807.375134:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648518528 00000100:00100000:3.0:1785774807.375230:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23850 00000100:00100000:3.0:1785774807.375242:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18396:x1872519648518528:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774807.375266:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774807.375285:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09f892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c129 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375356:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375370:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375382:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375397:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375405:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375411:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375485:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f8a7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375494:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f8a7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375501:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f8a7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375518:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375526:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375532:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375539:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375545:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774807.375549:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375555:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375566:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774807.375569:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774807.375573:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375580:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09f899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375599:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375606:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375612:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375618:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774807.375621:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375627:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375632:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b77199f5800) 00010000:00010000:3.0:1785774807.375635:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774807.375637:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375643:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09f8a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375670:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09f892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c129 expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375682:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f8a7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c129 expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.375689:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:3.0:1785774807.375691:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785774807.375693:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774807.375754:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18396:x1872519648518528:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 515us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.375765:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23850 00000100:00100000:3.0:1785774807.384264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.384428:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648518784 00000100:00100000:1.0:1785774807.384438:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648518784 00000100:00100000:1.0:1785774807.384496:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23851 00000100:00100000:1.0:1785774807.384506:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:18396:x1872519648518784:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774807.384530:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.384551:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8ae lrc: 2/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c130 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774807.384692:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:1.0:1785774807.384770:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8ae lrc: 1/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c130 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.384796:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774807.384799:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774807.384804:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8ae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c130 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.384820:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:1.0:1785774807.384874:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18396:x1872519648518784:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 369us (619us total) trans 4294968519 rc 301/301 00000100:00100000:1.0:1785774807.384881:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23851 00000100:00100000:2.0:1785774807.400232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774807.400337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.400727:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648519040 00000100:00100000:3.0:1785774807.400736:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648519040 00000100:00100000:3.0:1785774807.400803:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1475 00000100:00100000:3.0:1785774807.400812:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2417:x1872519648519040:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774807.400827:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774807.400850:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f8a7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c129 expref: 30 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.400872:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:3.0:1785774807.400876:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774807.400921:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:2417:x1872519648519040:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 111us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.400928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1475 00000100:00100000:1.0:1785774807.401118:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648518912 00000100:00100000:1.0:1785774807.401132:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648518912 00000100:00100000:1.0:1785774807.401188:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5111 00000100:00100000:1.0:1785774807.401196:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732247850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18396:x1872519648518912:12345-192.168.202.31@tcp:33:lfs.0 00000004:00200000:1.0:1785774807.401324:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00000004:00200000:1.0:1785774807.401328:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:1.0:1785774807.401363:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732247850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18396:x1872519648518912:12345-192.168.202.31@tcp:33:lfs.0 Request processed in 168us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.401370:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5111 00000100:00100000:0.0:1785774807.404926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.405015:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648519296 00000100:00100000:1.0:1785774807.405024:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648519296 00000100:00100000:1.0:1785774807.405075:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5112 00000100:00100000:1.0:1785774807.405085:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:18396:x1872519648519296:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1785774807.405340:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18396:x1872519648519296:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 255us (419us total) trans 4294968520 rc 0/0 00000100:00100000:1.0:1785774807.405348:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5112 00000100:00100000:0.0:1785774807.424417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.424522:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648519424 00000100:00100000:1.0:1785774807.424533:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648519424 00000100:00100000:1.0:1785774807.424597:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23852 00000100:00100000:1.0:1785774807.424608:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:18204:x1872519648519424:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774807.424632:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.424654:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c137 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.424719:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f8c3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.424731:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f8c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.424743:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f8c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774807.424845:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00000004:00200000:1.0:1785774807.424850:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:1.0:1785774807.424871:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f8c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.424896:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c137 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.424916:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f8c3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c137 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.424925:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7702c6ad00) 00010000:00010000:1.0:1785774807.424927:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774807.424930:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfe00, rc 0) 00000100:00100000:1.0:1785774807.424987:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18204:x1872519648519424:12345-192.168.202.31@tcp:101:bash.0 Request processed in 381us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.424994:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23852 00000100:00100000:2.0:1785774807.440622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.440718:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648519552 00000100:00100000:1.0:1785774807.440727:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648519552 00000100:00100000:1.0:1785774807.440798:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23853 00000100:00100000:1.0:1785774807.440809:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:18204:x1872519648519552:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774807.440832:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.440855:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8ca lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c13e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.440916:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f8d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.440930:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.440942:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774807.440984:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xd0:0x0]: returning size 4096 00000004:00200000:1.0:1785774807.441133:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1785774807.441212:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8ca lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c13e expref: 12 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.441236:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f8d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c13e expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.441245:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774807.441248:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785774807.441251:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774807.441303:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18204:x1872519648519552:12345-192.168.202.31@tcp:101:bash.0 Request processed in 496us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.441310:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23853 00000100:00100000:3.0:1785774807.445928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774807.446034:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648519680 00000100:00100000:2.0:1785774807.446043:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648519680 00000100:00100000:2.0:1785774807.446110:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23854 00000100:00100000:2.0:1785774807.446130:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:18204:x1872519648519680:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774807.446152:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774807.446212:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f8d8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c145 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.446272:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.446290:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.446301:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774807.446343:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd2:0x0]: returning size 4096 00000004:00200000:2.0:1785774807.446349:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1785774807.446388:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09f8d8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 31 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.446407:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 30 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.446414:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:2.0:1785774807.446417:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774807.446420:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b000, rc 0) 00000100:00100000:2.0:1785774807.446471:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648519680:12345-192.168.202.31@tcp:101:bash.0 Request processed in 352us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774807.446478:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23854 00000100:00100000:0.0:1785774807.456346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.457094:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648519936 00000100:00100000:3.0:1785774807.457104:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648519936 00000100:00100000:3.0:1785774807.457215:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23855 00000100:00100000:3.0:1785774807.457225:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18204:x1872519648519936:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774807.457247:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774807.457270:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f8e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.457438:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09f8ed lrc: 3/1,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.457458:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09f8ed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.457470:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09f8ed lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774807.457482:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:3.0:1785774807.457584:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09f8e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c14c expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.457613:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09f8ed lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c14c expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.457621:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7702c6ad00) 00010000:00010000:3.0:1785774807.457624:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785774807.457628:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:3.0:1785774807.457687:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18204:x1872519648519936:12345-192.168.202.31@tcp:101:bash.0 Request processed in 464us (1348us total) trans 4294968521 rc 0/0 00000100:00100000:3.0:1785774807.457694:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23855 00000100:00100000:3.0:1785774807.470808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774807.470949:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520064 00000100:00100000:2.0:1785774807.470959:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520064 00000100:00100000:2.0:1785774807.471032:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5113 00000100:00100000:2.0:1785774807.471042:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18204:x1872519648520064:12345-192.168.202.31@tcp:37:bash.0 00000100:00100000:2.0:1785774807.484371:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18204:x1872519648520064:12345-192.168.202.31@tcp:37:bash.0 Request processed in 13319us (13561us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774807.484387:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5113 00000100:00100000:1.0:1785774807.511471:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.515913:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520192 00000100:00100000:3.0:1785774807.515926:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520192 00000100:00100000:2.0:1785774807.518204:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5114 00000100:00100000:2.0:1785774807.518219:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648520192:12345-192.168.202.31@tcp:37:bash.0 00000100:00100000:1.0:1785774807.533696:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18204:x1872519648520192:12345-192.168.202.31@tcp:37:bash.0 Request processed in 15471us (22225us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.533709:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5114 00000100:00100000:0.0:1785774807.566970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.567300:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520320 00000100:00100000:1.0:1785774807.567310:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520320 00000100:00100000:1.0:1785774807.567370:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23856 00000100:00100000:1.0:1785774807.567380:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648520320:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774807.567402:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.567425:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8fb lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c153 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567494:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567509:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567525:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567541:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567548:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567554:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567598:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567606:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567612:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567619:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567625:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.567630:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567638:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567648:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774807.567652:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.567657:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567663:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f902 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567675:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567681:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567687:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567693:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.567696:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567702:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567708:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xeddcfc6c (ffff9b7702c6a600) 00010000:00010000:1.0:1785774807.567710:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.567713:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567719:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f909 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567746:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8fb lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c153 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567761:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774807.567763:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774807.567875:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f8fb lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c153 expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.567887:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:1.0:1785774807.567992:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648520320:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 605us (1023us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774807.568000:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23856 00000100:00100000:1.0:1785774807.588417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.592302:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520448 00000100:00100000:0.0:1785774807.592317:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520448 00000100:00100000:0.0:1785774807.592453:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23857 00000100:00100000:0.0:1785774807.592465:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18398:x1872519648520448:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774807.592488:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774807.592510:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f910 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c15a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592571:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592585:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592595:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592607:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592613:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592618:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592658:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592665:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592671:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592678:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592683:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.592686:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592692:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592701:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774807.592703:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.592707:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592712:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09f917 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592724:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592729:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592736:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592741:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.592744:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592750:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592756:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xeddcfc6c (ffff9b7706383c00) 00010000:00010000:0.0:1785774807.592758:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.592760:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592765:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09f91e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592803:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f910 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c15a expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592811:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774807.592812:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774807.592815:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f910 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c15a expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.592822:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2600, rc 0) 00000100:00100000:0.0:1785774807.592900:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18398:x1872519648520448:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 438us (4493us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774807.592908:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23857 00000100:00100000:2.0:1785774807.601297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.601894:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520576 00000100:00100000:1.0:1785774807.601903:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520576 00000100:00100000:1.0:1785774807.601954:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23858 00000100:00100000:1.0:1785774807.601962:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648520576:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774807.601980:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.602215:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f925 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c161 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602276:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602288:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602297:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602312:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602318:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602323:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602359:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602365:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602371:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602377:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602383:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.602387:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602394:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602405:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774807.602409:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.602413:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602420:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09f92c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602431:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602437:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602442:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602445:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.602448:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602452:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602458:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x3491cd4c (ffff9b7702c6a600) 00010000:00010000:1.0:1785774807.602459:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.602462:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602466:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d09f933 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602495:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f925 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c161 expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602507:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774807.602509:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774807.602512:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d09f925 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c161 expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.602519:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:1.0:1785774807.602587:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648520576:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 625us (1298us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774807.602593:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23858 00000100:00100000:2.0:1785774807.609554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.609617:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520704 00000100:00100000:0.0:1785774807.609628:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520704 00000100:00100000:0.0:1785774807.609758:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23859 00000100:00100000:0.0:1785774807.609771:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18398:x1872519648520704:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774807.609793:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774807.609814:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f93a lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c168 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.609878:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.609894:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.609905:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.609919:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.609926:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.609932:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610242:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610256:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610262:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610268:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610274:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.610278:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610286:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610298:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774807.610300:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.610304:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610310:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f941 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610323:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610328:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610333:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610338:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.610340:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610345:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610414:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x3491cd4c (ffff9b7706383000) 00010000:00010000:0.0:1785774807.610418:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.610421:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610427:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f948 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610458:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f93a lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c168 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610468:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774807.610471:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774807.610474:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f93a lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c168 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.610481:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774807.611655:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18398:x1872519648520704:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 1882us (2104us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774807.611727:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23859 00000100:00100000:2.0:1785774807.627535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.628600:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520832 00000100:00100000:1.0:1785774807.628609:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520832 00000100:00100000:1.0:1785774807.628661:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23860 00000100:00100000:1.0:1785774807.628670:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648520832:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774807.628690:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.628709:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f94f lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c16f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628778:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628792:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628804:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628818:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628826:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628833:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628868:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628875:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628881:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628888:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628894:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.628898:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628905:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628916:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774807.628919:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.628923:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628929:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09f956 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628942:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628948:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628955:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628959:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.628962:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628968:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.628974:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x3735a305 (ffff9b7605fd8900) 00010000:00010000:1.0:1785774807.628976:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.629092:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.629100:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09f95d lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.629138:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f94f lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c16f expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.629147:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774807.629149:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774807.629153:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d09f94f lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c16f expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.629176:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:1.0:1785774807.629245:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648520832:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 576us (1721us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774807.629252:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23860 00000100:00100000:1.0:1785774807.635825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774807.635915:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648520960 00000100:00100000:2.0:1785774807.635926:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648520960 00000100:00100000:2.0:1785774807.635999:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23861 00000100:00100000:2.0:1785774807.636010:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18398:x1872519648520960:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774807.636033:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774807.636055:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f964 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c176 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636132:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636148:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636189:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636214:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636222:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636229:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636271:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636278:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636284:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636291:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636297:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774807.636301:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636308:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636318:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:2.0:1785774807.636321:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774807.636325:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636332:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f96b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636344:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636350:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636357:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636361:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774807.636364:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636369:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636376:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x3735a305 (ffff9b7605dfeb00) 00010000:00010000:2.0:1785774807.636378:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774807.636380:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636386:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f972 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636416:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f964 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c176 expref: 14 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636427:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:2.0:1785774807.636430:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774807.636434:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f964 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c176 expref: 14 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.636444:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ae00, rc 0) 00000100:00100000:2.0:1785774807.636501:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18398:x1872519648520960:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 493us (685us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774807.636512:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23861 00000100:00100000:3.0:1785774807.650061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.650154:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648521216 00000100:00100000:0.0:1785774807.650198:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648521216 00000100:00100000:0.0:1785774807.650242:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23862 00000100:00100000:0.0:1785774807.650250:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648521216:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774807.650271:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774807.650291:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f979 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c17d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650359:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650373:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650383:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650393:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650401:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650407:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650466:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650473:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650479:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650486:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650492:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.650496:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650504:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650514:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774807.650517:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.650521:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650527:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f980 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650539:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650546:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650552:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650556:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.650559:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650569:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650576:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7605dfe800) 00010000:00010000:0.0:1785774807.650578:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.650580:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650586:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09f987 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650609:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f979 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c17d expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650618:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774807.650619:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774807.650623:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f979 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c17d expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.650631:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774807.650690:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18398:x1872519648521216:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 441us (637us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774807.650698:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23862 00000100:00100000:1.0:1785774807.666940:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774807.667043:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648521472 00000100:00100000:2.0:1785774807.667054:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648521472 00000100:00100000:2.0:1785774807.667114:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23863 00000100:00100000:2.0:1785774807.667134:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18398:x1872519648521472:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774807.667155:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774807.667225:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f98e lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c184 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.667299:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.667314:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.667325:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.667336:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.667345:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09f876 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f86f expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.667353:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.667387:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09f876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f86f expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.667408:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671276416:0@lo:104: 00000100:00100000:2.0:1785774807.667458:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.667513:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.667709:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671276416 00000100:00100000:3.0:1785774807.667714:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671276416 00000100:00100000:3.0:1785774807.667749:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1785774807.667756:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6531:x1872519671276416:12345-0@lo:104: 00010000:00010000:3.0:1785774807.667778:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.667830:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774807.667836:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6531:x1872519671276416:12345-0@lo:104: Request processed in 81us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.667842:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00010000:00010000:0.0:1785774807.667909:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774807.667916:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.667923:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774807.667929:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774807.667938:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.667965:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.667971:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774807.668004:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.668012:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b773c35be00/0x7b7109e1d09f86f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f876 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.668029:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774807.668031:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774807.668033:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774807.668207:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671276416:0@lo:104: 00010000:00010000:2.0:1785774807.668225:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.668377:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774807.668390:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671276544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774807.668428:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.668532:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671276544 00000100:00100000:2.0:1785774807.668536:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671276544 00010000:00010000:2.0:1785774807.668555:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09f876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f86f expref: 17 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.668582:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:2.0:1785774807.668587:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7706101050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+17:3654:x1872519671276544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774807.668596:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1785774807.670743:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968521 is committed 00000001:00080000:0.0:1785774807.670759:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968517 is committed 00000020:00080000:0.0:1785774807.670781:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 405 batchid updated 00010000:00010000:1.0:1785774807.670901:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d09f876 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f86f expref: 11 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.670920:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xdcc87686 (ffff9b7702c6aa00) 00010000:00010000:1.0:1785774807.670925:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.670935:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.670943:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.670973:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774807.671048:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7706101050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671276544:12345-0@lo:103:ldlm_bl.0 Request processed in 2458us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.671056:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:1.0:1785774807.671142:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671276544:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1785774807.671303:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 405 00000004:00080000:3.0:1785774807.671356:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605f84540 with version 775 00000020:00080000:3.0:1785774807.671373:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 405 cancel update log [0x200000401:0x3:0x0].403: rc = 0 00000020:00080000:3.0:1785774807.671445:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 405 cancel update log [0x240000400:0x3:0x0].404: rc = 0 00000020:00080000:3.0:1785774807.671452:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 405 00010000:00010000:0.0:1785774807.672104:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672114:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672256:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f9a3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672271:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f9a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672280:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f9a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774807.672290:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x198:0x0]: returning size 2 00010000:00010000:0.0:1785774807.672350:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672358:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672364:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672370:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672376:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.672380:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672389:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672400:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774807.672403:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.672407:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672414:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09f995 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672426:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672432:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672439:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672444:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.672447:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672453:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672459:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xdcc87686 (ffff9b7702c6aa00) 00010000:00010000:0.0:1785774807.672461:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.672463:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672469:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ae00/0x7b7109e1d09f99c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672510:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09f98e lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c184 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672523:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f9a3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c184 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.672536:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9b7702bc0c00) 00010000:00010000:0.0:1785774807.672539:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774807.672541:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774807.672588:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18398:x1872519648521472:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 5457us (5657us total) trans 4294968522 rc 0/0 00000100:00100000:0.0:1785774807.672595:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23863 00000004:00080000:1.0:1785774807.674350:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 775 rpc_version 775 00000020:00100000:1.0:1785774807.674388:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774807.674398:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb4b100 x1872519671276800/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774807.674422:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671276800:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774807.674491:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.674519:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.676332:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671276800 00000100:00100000:0.0:1785774807.676342:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671276800 00000100:00100000:0.0:1785774807.676395:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1785774807.676406:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7474:x1872519671276800:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774807.676562:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671276800:12345-0@lo:1000:osp_up0-1.0 Request processed in 158us (2071us total) trans 4294983623 rc 0/0 00000100:00100000:0.0:1785774807.676569:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:1.0:1785774807.677098:0:7474:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983610 gen 2 00000004:00080000:1.0:1785774807.677104:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983610 committed transno 4294983610 00000020:00080000:1.0:1785774807.677109:0:7474:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7735a4db40 refcount 2 committed 0 result 0 batchid 406 00000020:00080000:1.0:1785774807.677113:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054ab500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7735a4df00 00000020:00080000:1.0:1785774807.677116:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].404 00000020:00080000:1.0:1785774807.677128:0:7474:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054abd00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604760800 00000020:00080000:1.0:1785774807.677131:0:7474:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].405 00000100:00100000:1.0:1785774807.677184:0:7474:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b773fb4b100 x1872519671276800/t4294983623(4294983623) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1785774823 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785774807.677200:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671276800:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1785774807.678079:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 406 committed batchid 405 00000020:00080000:3.0:1785774807.678134:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 405 00000100:00100000:2.0:1785774807.682995:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.683140:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648521600 00000100:00100000:1.0:1785774807.683148:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648521600 00000100:00100000:1.0:1785774807.683217:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5223 00000100:00100000:1.0:1785774807.683226:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648521600:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774807.683244:0:14712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.683263:0:14712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c18b expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774807.683291:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x6a70c2d4, atime: 0x0, ctime: 0x6a70c2d4, blocks: 0x8 00010000:00010000:1.0:1785774807.683310:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:1.0:1785774807.683314:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774807.683322:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 14 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.683336:0:14712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 14 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.683347:0:14712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700030e00, rc 0) 00000100:00100000:1.0:1785774807.683408:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648521600:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 182us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.683415:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5223 00000100:00100000:2.0:1785774807.698879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.699013:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648521728 00000100:00100000:1.0:1785774807.699023:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648521728 00002000:00100000:1.0:1785774807.699071:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff9b76056d6a00 x1872519648521728/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1785774818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774807.699082:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76056d6a00 with x1872519648521728 ext(0->4095) 00002000:00010000:1.0:1785774807.699088:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76056d6a00 00000100:00100000:1.0:1785774807.699127:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:1.0:1785774807.699141:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648521728:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:1.0:1785774807.699344:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648521728:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 207us (472us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1785774807.699355:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00002000:00100000:1.0:1785774807.699362:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff9b76056d6a00 x1872519648521728/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1785774818 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774807.699370:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76056d6a00 with x1872519648521728 ext(0->4095) 00002000:00010000:1.0:1785774807.699373:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76056d6a00 00000100:00100000:2.0:1785774807.734918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.735053:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648521984 00000100:00100000:3.0:1785774807.735061:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648521984 00000100:00100000:3.0:1785774807.735145:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5115 00000100:00100000:3.0:1785774807.735157:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:18398:x1872519648521984:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:3.0:1785774807.736327:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18398:x1872519648521984:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 1168us (1412us total) trans 4294968523 rc 0/0 00000100:00100000:3.0:1785774807.736337:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5115 00000100:00100000:3.0:1785774807.774592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774807.774701:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648522240 00000100:00100000:2.0:1785774807.774711:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648522240 00000100:00100000:2.0:1785774807.774765:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23864 00000100:00100000:2.0:1785774807.774788:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18400:x1872519648522240:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774807.774808:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774807.774829:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09f9b8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c192 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774903:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774915:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774926:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774934:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774941:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774947:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774982:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.774999:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775004:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775010:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775015:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774807.775019:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775026:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775035:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:2.0:1785774807.775038:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774807.775042:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775047:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09f9bf lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775059:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775064:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775069:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775072:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774807.775075:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775079:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775084:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b77199f5600) 00010000:00010000:2.0:1785774807.775086:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774807.775089:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775093:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09f9c6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775124:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09f9b8 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c192 expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775134:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:2.0:1785774807.775136:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774807.775139:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09f9b8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c192 expref: 31 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.775147:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b800, rc 0) 00000100:00100000:2.0:1785774807.775253:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18400:x1872519648522240:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 479us (669us total) trans 0 rc 301/301 00000100:00100000:2.0:1785774807.775260:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23864 00000100:00100000:2.0:1785774807.795467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.795553:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648522496 00000100:00100000:1.0:1785774807.795564:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648522496 00000100:00100000:1.0:1785774807.795621:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23865 00000100:00100000:1.0:1785774807.795630:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18400:x1872519648522496:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774807.795654:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774807.795673:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031000/0x7b7109e1d09f9cd lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c199 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.795741:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.795755:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.795778:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.795790:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.795800:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f734 expref: 9 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.795814:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.795846:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f734 expref: 9 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774807.795860:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671276928:0@lo:104: 00000100:00100000:1.0:1785774807.795904:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.795948:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3840 going to sleep for 11 seconds 00000100:00100000:3.0:1785774807.796087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671276928 00000100:00100000:3.0:1785774807.796091:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671276928 00000100:00100000:3.0:1785774807.796134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1785774807.796141:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671276928:12345-0@lo:104: 00010000:00010000:3.0:1785774807.796152:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.796242:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774807.796248:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671276928:12345-0@lo:104: Request processed in 108us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.796255:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00010000:00010000:3.0:1785774807.796275:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774807.796281:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.796289:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774807.796294:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774807.796303:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.796328:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.796334:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774807.796354:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.796362:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1600/0x7b7109e1d09f734 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f73b expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.796378:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774807.796380:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774807.796382:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774807.796389:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774807.796399:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671277056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774807.796428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774807.796456:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671277056 00000100:00100000:3.0:1785774807.796460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671277056 00010000:00010000:3.0:1785774807.796476:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f73b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f734 expref: 10 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774807.796496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:3.0:1785774807.796502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3653:x1872519671277056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774807.796511:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1785774807.797287:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671276928:0@lo:104: 00010000:00010000:1.0:1785774807.797312:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774807.803603:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968523 is committed 00000020:00080000:2.0:1785774807.803627:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 406 batchid updated 00000020:00080000:3.0:1785774807.803664:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 406 00000004:00080000:3.0:1785774807.803749:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7605f84b40 with version 776 00000020:00080000:3.0:1785774807.803786:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 406 cancel update log [0x200000401:0x3:0x0].404: rc = 0 00000020:00080000:3.0:1785774807.803885:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 406 cancel update log [0x240000400:0x3:0x0].405: rc = 0 00000020:00080000:3.0:1785774807.803901:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 406 00000004:00080000:1.0:1785774807.804082:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 776 rpc_version 776 00000020:00100000:1.0:1785774807.804140:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774807.804155:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76044b1c00 x1872519671277312/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774807.804213:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671277312:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774807.804309:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774807.804348:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3840 going to sleep for 11 seconds 00000100:00100000:0.0:1785774807.804557:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671277312 00000100:00100000:0.0:1785774807.804568:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671277312 00000100:00100000:0.0:1785774807.804638:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:0.0:1785774807.804650:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671277312:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774807.805321:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:7474:x1872519671277312:12345-0@lo:1000:osp_up0-1.0 Request processed in 662us (1002us total) trans 4294983624 rc 0/0 00000100:00100000:3.0:1785774807.805334:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671277312:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774807.805347:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00010000:00010000:3.0:1785774807.806348:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2200/0x7b7109e1d09f73b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f734 expref: 10 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.806503:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xbc0ca3a9 (ffff9b7706383400) 00010000:00010000:3.0:1785774807.806509:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.806521:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.806535:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.806561:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774807.806687:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3653:x1872519671277056:12345-0@lo:103:ldlm_bl.0 Request processed in 10182us (10255us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.806696:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00010000:00010000:1.0:1785774807.806764:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.806781:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.806946:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030400/0x7b7109e1d09f9e2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.806959:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030400/0x7b7109e1d09f9e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.806968:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030400/0x7b7109e1d09f9e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774807.806982:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x195:0x0]: returning size 2 00010000:00010000:1.0:1785774807.807074:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807083:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807089:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807096:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807104:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.807109:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807128:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807139:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774807.807142:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.807147:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807153:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09f9d4 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807192:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807198:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807204:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807209:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.807212:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807217:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807224:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xbc0ca3a9 (ffff9b7706383400) 00010000:00010000:1.0:1785774807.807226:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.807230:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807236:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09f9db lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807290:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031000/0x7b7109e1d09f9cd lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c199 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807308:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030400/0x7b7109e1d09f9e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c199 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.807320:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:1.0:1785774807.807323:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774807.807325:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700030400, rc 0) 00000100:00100000:1.0:1785774807.807392:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18400:x1872519648522496:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 11763us (11933us total) trans 4294968524 rc 0/0 00000100:00100000:1.0:1785774807.807400:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23865 00000100:00100000:0.0:1785774807.813948:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671277056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774807.825518:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.825656:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648522624 00000100:00100000:3.0:1785774807.825669:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648522624 00000100:00100000:3.0:1785774807.825740:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5224 00000100:00100000:3.0:1785774807.825752:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648522624:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774807.825777:0:14719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774807.825805:0:14719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1a0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774807.825837:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x6a70c2d4, atime: 0x0, ctime: 0x6a70c2d4, blocks: 0x8 00010000:00010000:3.0:1785774807.825864:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:3.0:1785774807.825870:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774807.825880:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 13 pid: 14719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.825920:0:14719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 13 pid: 14719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.825936:0:14719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:3.0:1785774807.826015:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648522624:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 265us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.826024:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5224 00000100:00100000:3.0:1785774807.840628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.840865:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648522752 00000100:00100000:0.0:1785774807.840878:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648522752 00002000:00100000:0.0:1785774807.840953:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff9b7741b39180 x1872519648522752/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 488/0 e 0 to 0 dl 1785774818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774807.840973:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b39180 with x1872519648522752 ext(0->4095) 00002000:00010000:0.0:1785774807.840980:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7741b39180 00000100:00100000:0.0:1785774807.841020:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:0.0:1785774807.841030:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648522752:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:0.0:1785774807.841292:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648522752:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 263us (679us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1785774807.841300:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00002000:00100000:0.0:1785774807.841307:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff9b7741b39180 x1872519648522752/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:498/0 lens 488/4536 e 0 to 0 dl 1785774818 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774807.841315:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b39180 with x1872519648522752 ext(0->4095) 00002000:00010000:0.0:1785774807.841318:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7741b39180 00010000:00010000:2.0:1785774807.847252:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774807.883115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774807.891901:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648523008 00000100:00100000:1.0:1785774807.891970:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648523008 00000100:00100000:1.0:1785774807.892069:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5116 00000100:00100000:1.0:1785774807.892080:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732244850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:18400:x1872519648523008:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:1.0:1785774807.895549:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732244850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18400:x1872519648523008:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 3455us (12433us total) trans 4294968525 rc 0/0 00000100:00100000:1.0:1785774807.895566:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5116 00000100:00100000:2.0:1785774807.945417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.950103:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648523264 00000100:00100000:0.0:1785774807.950131:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648523264 00000100:00100000:0.0:1785774807.950249:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23866 00000100:00100000:0.0:1785774807.950262:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18402:x1872519648523264:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774807.950290:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774807.950490:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f9f7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950589:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950607:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950625:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950637:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950645:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950652:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950852:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950862:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950869:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950877:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.950884:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.950888:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951465:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951481:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774807.951485:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.951490:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951497:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09f9fe lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951513:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951520:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951526:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951530:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774807.951533:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951539:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951545:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7706383200) 00010000:00010000:0.0:1785774807.951548:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774807.951550:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951556:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa05 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951589:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f9f7 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a7 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951605:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774807.951608:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774807.951611:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09f9f7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a7 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.951621:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774807.952620:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18402:x1872519648523264:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 2357us (7735us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774807.952631:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23866 00000100:00100000:2.0:1785774807.959705:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774807.959801:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648523520 00000100:00100000:0.0:1785774807.959814:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648523520 00000100:00100000:0.0:1785774807.959893:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23867 00000100:00100000:0.0:1785774807.959916:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18402:x1872519648523520:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774807.959949:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774807.959977:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fa0c lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1ae expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.960071:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.960091:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.960104:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.960129:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.960142:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f6d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f6cb expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.960151:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.960220:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f6d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f6cb expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774807.960239:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671277440:0@lo:104: 00000100:00100000:0.0:1785774807.960297:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774807.960353:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774807.961254:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671277440 00000100:00100000:1.0:1785774807.961261:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671277440 00000100:00100000:1.0:1785774807.961323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1785774807.961332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8469:x1872519671277440:12345-0@lo:104: 00010000:00010000:1.0:1785774807.961348:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.961440:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785774807.961446:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8469:x1872519671277440:12345-0@lo:104: Request processed in 117us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774807.961455:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00010000:00010000:2.0:1785774807.961571:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774807.961580:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.961590:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774807.961597:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774807.961607:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.961640:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.961647:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774807.961698:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.961706:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cf800/0x7b7109e1d09f6cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f6d2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774807.961728:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774807.961730:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774807.961732:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774807.961740:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774807.961753:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671277568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774807.961799:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774807.961836:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671277568 00000100:00100000:2.0:1785774807.961841:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671277568 00010000:00010000:2.0:1785774807.961861:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f6d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f6cb expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774807.961887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:2.0:1785774807.961895:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3656:x1872519671277568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774807.961920:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1785774807.962666:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671277440:0@lo:104: 00010000:00010000:0.0:1785774807.962700:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774807.966034:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968525 is committed 00010000:00010000:0.0:1785774807.966219:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d09f6d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f6cb expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.966243:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x84832a57 (ffff9b7702c6a000) 00010000:00010000:0.0:1785774807.966249:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.966260:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.966269:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774807.966312:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774807.966416:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671277568:12345-0@lo:103:ldlm_bl.0 Request processed in 4520us (4614us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774807.966427:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00010000:00010000:1.0:1785774807.966569:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.966578:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.966740:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031000/0x7b7109e1d09fa21 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.966751:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031000/0x7b7109e1d09fa21 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.966761:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031000/0x7b7109e1d09fa21 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774807.966785:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x194:0x0]: returning size 3 00010000:00010000:1.0:1785774807.966899:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967052:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967059:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967066:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967073:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.967078:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967087:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967098:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774807.967101:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.967105:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967112:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fa13 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967134:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967141:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967147:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967152:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774807.967154:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967195:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967203:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x84832a57 (ffff9b7702c6a000) 00010000:00010000:1.0:1785774807.967205:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774807.967208:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967215:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fa1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967275:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fa0c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ae expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967291:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031000/0x7b7109e1d09fa21 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ae expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774807.967300:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:1.0:1785774807.967302:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774807.967304:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700031000, rc 0) 00000100:00100000:2.0:1785774807.967497:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671277568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774807.967585:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18402:x1872519648523520:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 7682us (7905us total) trans 4294968526 rc 0/0 00000100:00100000:1.0:1785774807.967594:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23867 00000100:00100000:2.0:1785774807.995530:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774807.995676:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648523648 00000100:00100000:3.0:1785774807.995689:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648523648 00000100:00100000:3.0:1785774807.995762:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5225 00000100:00100000:3.0:1785774807.995783:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648523648:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774807.995808:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774807.995835:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1b5 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774807.995867:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cd:0x0] initial LVB size: 3, mtime: 0x6a70c2d4, atime: 0x0, ctime: 0x6a70c2d4, blocks: 0x8 00010000:00010000:3.0:1785774807.995912:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:3.0:1785774807.995918:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774807.995929:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 14 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.995950:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 14 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774807.995966:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774807.996043:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648523648:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 263us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774807.996050:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5225 00000100:00100000:2.0:1785774808.003590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.003724:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648523776 00000100:00100000:1.0:1785774808.003737:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648523776 00002000:00100000:1.0:1785774808.003810:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->4095) req@ffff9b7735944e00 x1872519648523776/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1785774819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774808.003824:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735944e00 with x1872519648523776 ext(0->4095) 00002000:00010000:1.0:1785774808.003831:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7735944e00 00000100:00100000:1.0:1785774808.003869:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:1.0:1785774808.003880:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648523776:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:1.0:1785774808.004124:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648523776:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 236us (536us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1785774808.004134:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00002000:00100000:1.0:1785774808.004142:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->4095) req@ffff9b7735944e00 x1872519648523776/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1785774819 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774808.004182:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735944e00 with x1872519648523776 ext(0->4095) 00002000:00010000:1.0:1785774808.004187:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7735944e00 00000100:00100000:0.0:1785774808.033210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.033349:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648524032 00000100:00100000:3.0:1785774808.033363:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648524032 00000100:00100000:3.0:1785774808.033453:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5117 00000100:00100000:3.0:1785774808.033466:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:18402:x1872519648524032:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:3.0:1785774808.033853:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18402:x1872519648524032:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 389us (690us total) trans 4294968527 rc 0/0 00000100:00100000:3.0:1785774808.033862:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5117 00000100:00080000:1.0:1785774808.034553:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774808.074820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.076214:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648524288 00000100:00100000:1.0:1785774808.076230:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648524288 00000100:00100000:1.0:1785774808.076396:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23868 00000100:00100000:1.0:1785774808.076409:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18404:x1872519648524288:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774808.076438:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.076467:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09fa36 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1bc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076562:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076580:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076592:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076606:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076613:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076620:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076672:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076681:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076687:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076694:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076700:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.076705:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076713:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076726:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774808.076729:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.076735:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076742:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa3d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076758:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076763:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076770:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076775:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.076778:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076784:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076791:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7706383700) 00010000:00010000:1.0:1785774808.076793:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.076796:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076802:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa44 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076838:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09fa36 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1bc expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076851:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774808.076853:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774808.076857:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d09fa36 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1bc expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.076868:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700030a00, rc 0) 00000100:00100000:1.0:1785774808.076955:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18404:x1872519648524288:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 548us (2149us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774808.076967:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23868 00000100:00080000:3.0:1785774808.078185:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774808.083687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.083780:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648524544 00000100:00100000:0.0:1785774808.083792:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648524544 00000100:00100000:0.0:1785774808.083860:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23869 00000100:00100000:0.0:1785774808.083872:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18404:x1872519648524544:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774808.083903:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.083930:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fa4b lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1c3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084029:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084047:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084060:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084073:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084083:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f662 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084092:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084144:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f662 expref: 7 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.084191:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671277696:0@lo:104: 00000100:00100000:0.0:1785774808.084250:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.084311:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.084475:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671277696 00000100:00100000:3.0:1785774808.084480:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671277696 00000100:00100000:3.0:1785774808.084518:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1785774808.084526:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6531:x1872519671277696:12345-0@lo:104: 00010000:00010000:3.0:1785774808.084540:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.084600:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774808.084606:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6531:x1872519671277696:12345-0@lo:104: Request processed in 81us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.084612:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00010000:00010000:0.0:1785774808.084731:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774808.084739:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084748:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774808.084754:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774808.084773:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084803:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084810:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1785774808.084855:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1785774808.084909:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084918:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057cec00/0x7b7109e1d09f662 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f669 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.084938:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.084941:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.084943:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774808.084973:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6531:1872519671277696:0@lo:104: 00010000:00010000:0.0:1785774808.085005:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.085414:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671277824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.085455:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.086332:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671277824 00000100:00100000:2.0:1785774808.086341:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671277824 00010000:00010000:2.0:1785774808.086378:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f662 expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.086420:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:2.0:1785774808.086428:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3655:x1872519671277824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774808.086444:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1785774808.087967:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968527 is committed 00010000:00010000:2.0:1785774808.088184:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09f669 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f662 expref: 8 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.088211:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x391d5834 (ffff9b77199f5400) 00010000:00010000:2.0:1785774808.088217:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.088228:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.088237:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.088270:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774808.088349:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3655:x1872519671277824:12345-0@lo:103:ldlm_bl.0 Request processed in 1921us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.088359:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:1.0:1785774808.088463:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671277824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.088529:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088539:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088672:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09fa60 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088683:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09fa60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088692:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09fa60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774808.088706:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 2 00010000:00010000:0.0:1785774808.088825:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088835:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088842:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088850:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088859:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.088865:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088873:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088883:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:0.0:1785774808.088886:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.088890:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088897:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa52 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088908:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088914:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088920:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088925:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.088928:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088935:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088947:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x391d5834 (ffff9b77199f5400) 00010000:00010000:0.0:1785774808.088950:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.088953:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.088959:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.089087:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fa4b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1c3 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.089105:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09fa60 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1c3 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.089112:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9b7702bc0f00) 00010000:00010000:0.0:1785774808.089126:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774808.089128:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3e00, rc 0) 00000100:00100000:0.0:1785774808.089358:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18404:x1872519648524544:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 5486us (5682us total) trans 4294968528 rc 0/0 00000100:00100000:0.0:1785774808.089367:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23869 00000100:00100000:0.0:1785774808.096940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774808.097028:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648524672 00000100:00100000:2.0:1785774808.097041:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648524672 00000100:00100000:2.0:1785774808.097121:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5226 00000100:00100000:2.0:1785774808.097133:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648524672:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:2.0:1785774808.097156:0:14729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774808.097214:0:14729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1ca expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774808.097246:0:14729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x6a70c2d4, atime: 0x0, ctime: 0x6a70c2d4, blocks: 0x8 00010000:00010000:2.0:1785774808.097272:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=1049s v=(0 0) 00010000:00010000:2.0:1785774808.097278:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774808.097289:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 15 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.097310:0:14729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 15 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.097324:0:14729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ae00, rc 0) 00000100:00100000:2.0:1785774808.097391:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648524672:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 259us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.097399:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5226 00000100:00100000:2.0:1785774808.103442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.103776:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648524800 00000100:00100000:0.0:1785774808.103790:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648524800 00000100:00100000:0.0:1785774808.103864:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3918 00000100:00100000:0.0:1785774808.103875:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648524800:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:0.0:1785774808.103928:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.103955:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fa75 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1d1 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104043:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104061:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104075:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104086:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104093:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104100:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104200:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104210:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104217:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104224:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.104229:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104242:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104257:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774808.104260:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.104265:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104272:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fa7c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104286:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104293:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104300:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104305:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.104308:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104314:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104321:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b77199f5b00) 00010000:00010000:0.0:1785774808.104324:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.104327:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104337:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fa83 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104366:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fa75 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1d1 expref: 31 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104378:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774808.104380:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774808.104383:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fa75 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1d1 expref: 31 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.104394:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2600, rc -2) 00000100:00100000:0.0:1785774808.104650:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648524800:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 775us (1221us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774808.104659:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3918 00000100:00100000:1.0:1785774808.142125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.142313:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648524928 00000100:00100000:3.0:1785774808.142327:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648524928 00002000:00100000:3.0:1785774808.142389:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff9b7735aa9880 x1872519648524928/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1785774819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774808.142403:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735aa9880 with x1872519648524928 ext(0->4095) 00002000:00010000:3.0:1785774808.142411:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7735aa9880 00000100:00100000:3.0:1785774808.142451:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:3.0:1785774808.142462:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2419:x1872519648524928:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:3.0:1785774808.142712:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2419:x1872519648524928:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 251us (611us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785774808.142722:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00002000:00100000:3.0:1785774808.142730:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff9b7735aa9880 x1872519648524928/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1785774819 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774808.142738:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735aa9880 with x1872519648524928 ext(0->4095) 00002000:00010000:3.0:1785774808.142742:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7735aa9880 00000100:00100000:2.0:1785774808.149455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.149573:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648525184 00000100:00100000:1.0:1785774808.149588:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648525184 00000100:00100000:1.0:1785774808.149658:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5118 00000100:00100000:1.0:1785774808.149670:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:18404:x1872519648525184:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:1.0:1785774808.150059:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18404:x1872519648525184:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 390us (617us total) trans 4294968529 rc 0/0 00000100:00100000:1.0:1785774808.150068:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5118 00000100:00100000:2.0:1785774808.184600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.184709:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648525440 00000100:00100000:1.0:1785774808.184722:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648525440 00000100:00100000:1.0:1785774808.184806:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23870 00000100:00100000:1.0:1785774808.184818:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18408:x1872519648525440:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774808.184846:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.184872:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa8a lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1ed expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.184975:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185004:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185025:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185038:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185046:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185053:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185104:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185123:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185130:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185138:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185144:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.185150:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185205:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185221:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774808.185225:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.185230:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185237:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d09fa91 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185253:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185259:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185264:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185270:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.185273:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185279:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185287:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b77199f5b00) 00010000:00010000:1.0:1785774808.185289:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.185292:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185298:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d09fa98 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185336:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa8a lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ed expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185353:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774808.185355:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774808.185359:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d09fa8a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ed expref: 31 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.185369:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700031400, rc 0) 00000100:00100000:1.0:1785774808.185445:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18408:x1872519648525440:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 629us (859us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774808.185453:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23870 00000100:00100000:2.0:1785774808.193566:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.193660:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648525696 00000100:00100000:3.0:1785774808.193673:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648525696 00000100:00100000:3.0:1785774808.193784:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23871 00000100:00100000:3.0:1785774808.193797:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18408:x1872519648525696:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774808.193828:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.193854:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fa9f lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.193948:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.193966:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.193982:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.194009:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.194020:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f80d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f806 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.194033:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.194073:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f80d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f806 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774808.194091:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671277952:0@lo:104: 00000100:00100000:3.0:1785774808.194865:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.194942:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.195214:0:6512:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1785774808.195231:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671277952 00000100:00100000:0.0:1785774808.195236:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671277952 00000100:00100000:0.0:1785774808.195282:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1785774808.195290:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760301ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6529:x1872519671277952:12345-0@lo:104: 00010000:00010000:0.0:1785774808.195307:0:6512:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.195395:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785774808.195400:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760301ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6529:x1872519671277952:12345-0@lo:104: Request processed in 112us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.195408:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1785774808.195595:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671277952:0@lo:104: 00010000:00010000:1.0:1785774808.195620:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.196422:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774808.196430:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.196442:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774808.196448:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.196459:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.196497:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.196504:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774808.196540:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.196548:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b7605ec1e00/0x7b7109e1d09f806 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f80d expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.196570:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.196572:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.196574:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.196631:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774808.196646:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671278080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.196692:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.196781:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671278080 00000100:00100000:3.0:1785774808.196787:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671278080 00010000:00010000:3.0:1785774808.196810:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f80d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f806 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774808.196849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1785774808.196857:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3654:x1872519671278080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774808.196869:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1785774808.199427:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968529 is committed 00010000:00010000:0.0:1785774808.199566:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3600/0x7b7109e1d09f80d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f806 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.199587:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x18618557 (ffff9b7706383d00) 00010000:00010000:0.0:1785774808.199593:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.199604:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.199613:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.199648:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774808.199731:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1872519671278080:12345-0@lo:103:ldlm_bl.0 Request processed in 2874us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.199743:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00010000:00010000:1.0:1785774808.199829:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.199838:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200000:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031400/0x7b7109e1d09fab4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200012:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031400/0x7b7109e1d09fab4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200025:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031400/0x7b7109e1d09fab4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774808.200038:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x197:0x0]: returning size 2 00010000:00010000:1.0:1785774808.200303:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200311:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200317:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200323:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200330:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.200335:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200344:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200355:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774808.200358:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.200363:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200369:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09faa6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200387:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200394:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200400:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200406:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.200409:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200415:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200422:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x18618557 (ffff9b7706383d00) 00010000:00010000:1.0:1785774808.200424:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.200427:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200433:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09faad lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200489:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fa9f lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1f4 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200505:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031400/0x7b7109e1d09fab4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1f4 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.200513:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:1.0:1785774808.200516:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774808.200519:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700031400, rc 0) 00000100:00100000:3.0:1785774808.200693:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671278080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.200744:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18408:x1872519648525696:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 6949us (7190us total) trans 4294968530 rc 0/0 00000100:00100000:1.0:1785774808.200752:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23871 00000100:00100000:0.0:1785774808.221297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.223155:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648525824 00000100:00100000:3.0:1785774808.223194:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648525824 00000100:00100000:3.0:1785774808.223263:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5227 00000100:00100000:3.0:1785774808.223274:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648525824:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:3.0:1785774808.223298:0:14722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.223334:0:14722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c1fb expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774808.223369:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x6a70c2d4, atime: 0x0, ctime: 0x6a70c2d4, blocks: 0x8 00010000:00010000:3.0:1785774808.223397:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:3.0:1785774808.223403:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774808.223414:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 15 pid: 14722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.223440:0:14722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 15 pid: 14722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.223458:0:14722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:3.0:1785774808.223543:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648525824:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 271us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.223552:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5227 00000100:00100000:1.0:1785774808.230731:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671278208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774808.230840:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.231000:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671278208 00000100:00100000:0.0:1785774808.231011:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671278208 00000100:00100000:0.0:1785774808.231078:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:0.0:1785774808.231090:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671278208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785774808.231148:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444052992 avail 1297813504 00000100:00100000:0.0:1785774808.231224:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671278208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.231232:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1785774808.231305:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671278208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774808.243764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.243881:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648525952 00000100:00100000:0.0:1785774808.243912:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648525952 00002000:00100000:0.0:1785774808.243979:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff9b7735944700 x1872519648525952/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1785774819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774808.243997:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735944700 with x1872519648525952 ext(0->4095) 00002000:00010000:0.0:1785774808.244005:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7735944700 00000100:00100000:0.0:1785774808.244042:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:0.0:1785774808.244052:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2418:x1872519648525952:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:0.0:1785774808.244593:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2418:x1872519648525952:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 540us (845us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1785774808.244603:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 12 00002000:00100000:0.0:1785774808.244610:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff9b7735944700 x1872519648525952/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1785774819 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774808.244619:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735944700 with x1872519648525952 ext(0->4095) 00002000:00010000:0.0:1785774808.244622:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7735944700 00000100:00100000:1.0:1785774808.253097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.262950:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648526208 00000100:00100000:0.0:1785774808.262970:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648526208 00000100:00100000:0.0:1785774808.263065:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5119 00000100:00100000:0.0:1785774808.263078:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:18408:x1872519648526208:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:0.0:1785774808.263525:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18408:x1872519648526208:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 449us (10442us total) trans 4294968531 rc 0/0 00000100:00100000:0.0:1785774808.263535:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5119 00000100:00100000:2.0:1785774808.277607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.277726:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648526464 00000100:00100000:0.0:1785774808.277740:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648526464 00000100:00100000:0.0:1785774808.277827:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23872 00000100:00100000:0.0:1785774808.277841:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18411:x1872519648526464:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:0.0:1785774808.277871:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.277915:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fac9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c202 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278019:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278038:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278051:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278065:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278073:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278079:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278141:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278149:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278157:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278206:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278213:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.278219:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278227:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278241:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774808.278245:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.278250:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278258:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fad0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278272:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278279:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278285:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278291:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.278294:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278301:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278308:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7702c6a900) 00010000:00010000:0.0:1785774808.278311:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.278314:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278320:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09fad7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278354:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fac9 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c202 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278367:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774808.278369:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774808.278373:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fac9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c202 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.278384:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3600, rc 0) 00000100:00100000:0.0:1785774808.278455:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18411:x1872519648526464:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 618us (863us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774808.278464:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23872 00000100:00100000:2.0:1785774808.299265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.299398:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648526720 00000100:00100000:1.0:1785774808.299413:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648526720 00000100:00100000:1.0:1785774808.299493:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23873 00000100:00100000:1.0:1785774808.299505:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18411:x1872519648526720:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774808.299539:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.299567:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09fade lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c209 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.299671:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.299691:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.299706:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.299720:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.299731:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f7a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09f79d expref: 5 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.299740:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.299787:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f7a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d09f79d expref: 5 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.299808:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671278336:0@lo:104: 00000100:00100000:1.0:1785774808.299873:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.299949:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.300362:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671278336 00000100:00100000:0.0:1785774808.300368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671278336 00000100:00100000:0.0:1785774808.300412:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1785774808.300420:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671278336:12345-0@lo:104: 00010000:00010000:0.0:1785774808.300435:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.300503:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785774808.300510:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6530:x1872519671278336:12345-0@lo:104: Request processed in 91us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.300517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00010000:00010000:2.0:1785774808.300689:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774808.300697:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.300707:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774808.300713:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774808.300723:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.300753:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.300760:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774808.300794:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.300803:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9b76057ce600/0x7b7109e1d09f79d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d09f7a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.300825:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774808.300828:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774808.300830:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.300878:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671278464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.300935:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.301154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671278464 00000100:00100000:2.0:1785774808.301196:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671278464 00010000:00010000:2.0:1785774808.301220:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f7a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d09f79d expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.301249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:2.0:1785774808.301256:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671278464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774808.301267:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1785774808.302078:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671278336:0@lo:104: 00010000:00010000:1.0:1785774808.302103:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774808.304203:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968531 is committed 00010000:00010000:2.0:1785774808.304449:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3400/0x7b7109e1d09f7a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d09f79d expref: 6 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.304472:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xb62e0cbf (ffff9b7706383600) 00010000:00010000:2.0:1785774808.304478:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.304489:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.304499:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.304582:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774808.304679:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671278464:12345-0@lo:103:ldlm_bl.0 Request processed in 3422us (3741us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.304690:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:3.0:1785774808.310961:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671278464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.316484:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.316507:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.316686:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09faf3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.316703:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09faf3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.316717:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09faf3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774808.316731:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x196:0x0]: returning size 2 00010000:00010000:1.0:1785774808.319326:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.319347:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320251:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320264:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320270:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.320276:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320285:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320306:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774808.320310:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.320315:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320323:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031800/0x7b7109e1d09fae5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320347:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320527:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320537:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320544:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774808.320548:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320554:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320564:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xb62e0cbf (ffff9b7706383600) 00010000:00010000:1.0:1785774808.320567:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.320570:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320577:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030a00/0x7b7109e1d09faec lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320652:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030600/0x7b7109e1d09fade lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c209 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320671:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09faf3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c209 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.320680:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:1.0:1785774808.320683:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774808.320685:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cec00, rc 0) 00000100:00100000:1.0:1785774808.322806:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18411:x1872519648526720:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 23290us (23541us total) trans 4294968532 rc 0/0 00000100:00100000:1.0:1785774808.322820:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23873 00000100:00100000:2.0:1785774808.348617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.348751:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648526848 00000100:00100000:1.0:1785774808.348775:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648526848 00000100:00100000:1.0:1785774808.348859:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5228 00000100:00100000:1.0:1785774808.348873:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2418:x1872519648526848:12345-192.168.202.31@tcp:101:cmp.0 00010000:00010000:1.0:1785774808.348915:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.348950:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c210 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774808.348986:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 2, mtime: 0x6a70c2d4, atime: 0x0, ctime: 0x6a70c2d4, blocks: 0x8 00010000:00010000:1.0:1785774808.349017:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:1.0:1785774808.349023:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774808.349035:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 16 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.349061:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 16 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.349078:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cee00, rc 0) 00000100:00100000:1.0:1785774808.349186:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2418:x1872519648526848:12345-192.168.202.31@tcp:101:cmp.0 Request processed in 289us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.349195:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5228 00000100:00100000:2.0:1785774808.358060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.360345:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648526976 00000100:00100000:1.0:1785774808.360365:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648526976 00002000:00100000:1.0:1785774808.360437:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff9b76037f6680 x1872519648526976/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/0 e 0 to 0 dl 1785774819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774808.360450:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f6680 with x1872519648526976 ext(0->4095) 00002000:00010000:1.0:1785774808.360459:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f6680 00000100:00100000:1.0:1785774808.360507:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:1.0:1785774808.360519:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648526976:12345-192.168.202.31@tcp:3:cmp.0 00000100:00100000:1.0:1785774808.360736:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648526976:12345-192.168.202.31@tcp:3:cmp.0 Request processed in 219us (2690us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1785774808.360746:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 13 00002000:00100000:1.0:1785774808.360752:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff9b76037f6680 x1872519648526976/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:499/0 lens 488/4536 e 0 to 0 dl 1785774819 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774808.360762:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f6680 with x1872519648526976 ext(0->4095) 00002000:00010000:1.0:1785774808.360766:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f6680 00000100:00100000:0.0:1785774808.377499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.377702:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648527232 00000100:00100000:3.0:1785774808.377716:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648527232 00000100:00100000:3.0:1785774808.377803:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5120 00000100:00100000:3.0:1785774808.377817:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18411:x1872519648527232:12345-192.168.202.31@tcp:35:cmp.0 00000100:00100000:2.0:1785774808.384086:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18411:x1872519648527232:12345-192.168.202.31@tcp:35:cmp.0 Request processed in 6257us (6586us total) trans 4294968533 rc 0/0 00000100:00100000:2.0:1785774808.384105:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5120 00000100:00100000:2.0:1785774808.430785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.431047:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648527360 00000100:00100000:3.0:1785774808.431062:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648527360 00000100:00100000:3.0:1785774808.431259:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3920 00000100:00100000:3.0:1785774808.431271:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2419:x1872519648527360:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:3.0:1785774808.431320:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.431348:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c217 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431433:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431451:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431464:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431480:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431487:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431493:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431563:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431570:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431577:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431583:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774808.431588:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431596:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431609:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774808.431613:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.431617:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431623:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431645:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431651:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431657:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431662:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774808.431664:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431670:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431677:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x861f4748 (ffff9b77199f5800) 00010000:00010000:3.0:1785774808.431680:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.431683:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431689:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431725:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c217 expref: 31 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431741:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774808.431743:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774808.431747:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c217 expref: 31 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.431757:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc -2) 00000100:00100000:3.0:1785774808.431847:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2419:x1872519648527360:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 578us (1076us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774808.431855:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3920 00000100:00100000:0.0:1785774808.454975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.459023:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648527488 00000100:00100000:1.0:1785774808.459044:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648527488 00000100:00100000:1.0:1785774808.459266:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23874 00000100:00100000:1.0:1785774808.459280:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18412:x1872519648527488:12345-192.168.202.31@tcp:41:rm.0 00000004:00000024:1.0:1785774808.459367:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7846993920 avail 7383777280 00000100:00100000:1.0:1785774808.459473:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:18412:x1872519648527488:12345-192.168.202.31@tcp:41:rm.0 Request processed in 195us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.459482:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23874 00000100:00100000:2.0:1785774808.476955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.477103:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648527744 00000100:00100000:1.0:1785774808.477121:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648527744 00000100:00100000:1.0:1785774808.477208:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23875 00000100:00100000:1.0:1785774808.477220:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18412:x1872519648527744:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774808.477283:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.477310:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09fa60 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1c3 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.477335:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9b7702bc0f00) 00010000:00010000:1.0:1785774808.477346:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774808.477393:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.477402:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.477413:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.477434:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671278592:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1785774808.477482:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.479790:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.481213:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671278592 00000100:00100000:3.0:1785774808.481225:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671278592 00000100:00100000:3.0:1785774808.481287:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:3.0:1785774808.481296:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671278592:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774808.481317:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.481339:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fb1d expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.481371:0:20645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.481381:0:20645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 4/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fb1d expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.481414:0:20645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 29 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.481432:0:20645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 29 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774808.481444:0:20645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20645:1872519671278720:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774808.481529:0:20645:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.492470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.494710:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648527872 00000100:00100000:1.0:1785774808.494722:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648527872 00010000:00010000:1.0:1785774808.494792:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 30 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.494837:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1665 00000100:00100000:1.0:1785774808.494849:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648527872:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.494866:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.494873:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 30 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.494887:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 30 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.494916:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774808.494922:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fb1d expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.494934:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09fb1d expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.494942:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7b7109e1d09fb1d expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.494976:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb1d expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.494989:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671278848:0@lo:105: 00000100:00100000:1.0:1785774808.495042:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.495084:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.495332:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671278848 00000100:00100000:0.0:1785774808.495337:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671278848 00000100:00100000:0.0:1785774808.495375:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1785774808.495383:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671278848:12345-0@lo:105: 00010000:00010000:0.0:1785774808.495395:0:16514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.495404:0:16514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.495413:0:16514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.495422:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.495430:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.495438:0:16514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.495452:0:16514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b76057cf800) 00000100:00100000:0.0:1785774808.495498:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671278848:12345-0@lo:105: Request processed in 117us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.495506:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1785774808.495583:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671278848:0@lo:105: 00010000:00010000:2.0:1785774808.495610:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774808.495657:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:2416:x1872519648527872:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 809us (3194us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.495665:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1665 00010000:00010000:3.0:1785774808.495951:0:20645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09f8df lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c145 expref: 29 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774808.496031:0:20645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20645:1872519671278720:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774808.496062:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb1d expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.496073:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:3.0:1785774808.496077:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.496080:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774808.496218:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:8469:x1872519671278592:12345-0@lo:101:mdt00_003.0 Request processed in 14923us (18735us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.496227:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:0.0:1785774808.496348:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671278592:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774808.496368:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774808.496392:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:0.0:1785774808.496441:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.496450:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.496460:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.496476:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671278976:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1785774808.496510:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.496542:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.496785:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671278976 00000100:00100000:3.0:1785774808.496792:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671278976 00000100:00100000:3.0:1785774808.496833:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:3.0:1785774808.496840:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:8469:x1872519671278976:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1785774808.496858:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.496874:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fb2b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.496903:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.496913:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.496928:0:6535:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1785774808.496966:0:6535:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1785774808.497020:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.497029:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7706383700) 00010000:00010000:3.0:1785774808.497032:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.497036:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.497043:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:3.0:1785774808.497080:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:8469:x1872519671278976:12345-0@lo:101:mdt00_003.0 Request processed in 240us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.497086:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:0.0:1785774808.497198:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671278976:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774808.497208:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.497217:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774808.505942:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983624 is committed 00000001:00080000:1.0:1785774808.505985:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983622 is committed 00010000:00010000:0.0:1785774808.506133:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506147:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506198:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506206:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.506211:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506220:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506241:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7706383700) 00010000:00010000:0.0:1785774808.506245:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.506253:0:3639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506267:0:3639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506277:0:3639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.506342:0:3639:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.506363:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3639:1872519671279104:0@lo:105: 00000100:00100000:0.0:1785774808.506449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.506508:0:3639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.506670:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671279104 00000100:00100000:3.0:1785774808.506681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671279104 00000100:00100000:3.0:1785774808.506766:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1785774808.506779:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3639:x1872519671279104:12345-0@lo:105: 00010000:00010000:3.0:1785774808.506793:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.506806:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.506815:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.506822:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.506829:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.506837:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.506869:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7605ec2800) 00000100:00100000:3.0:1785774808.506935:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3639:x1872519671279104:12345-0@lo:105: Request processed in 159us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.506944:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00010000:00010000:1.0:1785774808.507055:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.507068:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774808.507099:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00000100:00100000:1.0:1785774808.507184:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671279232:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774808.507225:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.507251:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3540 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.507428:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3639:1872519671279104:0@lo:105: 00010000:00010000:2.0:1785774808.507447:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507455:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09f677 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507474:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507480:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507485:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507490:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507493:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507504:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507514:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9b7602507d00) 00010000:00010000:2.0:1785774808.507517:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1785774808.507520:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507525:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09f67e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507547:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507553:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507558:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507564:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507567:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507573:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507582:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7706383200) 00010000:00010000:2.0:1785774808.507584:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.507587:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507594:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09f6e0 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507608:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507614:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507619:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507624:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507626:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507631:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507638:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:2.0:1785774808.507640:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1785774808.507643:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507648:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d09f6e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507661:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507667:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507674:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507679:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507682:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507688:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507696:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b77199f5600) 00010000:00010000:2.0:1785774808.507698:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.507701:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507706:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09f749 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507726:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507733:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507738:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507743:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507746:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507755:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507778:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:2.0:1785774808.507781:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1785774808.507784:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507790:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09f750 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507806:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507813:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507819:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507825:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507828:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507835:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507844:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7702c6a900) 00010000:00010000:2.0:1785774808.507846:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.507849:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507856:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09f7b2 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507869:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507875:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507882:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507887:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507889:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507895:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507901:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9b7709388300) 00010000:00010000:2.0:1785774808.507903:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1785774808.507906:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507912:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d09f7b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507927:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507934:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507941:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507947:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.507950:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507956:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507964:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b77199f5b00) 00010000:00010000:2.0:1785774808.507966:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.507969:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507976:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09f81b lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507988:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507993:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.507999:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508004:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.508007:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508016:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508021:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9b7602507300) 00010000:00010000:2.0:1785774808.508023:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1785774808.508026:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508031:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09f822 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508043:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508048:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508054:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508059:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.508061:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508066:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508072:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7605dfe800) 00010000:00010000:2.0:1785774808.508074:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.508076:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508083:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09f884 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508095:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508100:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508106:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508120:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35aa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.508123:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508129:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508136:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774808.508139:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1785774808.508141:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.508147:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09f88b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774808.508964:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671279232 00000100:00100000:3.0:1785774808.508974:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671279232 00000100:00100000:3.0:1785774808.509031:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1785774808.509040:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671279232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774808.509195:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671279232:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.509204:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:2.0:1785774808.509447:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983624 gen 2 00000004:00080000:2.0:1785774808.509454:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983623 committed transno 4294983624 00000004:00080000:2.0:1785774808.509472:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983624 committed transno 4294983624 00000100:00100000:2.0:1785774808.509485:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671279232:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774808.509551:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671279360:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774808.509587:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.509615:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.509662:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671279360 00000100:00100000:3.0:1785774808.509667:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671279360 00000100:00100000:3.0:1785774808.509699:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1785774808.509705:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671279360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774808.509897:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671279360:12345-0@lo:1000:mdt00_003.0 Request processed in 191us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.509905:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1785774808.509972:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671279360:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774808.510020:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671279488:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785774808.510045:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.510066:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.510513:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671279488 00000100:00100000:2.0:1785774808.510518:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671279488 00000100:00100000:2.0:1785774808.510553:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:2.0:1785774808.510560:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671279488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774808.510640:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671279488:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (594us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774808.510647:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1785774808.510737:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671279488:0@lo:1000:mdt00_003.0 00000004:00080000:0.0:1785774808.510775:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:0.0:1785774808.510786:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.510797:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.510806:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.510828:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774808.510833:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:0.0:1785774808.510837:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.510845:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.510851:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.510869:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1785774808.510946:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18412:x1872519648527744:12345-192.168.202.31@tcp:36:rm.0 Request processed in 33726us (33998us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774808.510953:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23875 00010000:00010000:1.0:1785774808.511286:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774808.511294:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511304:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774808.511319:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774808.511328:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511359:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511365:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774808.511387:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511395:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf800/0x7b7109e1d09fb1d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511413:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774808.511418:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511424:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774808.511428:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774808.511435:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511448:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511455:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774808.511469:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511476:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2800/0x7b7109e1d09fb2b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb32 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.511488:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774808.511490:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774808.511492:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.511499:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774808.511509:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671279744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.511545:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.511699:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671279616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774808.511726:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.511846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671279744 00000100:00100000:0.0:1785774808.511853:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671279744 00000100:00100000:0.0:1785774808.511885:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671279616 00000100:00100000:0.0:1785774808.511887:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671279616 00000100:00100000:0.0:1785774808.511909:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1785774808.511916:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7707d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+16:3654:x1872519671279744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.511930:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774808.511952:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fb32 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fb2b expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.511975:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x391d5834 (ffff9b7706383700) 00010000:00010000:0.0:1785774808.511986:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774808.512017:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7707d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671279744:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.512024:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1785774808.512068:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1785774808.512075:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3656:x1872519671279616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.512082:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774808.512093:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb24 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fb1d expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.512104:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfe100) 00010000:00010000:0.0:1785774808.512122:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774808.512146:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671279616:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.512152:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1785774808.512207:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671279616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774808.512227:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671279744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774808.512410:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774808.521581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.521860:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648528128 00000100:00100000:1.0:1785774808.521873:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648528128 00000100:00100000:1.0:1785774808.521954:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23876 00000100:00100000:1.0:1785774808.521968:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18412:x1872519648528128:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774808.522045:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.522081:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf200/0x7b7109e1d09f8d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c13e expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.522107:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702c6a400) 00010000:00010000:1.0:1785774808.522131:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774808.527228:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527260:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527279:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527320:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527328:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527336:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527436:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527444:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527451:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774808.527810:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1785774808.527824:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1050378662442ns, next at 1051378658969ns, rc = 0 00010000:00010000:2.0:1785774808.527884:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527895:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527904:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527911:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527918:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527925:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527959:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774808.527986:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.527994:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528000:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528007:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.528012:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528020:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528033:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9b7605dfe800) 00010000:00010000:2.0:1785774808.528036:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774808.528042:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528048:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a600/0x7b7109e1d09fb47 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528070:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528075:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528081:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528086:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528092:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.528095:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528100:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528106:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605fcc600) 00010000:00010000:2.0:1785774808.528108:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.528121:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528127:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d09fb39 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774808.528143:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011e7eaaf reply state 0000000022ce7d4a transno 4294968534 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528155:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.528189:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x391d5834 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774808.528192:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774808.528195:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774808.528298:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18412:x1872519648528128:12345-192.168.202.31@tcp:36:rm.0 Request processed in 6328us (6724us total) trans 4294968534 rc 0/0 00000100:00100000:2.0:1785774808.528307:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23876 00010000:00010000:3.0:1785774808.528464:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774808.528473:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.528480:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774808.528484:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.528490:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.528500:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9b7605dfe800) 00010000:00010000:3.0:1785774808.528503:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774808.528506:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 1/0,0 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.528512:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a400/0x7b7109e1d09fb4e lrc: 0/0,0 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.528526:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.528528:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.528530:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774808.541302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.541501:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648528384 00000100:00100000:1.0:1785774808.541514:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648528384 00000100:00100000:1.0:1785774808.541588:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23877 00000100:00100000:1.0:1785774808.541599:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18412:x1872519648528384:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774808.541674:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.541707:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09f9a3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c184 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.541740:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9b7702bc0c00) 00010000:00010000:1.0:1785774808.541754:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774808.541824:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.541833:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.541845:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.541870:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671279872:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1785774808.541931:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.541968:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.542123:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671279872 00000100:00100000:3.0:1785774808.542129:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671279872 00000100:00100000:3.0:1785774808.542208:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1785774808.542217:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6529:x1872519671279872:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1785774808.542228:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.542245:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb5c lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fb55 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.542272:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb5c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fb55 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.542287:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb5c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb55 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.542296:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:3.0:1785774808.542299:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.542302:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:3.0:1785774808.542352:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671279872:12345-0@lo:101:mdt00_000.0 Request processed in 137us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.542359:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:1.0:1785774808.542655:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671279872:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774808.542673:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.542685:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774808.542707:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:1.0:1785774808.542729:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.542736:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.542745:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.542756:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671280000:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1785774808.542840:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.542858:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.542874:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280000 00000100:00100000:1.0:1785774808.542878:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280000 00000100:00100000:1.0:1785774808.542905:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:1.0:1785774808.542912:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671280000:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774808.542921:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.542935:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09fb6a lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fb63 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.542950:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09fb6a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fb63 expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.542962:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09fb6a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb63 expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.542970:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7605fcc500) 00010000:00010000:1.0:1785774808.542972:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.543098:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:1.0:1785774808.543217:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671280000:12345-0@lo:101:mdt00_000.0 Request processed in 305us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.543224:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:2.0:1785774808.543866:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671280000:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774808.543884:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.543896:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774808.543915:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00000100:00100000:2.0:1785774808.543963:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671280128:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774808.544011:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.544080:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.544383:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280128 00000100:00100000:3.0:1785774808.544390:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280128 00000100:00100000:3.0:1785774808.544465:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:3.0:1785774808.544476:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671280128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774808.544569:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671280128:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.544577:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1785774808.544636:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671280128:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774808.544681:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671280256:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774808.544705:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.554657:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.554950:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280256 00000100:00100000:1.0:1785774808.554963:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280256 00000100:00100000:3.0:1785774808.556333:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1785774808.556348:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671280256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774808.556539:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671280256:12345-0@lo:1000:mdt00_000.0 Request processed in 194us (11831us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774808.556548:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1785774808.556596:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671280256:0@lo:1000:mdt00_000.0 00000004:00080000:3.0:1785774808.556641:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:3.0:1785774808.556651:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.556664:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.556672:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.556693:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774808.556699:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:3.0:1785774808.556708:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774808.556714:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.556722:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774808.556728:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.556737:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.557461:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.557474:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774808.557500:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.557510:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cf200/0x7b7109e1d09fb55 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.557533:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.557535:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.557537:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.557553:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671280384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.557601:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.557651:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280384 00000100:00100000:3.0:1785774808.557657:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280384 00000100:00100000:3.0:1785774808.557693:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1785774808.557700:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671280384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774808.557715:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774808.557737:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fb5c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fb55 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.559864:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:3.0:1785774808.559895:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774808.560038:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3654:x1872519671280384:12345-0@lo:103:ldlm_bl.0 Request processed in 2276us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.560050:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1785774808.560152:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671280384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774808.560202:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560213:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560221:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560246:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774808.560293:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774808.560300:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560308:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774808.560375:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.560385:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560424:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560431:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774808.560453:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560460:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fb63 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560476:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.560478:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.560480:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.560492:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671280512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.560528:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.560571:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280512 00000100:00100000:3.0:1785774808.560577:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280512 00000100:00100000:3.0:1785774808.560615:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:3.0:1785774808.560622:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671280512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774808.560636:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774808.560652:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d09fb6a lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fb63 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.560665:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xdcc87686 (ffff9b7605fcc500) 00010000:00010000:3.0:1785774808.560672:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774808.560695:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671280512:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.560701:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:3.0:1785774808.560726:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671280512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.561876:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18412:x1872519648528384:12345-192.168.202.31@tcp:36:rm.0 Request processed in 20273us (20582us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774808.561886:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23877 00000100:00100000:3.0:1785774808.565558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774808.566126:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648528640 00000100:00100000:2.0:1785774808.566139:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648528640 00000100:00100000:2.0:1785774808.566244:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23878 00000100:00100000:2.0:1785774808.566257:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:18412:x1872519648528640:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774808.566388:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566409:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566423:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566437:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566447:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566453:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566531:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566541:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566548:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774808.566847:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:2.0:1785774808.566904:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566914:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566922:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566930:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566938:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566945:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.566968:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774808.567190:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567199:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567207:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567214:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.567219:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567227:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567241:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9b7605dfeb00) 00010000:00010000:2.0:1785774808.567244:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774808.567249:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567257:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fb7f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567279:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567286:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567292:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567299:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567305:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.567364:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567370:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567378:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:2.0:1785774808.567381:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.567384:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567391:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fb71 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774808.567407:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000745aba7e reply state 00000000afda088c transno 4294968535 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567421:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.567428:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xdcc87686 (ffff9b7605dfe200) 00010000:00010000:2.0:1785774808.567431:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774808.567433:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774808.567527:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18412:x1872519648528640:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1273us (1981us total) trans 4294968535 rc 0/0 00000100:00100000:2.0:1785774808.567536:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23878 00010000:00010000:3.0:1785774808.568386:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774808.568396:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.568405:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774808.568409:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.568416:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.568428:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9b7605dfeb00) 00010000:00010000:3.0:1785774808.568430:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774808.568433:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.568439:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a000/0x7b7109e1d09fb86 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.568453:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.568456:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.568457:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774808.577021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.577228:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648528896 00000100:00100000:0.0:1785774808.577241:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648528896 00000100:00100000:0.0:1785774808.577324:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23879 00000100:00100000:0.0:1785774808.577336:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18412:x1872519648528896:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774808.577418:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774808.577456:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031400/0x7b7109e1d09fab4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1f4 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.577482:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9b7605fd8400) 00010000:00010000:0.0:1785774808.577495:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774808.577558:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.577568:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.577580:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.577606:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671280640:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1785774808.577665:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.577712:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.578756:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280640 00000100:00100000:3.0:1785774808.578775:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280640 00000100:00100000:3.0:1785774808.578833:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1785774808.578842:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671280640:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774808.578857:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.578878:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb94 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fb8d expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.578912:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb94 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fb8d expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.578934:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb94 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb8d expref: 14 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.578943:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5c00) 00010000:00010000:3.0:1785774808.578946:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.578950:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:2.0:1785774808.579320:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671280640:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1785774808.579342:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.579354:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774808.579380:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:2.0:1785774808.579412:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.579420:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.579429:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.579444:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671280768:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1785774808.579478:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.579514:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.579621:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280768 00000100:00100000:1.0:1785774808.579628:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280768 00000100:00100000:1.0:1785774808.579667:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:1.0:1785774808.579676:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671280768:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1785774808.579687:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.579703:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09fba2 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fb9b expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.579720:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09fba2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fb9b expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.579731:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09fba2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fb9b expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.579739:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b7605fccc00) 00010000:00010000:1.0:1785774808.579742:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.579744:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:1.0:1785774808.579791:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:6530:x1872519671280768:12345-0@lo:101:mdt00_001.0 Request processed in 116us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.579797:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1785774808.579897:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671280640:12345-0@lo:101:mdt00_001.0 Request processed in 347us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.579905:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:2.0:1785774808.581461:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671280768:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1785774808.581490:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.581506:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774808.581532:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00000100:00100000:2.0:1785774808.581591:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671280896:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774808.581645:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.581689:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4db40 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.581715:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671280896 00000100:00100000:2.0:1785774808.581722:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671280896 00000100:00100000:2.0:1785774808.581879:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:2.0:1785774808.581889:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671280896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774808.582251:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671280896:12345-0@lo:1000:mdt00_001.0 Request processed in 362us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.582259:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1785774808.582418:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671280896:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774808.582472:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671281024:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774808.582501:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.588698:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.605197:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281024 00000100:00100000:1.0:1785774808.605221:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281024 00000100:00100000:1.0:1785774808.605468:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1785774808.605481:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671281024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785774808.605682:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671281024:12345-0@lo:1000:mdt00_001.0 Request processed in 204us (23178us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774808.605689:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:0.0:1785774808.608118:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671281024:0@lo:1000:mdt00_001.0 00000004:00080000:0.0:1785774808.608386:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:0.0:1785774808.608398:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.608411:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.608420:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.608497:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1785774808.608506:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:0.0:1785774808.608511:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.608518:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.608525:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.608551:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774808.608561:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.609118:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774808.609128:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.609139:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.609217:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.609225:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785774808.609318:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671281152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774808.609402:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774808.609557:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774808.609604:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774808.609611:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.609619:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774808.609623:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774808.609631:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.609647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281152 00010000:00010000:0.0:1785774808.609651:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.609655:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281152 00010000:00010000:0.0:1785774808.609657:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774808.609675:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.609682:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b600/0x7b7109e1d09fb9b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fba2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.609705:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.609708:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.609709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00010000:00010000:0.0:1785774808.609709:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.609718:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3656:x1872519671281152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.609735:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.609757:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fb94 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fb8d expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.609781:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5c00) 00010000:00010000:1.0:1785774808.609792:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774808.609838:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.609847:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec2200/0x7b7109e1d09fb8d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fb94 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.609863:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.609865:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.609866:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.609878:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671281280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.609921:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.609958:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281280 00000100:00100000:3.0:1785774808.609962:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281280 00000100:00100000:0.0:1785774808.610118:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18412:x1872519648528896:12345-192.168.202.31@tcp:36:rm.0 Request processed in 32771us (33098us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774808.610128:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23879 00000100:00100000:3.0:1785774808.613226:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:3.0:1785774808.613246:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671281280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774808.613269:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774808.613301:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d09fba2 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fb9b expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.613462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1785774808.613535:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x18618557 (ffff9b7605fccc00) 00010000:00010000:3.0:1785774808.613549:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774808.613619:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671281280:12345-0@lo:103:ldlm_bl.0 Request processed in 381us (3697us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.613627:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:3.0:1785774808.613677:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648529152 00000100:00100000:3.0:1785774808.613686:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648529152 00000100:00100000:3.0:1785774808.613726:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23880 00000100:00100000:3.0:1785774808.613734:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:18412:x1872519648529152:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774808.614097:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614125:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614138:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614152:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614185:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614193:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614286:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614294:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.614301:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.614415:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671281280:0@lo:103:ldlm_bl.0 00000040:00080000:3.0:1785774808.615068:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1785774808.615083:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1050465921415ns, next at 1051465917870ns, rc = 0 00010000:00010000:3.0:1785774808.615153:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 3/0,1 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615193:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615202:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615214:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615221:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615228:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615252:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774808.615275:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615281:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615288:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615294:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774808.615300:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615307:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615328:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9b77199f5b00) 00010000:00010000:3.0:1785774808.615332:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774808.615336:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615347:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fbb7 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615376:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615382:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615389:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615395:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615400:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774808.615403:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615410:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615418:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:3.0:1785774808.615421:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.615424:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615429:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fba9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.615445:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d972e77e reply state 00000000dc44df25 transno 4294968536 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615458:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.615464:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x18618557 (ffff9b77199f5d00) 00010000:00010000:3.0:1785774808.615466:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774808.615469:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774808.615548:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18412:x1872519648529152:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1813us (2088us total) trans 4294968536 rc 0/0 00000100:00100000:3.0:1785774808.615556:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23880 00000100:00100000:1.0:1785774808.617856:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671281152:12345-0@lo:103:ldlm_bl.0 Request processed in 8128us (8443us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.617871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00010000:00010000:0.0:1785774808.619385:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774808.619399:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.619411:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774808.619415:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.619426:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.619446:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9b77199f5b00) 00010000:00010000:0.0:1785774808.619448:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774808.619453:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 1/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.619459:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fbbe lrc: 0/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.619488:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.619490:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.619492:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774808.620661:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671281152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774808.621572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.621821:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648529408 00000100:00100000:1.0:1785774808.621831:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648529408 00000100:00100000:1.0:1785774808.621903:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23881 00000100:00100000:1.0:1785774808.621917:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18412:x1872519648529408:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774808.621994:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.622025:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700030400/0x7b7109e1d09f9e2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c199 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.622046:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:1.0:1785774808.622057:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774808.622127:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.622137:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.622152:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.622203:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281408:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1785774808.622269:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.622319:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.622404:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281408 00000100:00100000:3.0:1785774808.622410:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281408 00000100:00100000:3.0:1785774808.622486:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1785774808.622495:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a2af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6531:x1872519671281408:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1785774808.622506:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774808.622524:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fbcc lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fbc5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.622549:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fbcc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fbc5 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.622565:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fbcc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fbc5 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.622574:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5600) 00010000:00010000:3.0:1785774808.622576:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.622579:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774808.622630:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a2af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6531:x1872519671281408:12345-0@lo:101:mdt00_002.0 Request processed in 136us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.622637:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1785774808.622661:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281408:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1785774808.622676:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.622686:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774808.622703:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:1.0:1785774808.622723:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.622733:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.622739:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.622749:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281536:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1785774808.626609:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.626743:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281536 00000100:00100000:2.0:1785774808.626757:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281536 00000100:00100000:1.0:1785774808.626785:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.626839:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:2.0:1785774808.626850:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6531:x1872519671281536:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1785774808.626874:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774808.626911:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fbda lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fbd3 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.626951:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fbda lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fbd3 expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.626969:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fbda lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fbd3 expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.626994:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b7605dfe000) 00010000:00010000:2.0:1785774808.626997:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.627001:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ac00, rc 0) 00000100:00100000:2.0:1785774808.627083:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6531:x1872519671281536:12345-0@lo:101:mdt00_002.0 Request processed in 234us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.627090:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1785774808.627825:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281536:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1785774808.627853:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.627869:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774808.627892:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00000100:00100000:1.0:1785774808.627947:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281664:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785774808.628001:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.628034:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3300 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.628076:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281664 00000100:00100000:2.0:1785774808.628083:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281664 00000100:00100000:2.0:1785774808.628130:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:2.0:1785774808.628138:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6531:x1872519671281664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785774808.628262:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6531:x1872519671281664:12345-0@lo:1000:mdt00_002.0 Request processed in 125us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.628270:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1785774808.629610:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281664:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785774808.629798:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281792:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785774808.629838:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.629875:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3300 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.630147:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281792 00000100:00100000:3.0:1785774808.630207:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281792 00000100:00100000:3.0:1785774808.630258:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1785774808.630267:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6531:x1872519671281792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785774808.630669:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6531:x1872519671281792:12345-0@lo:1000:mdt00_002.0 Request processed in 402us (828us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774808.630679:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:1.0:1785774808.631861:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6531:1872519671281792:0@lo:1000:mdt00_002.0 00000004:00080000:1.0:1785774808.631892:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:1.0:1785774808.631902:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.631913:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.631922:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.631948:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1785774808.631953:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:1.0:1785774808.631956:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.631962:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.631968:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.631980:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1785774808.632036:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774808.632051:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.632068:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18412:x1872519648529408:12345-192.168.202.31@tcp:36:rm.0 Request processed in 10147us (10492us total) trans 0 rc -2/-2 00010000:00010000:0.0:1785774808.632088:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18c3ed0) 00000100:00100000:1.0:1785774808.632094:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23881 00010000:00010000:0.0:1785774808.632101:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774808.632124:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632206:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632219:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774808.632248:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632257:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057cfa00/0x7b7109e1d09fbc5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fbcc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632281:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774808.632285:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632293:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774808.632297:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774808.632306:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632701:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632707:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774808.632733:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.632740:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce200/0x7b7109e1d09fbd3 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fbda expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.632784:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671281920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.632811:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.632816:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.632818:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.632832:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.632837:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774808.632856:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671282048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.632901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671281920 00000100:00100000:1.0:1785774808.632909:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671281920 00000100:00100000:1.0:1785774808.632949:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1785774808.632971:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671281920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774808.632982:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785774808.632987:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.633012:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fbcc lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fbc5 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.633039:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b77199f5600) 00000100:00100000:0.0:1785774808.633041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282048 00000100:00100000:0.0:1785774808.633049:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282048 00010000:00010000:1.0:1785774808.633054:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774808.633103:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671281920:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.633117:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1785774808.633133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1785774808.633136:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7707d73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3656:x1872519671282048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.633153:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774808.633204:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fbda lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fbd3 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.633216:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671281920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.633220:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xbc0ca3a9 (ffff9b7605dfe000) 00010000:00010000:0.0:1785774808.633236:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774808.633286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7707d73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671282048:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.633294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00010000:00010000:3.0:1785774808.634961:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.635840:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671282048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.639014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.639146:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648529664 00000100:00100000:0.0:1785774808.639203:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648529664 00000100:00100000:0.0:1785774808.639274:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23882 00000100:00100000:0.0:1785774808.639285:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:18412:x1872519648529664:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1785774808.639402:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639426:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639440:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639452:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639460:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639467:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639539:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 3/0,1 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639546:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639552:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774808.639857:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00010000:00010000:0.0:1785774808.639911:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639921:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639930:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639939:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639947:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639954:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.639983:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774808.640004:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640011:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640020:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640027:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.640033:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.640036:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774808.640046:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.640052:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640063:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9b7702bc0700) 00010000:00010000:0.0:1785774808.640068:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774808.640403:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 2/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640418:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fbef lrc: 0/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640441:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640448:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640454:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640461:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640467:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.640471:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640477:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640486:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7702bc0000) 00010000:00010000:0.0:1785774808.640489:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.640493:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640500:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fbe1 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774808.640515:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007da6189b reply state 0000000033853165 transno 4294968537 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640528:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.640535:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xbc0ca3a9 (ffff9b7702bc0900) 00010000:00010000:0.0:1785774808.640538:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774808.640541:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774808.640641:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18412:x1872519648529664:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1357us (1637us total) trans 4294968537 rc 0/0 00000100:00100000:0.0:1785774808.640651:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23882 00010000:00010000:1.0:1785774808.649622:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774808.649636:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.649650:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.649668:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9b7702bc0700) 00010000:00010000:1.0:1785774808.649672:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774808.649675:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.649685:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3200/0x7b7109e1d09fbf6 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.651675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.652739:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648529920 00000100:00100000:3.0:1785774808.652767:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648529920 00000100:00100000:3.0:1785774808.652857:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23883 00000100:00100000:3.0:1785774808.652871:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18412:x1872519648529920:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774808.652952:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774808.652999:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7700031000/0x7b7109e1d09fa21 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ae expref: 20 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.653024:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:3.0:1785774808.653036:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774808.653096:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.653106:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.653129:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774808.653155:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282176:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1785774808.653262:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.653641:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282176 00000100:00100000:1.0:1785774808.653653:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282176 00000100:00100000:1.0:1785774808.653734:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1785774808.653746:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:8469:x1872519671282176:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1785774808.653768:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.653795:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc04 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fbfd expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.653828:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc04 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fbfd expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.653843:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc04 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fbfd expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.653852:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605fcc300) 00010000:00010000:1.0:1785774808.653855:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.653859:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00000100:00100000:1.0:1785774808.653921:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:8469:x1872519671282176:12345-0@lo:101:mdt00_003.0 Request processed in 178us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.653929:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00010000:00010000:0.0:1785774808.658652:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.658661:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.658664:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774808.661886:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.661965:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282176:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774808.662749:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.662830:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774808.662864:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:2.0:1785774808.662930:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.662945:0:8469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.662957:0:8469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.663220:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282304:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1785774808.663306:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.663363:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.663644:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282304 00000100:00100000:0.0:1785774808.663658:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282304 00000100:00100000:0.0:1785774808.663783:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:0.0:1785774808.663796:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:8469:x1872519671282304:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1785774808.663818:0:7692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.663845:0:7692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fc12 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fc0b expref: -99 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.663879:0:7692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fc12 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fc0b expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.663895:0:7692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fc12 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc0b expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.663903:0:7692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7702bc0000) 00010000:00010000:0.0:1785774808.663906:0:7692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.663910:0:7692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774808.663993:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671282304:12345-0@lo:101:mdt00_003.0 Request processed in 201us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.664000:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:2.0:1785774808.664099:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282304:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1785774808.664128:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.664141:0:8469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774808.664206:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00000100:00100000:2.0:1785774808.664254:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774808.664293:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.664333:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.664452:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282432 00000100:00100000:3.0:1785774808.664459:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282432 00000100:00100000:3.0:1785774808.664515:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:3.0:1785774808.664524:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671282432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774808.664611:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671282432:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.664619:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1785774808.664854:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774808.664897:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282560:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785774808.664922:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.664949:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.665000:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282560 00000100:00100000:3.0:1785774808.665005:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282560 00000100:00100000:3.0:1785774808.665028:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:3.0:1785774808.665035:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671282560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785774808.665128:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:8469:x1872519671282560:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (204us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785774808.665135:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1785774808.665420:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8469:1872519671282560:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1785774808.665440:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:2.0:1785774808.665448:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.665458:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.665466:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.665494:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774808.665500:0:8469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:2.0:1785774808.665505:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.665511:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.665518:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.665538:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774808.665620:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18412:x1872519648529920:12345-192.168.202.31@tcp:36:rm.0 Request processed in 12751us (13949us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774808.665627:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23883 00010000:00010000:1.0:1785774808.665696:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774808.665705:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665714:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774808.665721:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774808.665730:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665772:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665780:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774808.665809:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665818:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec1800/0x7b7109e1d09fbfd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc04 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665838:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774808.665842:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665848:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774808.665852:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774808.665860:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665883:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665895:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785774808.665918:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665926:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35be00/0x7b7109e1d09fc0b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc12 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.665940:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774808.665943:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774808.665945:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.665955:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774808.665965:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671282816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.666009:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.666045:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282816 00000100:00100000:1.0:1785774808.666050:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282816 00000100:00100000:1.0:1785774808.666083:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1785774808.666089:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671282816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.666102:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.666135:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09fc12 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fc0b expref: 15 pid: 7692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.666148:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x84832a57 (ffff9b7702bc0000) 00010000:00010000:1.0:1785774808.666178:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774808.666205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3654:x1872519671282816:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.666212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1785774808.666240:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671282816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785774808.666397:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774808.666445:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774808.666455:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671282688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774808.666481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.668232:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282688 00000100:00100000:1.0:1785774808.668246:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282688 00000100:00100000:1.0:1785774808.668320:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1785774808.668331:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671282688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.668350:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.668375:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc04 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fbfd expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.668396:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605fcc300) 00010000:00010000:1.0:1785774808.668407:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774808.668481:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671282688:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.668488:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1785774808.668704:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671282688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.678383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.678552:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648530176 00000100:00100000:1.0:1785774808.678567:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648530176 00000100:00100000:1.0:1785774808.678644:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23884 00000100:00100000:1.0:1785774808.678657:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:18412:x1872519648530176:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774808.678789:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678810:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678825:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678841:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678853:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678861:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678940:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678950:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.678958:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774808.679557:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8640 00010000:00010000:0.0:1785774808.679648:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679666:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679678:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679687:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679694:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679790:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679880:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774808.679908:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679915:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679921:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679931:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.679936:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679944:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679957:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:0.0:1785774808.679959:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774808.679964:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679969:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d09fc27 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679990:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.679996:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680001:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680007:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680012:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774808.680015:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680024:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680031:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605fcc100) 00010000:00010000:0.0:1785774808.680034:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.680037:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680042:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d09fc19 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774808.680058:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf913891 reply state 000000008829d513 transno 4294968538 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680069:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.680075:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x84832a57 (ffff9b7605fcc000) 00010000:00010000:0.0:1785774808.680077:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774808.680080:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774808.680206:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18412:x1872519648530176:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1548us (1834us total) trans 4294968538 rc 0/0 00000100:00100000:0.0:1785774808.680214:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23884 00000100:00100000:0.0:1785774808.686845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.687075:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648530432 00000100:00100000:1.0:1785774808.687092:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648530432 00000100:00100000:1.0:1785774808.687227:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23885 00000100:00100000:1.0:1785774808.687244:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:18412:x1872519648530432:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1785774808.687339:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.687376:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cec00/0x7b7109e1d09faf3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c209 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.687401:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:1.0:1785774808.687414:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774808.687479:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.687489:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.687502:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.687529:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671282944:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1785774808.687600:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774808.687670:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770efa3540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.687866:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671282944 00000100:00100000:0.0:1785774808.687877:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671282944 00000100:00100000:0.0:1785774808.687940:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1785774808.687952:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671282944:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774808.687977:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.688004:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc3c lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fc35 expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.688036:0:20645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc3c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fc35 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.688051:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc3c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc35 expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.688060:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774808.688063:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.688067:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3c00, rc 0) 00000100:00100000:0.0:1785774808.688146:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6530:x1872519671282944:12345-0@lo:101:mdt00_001.0 Request processed in 197us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.688153:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:3.0:1785774808.688515:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671282944:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774808.688537:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.688549:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774808.688574:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:3.0:1785774808.688602:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.688609:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.688617:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774808.688630:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671283072:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1785774808.688662:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.688697:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.688774:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671283072 00000100:00100000:0.0:1785774808.688780:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671283072 00000100:00100000:0.0:1785774808.688815:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:0.0:1785774808.688821:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6530:x1872519671283072:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774808.688831:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.688847:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fc4a lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fc43 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.688866:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fc4a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fc43 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.688877:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fc4a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc43 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.688890:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7702bc0100) 00010000:00010000:0.0:1785774808.688893:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774808.688895:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2000, rc 0) 00000100:00100000:0.0:1785774808.688941:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671283072:12345-0@lo:101:mdt00_001.0 Request processed in 119us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.688947:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1785774808.689886:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671283072:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774808.689905:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.689916:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774808.689935:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00000100:00100000:3.0:1785774808.689991:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671283200:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774808.690037:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.690075:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.690094:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671283200 00000100:00100000:0.0:1785774808.690103:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671283200 00000100:00100000:0.0:1785774808.690150:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1785774808.690175:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671283200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774808.690278:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671283200:12345-0@lo:1000:mdt00_001.0 Request processed in 121us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.690286:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00010000:00010000:2.0:1785774808.690405:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774808.690414:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.690423:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774808.690434:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.690452:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.690467:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:2.0:1785774808.690470:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774808.690474:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 1/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.690480:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fc2e lrc: 0/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.690508:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774808.690510:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774808.690512:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.690747:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671283200:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774808.690808:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671283328:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774808.690840:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.690877:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.690961:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671283328 00000100:00100000:1.0:1785774808.690970:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671283328 00000100:00100000:1.0:1785774808.691033:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1785774808.691042:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671283328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785774808.691217:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671283328:12345-0@lo:1000:mdt00_001.0 Request processed in 176us (376us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785774808.691225:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:2.0:1785774808.691792:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671283328:0@lo:1000:mdt00_001.0 00000004:00080000:2.0:1785774808.691815:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:2.0:1785774808.691823:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.691834:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.691841:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.691867:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774808.691872:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:2.0:1785774808.691876:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.691883:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.691889:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.691905:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774808.691984:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18412:x1872519648530432:12345-192.168.202.31@tcp:36:rm.0 Request processed in 4744us (5147us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774808.691992:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23885 00010000:00010000:0.0:1785774808.692045:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774808.692051:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.692059:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:0.0:1785774808.692064:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774808.692072:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.692090:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774808.692099:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.692104:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.692135:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:1.0:1785774808.692146:0:16275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.692149:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785774808.692221:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.692230:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b76057ce400/0x7b7109e1d09fc35 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc3c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774808.692243:0:16275:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.692271:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1785774808.692282:0:16275:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.692288:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671283456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785774808.692337:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.692377:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671283456 00000100:00100000:0.0:1785774808.692383:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671283456 00010000:00010000:1.0:1785774808.692424:0:16275:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1785774808.692425:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00010000:00010000:1.0:1785774808.692449:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.692463:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671283456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.692466:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7605ec0e00/0x7b7109e1d09fc43 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc4a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.692488:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.692494:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774808.692498:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774808.692501:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.692514:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc3c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fc35 expref: 15 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.692530:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774808.692540:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774808.692575:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671283456:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.692582:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00010000:00010000:0.0:1785774808.692603:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.692605:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774808.692607:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774808.693348:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671283584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774808.693381:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.694394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671283584 00000100:00100000:0.0:1785774808.694403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671283584 00000100:00100000:0.0:1785774808.694550:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1785774808.694559:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671283584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.694572:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774808.694591:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fc4a lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fc43 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.694607:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0xb62e0cbf (ffff9b7702bc0100) 00010000:00010000:0.0:1785774808.694680:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774808.694777:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671283584:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.694784:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1785774808.694846:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671283584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.695340:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671283456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.697818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774808.697883:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648530688 00000100:00100000:2.0:1785774808.697898:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648530688 00000100:00100000:2.0:1785774808.697960:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23886 00000100:00100000:2.0:1785774808.697970:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:18412:x1872519648530688:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774808.698052:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698068:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698081:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698095:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698102:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698125:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698217:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698226:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.698234:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774808.700431:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00010000:00010000:2.0:1785774808.700797:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700813:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700824:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700833:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700840:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700846:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700859:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774808.700887:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700893:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700898:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700903:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.700907:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700914:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700927:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9b7605dfe700) 00010000:00010000:2.0:1785774808.700931:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774808.700935:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700940:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35a800/0x7b7109e1d09fc5f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700960:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700967:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700973:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700980:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700985:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.700988:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.700994:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.701002:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605dfe600) 00010000:00010000:2.0:1785774808.701004:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.701007:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.701013:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35be00/0x7b7109e1d09fc51 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774808.701027:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001443f8f2 reply state 000000000cacc3d6 transno 4294968539 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.701038:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.701045:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xb62e0cbf (ffff9b7605dfea00) 00010000:00010000:2.0:1785774808.701048:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774808.701051:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774808.701150:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18412:x1872519648530688:12345-192.168.202.31@tcp:36:rm.0 Request processed in 3178us (3337us total) trans 4294968539 rc 0/0 00000100:00100000:2.0:1785774808.701208:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23886 00010000:00010000:3.0:1785774808.701600:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774808.701607:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.701615:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774808.701619:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.701626:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.701636:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9b7605dfe700) 00010000:00010000:3.0:1785774808.701639:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774808.701642:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.701648:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b600/0x7b7109e1d09fc66 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.701663:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.701665:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.701667:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.706080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774808.706388:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648530816 00000100:00100000:0.0:1785774808.706398:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648530816 00000100:00100000:0.0:1785774808.707569:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 552 00000100:00100000:0.0:1785774808.707582:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648530816:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774808.707656:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648530816:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.707664:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 552 00000100:00100000:0.0:1785774808.709933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774808.710009:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648531200 00000100:00100000:1.0:1785774808.710025:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648531200 00000100:00100000:1.0:1785774808.710105:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5121 00000100:00100000:1.0:1785774808.710131:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18412:x1872519648531200:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1785774808.712971:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18412:x1872519648531200:12345-192.168.202.31@tcp:35:rm.0 Request processed in 2836us (3035us total) trans 4294968540 rc 0/0 00000100:00100000:1.0:1785774808.712997:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5121 00000100:00100000:2.0:1785774808.713129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.713837:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648530944 00000100:00100000:3.0:1785774808.713847:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648530944 00000100:00100000:3.0:1785774808.713907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1488 00000100:00100000:3.0:1785774808.713917:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648530944:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:3.0:1785774808.713934:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774808.713960:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09f5c1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0dc expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.713983:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:3.0:1785774808.713995:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774808.714046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2418:x1872519648530944:12345-192.168.202.31@tcp:103:rm.0 Request processed in 131us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.714054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1488 00000100:00100000:2.0:1785774808.725588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.732939:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648531456 00000100:00100000:3.0:1785774808.732956:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648531456 00000100:00100000:2.0:1785774808.733118:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23887 00000100:00100000:2.0:1785774808.733130:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:18412:x1872519648531456:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774808.733207:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1785774808.733236:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d09f8ed lrc: 0/0,0 mode: --/CR res: [0x240000402:0x192:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c14c expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.733590:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d09f8c3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c137 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.733603:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7702c6ad00) 00010000:00010000:2.0:1785774808.733613:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774808.733658:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.733666:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.733676:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.733799:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671283712:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774808.733866:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.733915:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.734072:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671283712 00000100:00100000:0.0:1785774808.734085:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671283712 00000100:00100000:0.0:1785774808.734194:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:0.0:1785774808.734207:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6529:x1872519671283712:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774808.734226:0:20645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.734248:0:20645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fc6d expref: -99 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.734292:0:20645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 9 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.734304:0:20645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.734351:0:20645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 9 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.734367:0:20645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 9 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.734380:0:20645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20645:1872519671283840:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774808.734468:0:20645:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8480 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.738818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774808.738982:0:20645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20645:1872519671283840:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774808.739025:0:20645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.739040:0:20645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774808.739043:0:20645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774808.739047:0:20645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 14 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.739058:0:20645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3c00, rc 0) 00000100:00100000:3.0:1785774808.739137:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671283712:12345-0@lo:101:mdt00_000.0 Request processed in 4933us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774808.739147:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:2.0:1785774808.739647:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671283712:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774808.739675:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.739688:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774808.746179:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648531584 00000100:00100000:1.0:1785774808.746198:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648531584 00010000:00010000:0.0:1785774808.747150:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 10 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.747229:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1666 00000100:00100000:0.0:1785774808.747243:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648531584:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774808.747270:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774808.747279:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 10 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.747295:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 10 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.747319:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09f5a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c0d5 expref: 10 pid: 8627 timeout: 1150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.747336:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774808.747343:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.747356:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.747366:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.747401:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 13 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.747416:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671283968:0@lo:105: 00000100:00100000:0.0:1785774808.747893:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774808.748000:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8840 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.752302:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671283968 00000100:00100000:1.0:1785774808.752317:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671283968 00000100:00100000:1.0:1785774808.752387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1785774808.752397:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671283968:12345-0@lo:105: 00010000:00010000:1.0:1785774808.752413:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.753382:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.753398:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.753408:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.753416:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.753435:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.753562:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b773c35a800) 00000100:00100000:1.0:1785774808.753680:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6515:x1872519671283968:12345-0@lo:105: Request processed in 1283us (5786us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.753688:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00010000:00010000:2.0:1785774808.755368:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.755384:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774808.755413:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1785774808.755467:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.755475:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.755486:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.755504:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284096:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774808.755551:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.755583:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.757224:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671284096 00000100:00100000:1.0:1785774808.757234:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671284096 00000100:00100000:1.0:1785774808.757301:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:1.0:1785774808.757310:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6529:x1872519671284096:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1785774808.757330:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774808.757352:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc82 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fc7b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.757388:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fc7b expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.757404:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc7b expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.757413:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7605fcc300) 00010000:00010000:1.0:1785774808.757416:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774808.757420:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00000100:00100000:1.0:1785774808.757496:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671284096:12345-0@lo:101:mdt00_000.0 Request processed in 186us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.757504:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:2.0:1785774808.758403:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284096:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774808.758423:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.758446:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774808.758471:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1785774808.758513:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284224:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774808.758548:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.758566:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.758713:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671284224 00000100:00100000:1.0:1785774808.758719:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671284224 00000100:00100000:1.0:1785774808.758754:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:1.0:1785774808.758761:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671284224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785774808.758839:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671284224:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.758846:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:2.0:1785774808.758953:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284224:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774808.758992:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284352:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785774808.759015:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.759038:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774808.759434:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671284352 00000100:00100000:3.0:1785774808.759447:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671284352 00000100:00100000:3.0:1785774808.759579:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:3.0:1785774808.759591:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671284352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785774808.759994:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671284352:12345-0@lo:1000:mdt00_000.0 Request processed in 170us (741us total) trans 0 rc 1/1 00000100:00100000:3.0:1785774808.760004:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:0.0:1785774808.760118:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6515:1872519671283968:0@lo:105: 00010000:00010000:0.0:1785774808.760137:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774808.760210:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648531584:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 12971us (21403us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.760220:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1666 00000100:00100000:2.0:1785774808.764098:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284352:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1785774808.764240:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.764253:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.764265:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.764288:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284480:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774808.764577:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.764618:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.766944:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671284480 00000100:00100000:0.0:1785774808.766960:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671284480 00000100:00100000:0.0:1785774808.767056:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1785774808.767068:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6529:x1872519671284480:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1785774808.767094:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774808.767133:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fc90 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fc89 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.767200:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fc90 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fc89 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.767216:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fc90 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fc89 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774808.767226:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774808.767229:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774808.767234:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2a00, rc 0) 00000100:00100000:2.0:1785774808.767474:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284480:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774808.767496:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767510:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767544:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767553:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767561:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767582:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767589:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767595:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767630:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767638:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767648:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.767666:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284608:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1785774808.767700:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.767715:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:2.0:1785774808.767733:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671284608 00000100:00100000:2.0:1785774808.767737:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671284608 00000100:00100000:2.0:1785774808.767771:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:2.0:1785774808.767779:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671284608:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774808.767787:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774808.767799:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fcac lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d09fca5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767814:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fcac lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d09fca5 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767824:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fcac lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d09fca5 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767831:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfef00) 00010000:00010000:2.0:1785774808.767834:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774808.767836:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35be00, rc 0) 00000100:00100000:2.0:1785774808.767862:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6529:x1872519671284608:12345-0@lo:101:mdt00_000.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774808.767870:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:2.0:1785774808.767900:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284608:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1785774808.767910:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.767919:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774808.769399:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671284480:12345-0@lo:101:mdt00_000.0 Request processed in 246us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.769409:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1785774808.769478:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284736:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1785774808.769530:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774808.769561:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1785774808.769660:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671284736 00000100:00100000:0.0:1785774808.769665:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671284736 00000100:00100000:0.0:1785774808.769703:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:0.0:1785774808.769711:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671284736:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1785774808.772895:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6529:x1872519671284736:12345-0@lo:403:mdt00_000.0 Request processed in 3173us (3352us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774808.772911:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:2.0:1785774808.776022:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6529:1872519671284736:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1785774808.777574:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].406, 960 off609288 00000040:00080000:2.0:1785774808.780219:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].406, 1040 off656400 00000004:00080000:2.0:1785774808.780235:0:6529:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7735a4d300 with version 777 00000004:00080000:3.0:1785774808.780349:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 777 rpc_version 777 00000020:00100000:3.0:1785774808.780400:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774808.780414:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c1500 x1872519671284992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774808.780444:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671284992:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774808.780533:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.780576:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605f84f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785774808.780642:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671284992 00000100:00100000:1.0:1785774808.780658:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671284992 00000100:00100000:1.0:1785774808.780787:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:1.0:1785774808.780799:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7474:x1872519671284992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774808.784707:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:7474:x1872519671284992:12345-0@lo:1000:osp_up0-1.0 Request processed in 3900us (4162us total) trans 4294983625 rc 0/0 00000100:00100000:0.0:1785774808.784725:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1785774808.784999:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671284992:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1785774808.785134:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 4096 00010000:00010000:2.0:1785774808.785196:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785207:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785216:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785222:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.785228:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785236:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785256:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9b7605dfe500) 00010000:00010000:2.0:1785774808.785259:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774808.785264:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 2/0,0 mode: --/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785275:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b800/0x7b7109e1d09fc9e lrc: 0/0,0 mode: --/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785299:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785307:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785324:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785349:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1785774808.785360:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd2:0x0] 00010000:00010000:2.0:1785774808.785368:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785374:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785380:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785384:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774808.785387:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785393:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785405:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7605dfec00) 00010000:00010000:2.0:1785774808.785407:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774808.785410:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785416:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35b000/0x7b7109e1d09fc97 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785427:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785436:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785443:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785455:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1785774808.785463:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1785774808.785468:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785475:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785483:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785498:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1785774808.785502:0:6529:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1785774808.785507:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774808.785516:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774808.785596:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:18412:x1872519648531456:12345-192.168.202.31@tcp:36:rm.0 Request processed in 52465us (60016us total) trans 4294968541 rc 0/0 00000100:00100000:2.0:1785774808.785604:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23887 00010000:00010000:3.0:1785774808.785863:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785774808.785870:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.785879:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774808.785884:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.785893:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.785931:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.785938:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774808.785969:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 1/0,0 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.785985:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35b200/0x7b7109e1d09fca5 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fcac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786005:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774808.786009:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786015:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774808.786018:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.786025:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786040:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786046:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774808.786062:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786069:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a400/0x7b7109e1d09fc89 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc90 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786079:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774808.786083:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786089:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:3.0:1785774808.786092:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774808.786099:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786123:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786128:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774808.786133:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786139:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a800/0x7b7109e1d09fc6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc74 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774808.786147:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.786148:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774808.786150:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.786193:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774808.786212:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671285120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.786268:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785774808.786808:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774808.786866:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671285248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.786900:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774808.786934:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774808.786942:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671285376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785774808.786969:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671285120 00000100:00100000:1.0:1785774808.786982:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671285120 00000100:00100000:3.0:1785774808.787022:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774808.787128:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774808.792594:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671285248 00000100:00100000:1.0:1785774808.792611:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671285248 00000100:00100000:1.0:1785774808.792664:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671285376 00000100:00100000:1.0:1785774808.792667:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671285376 00000100:00100000:1.0:1785774808.792688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1785774808.792696:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7707d71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3655:x1872519671285120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.795779:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.795810:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fcac lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fca5 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.795834:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9b7605dfef00) 00010000:00010000:1.0:1785774808.795846:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774808.795954:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7707d71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+19:3655:x1872519671285120:12345-0@lo:103:ldlm_bl.0 Request processed in 3257us (9685us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.795963:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1785774808.796042:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:1.0:1785774808.796053:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3653:x1872519671285248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.796061:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.796073:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fc90 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fc89 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.796085:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:1.0:1785774808.796092:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774808.796135:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3653:x1872519671285248:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (9234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.796141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:1.0:1785774808.796154:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1785774808.796176:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3653:x1872519671285376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.796184:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774808.796195:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09fc74 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fc6d expref: 16 pid: 20645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774808.796205:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774808.796209:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774808.796232:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671285376:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (9263us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774808.796237:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:2.0:1785774808.800620:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671285120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.801909:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671285376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774808.801935:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671285248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774808.868702:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774809.253123:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774809.253147:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671285504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774809.253245:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774809.253327:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671285504 00000100:00100000:2.0:1785774809.253335:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671285504 00000100:00100000:2.0:1785774809.253385:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1785774809.253395:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671285504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774809.253424:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67534272 pending 57344 free 3923472384 avail 3691950080 00000100:00100000:2.0:1785774809.253466:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671285504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774809.253473:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00080000:2.0:1785774809.253493:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774809.253531:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671285504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774809.256209:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774809.259076:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671285632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774809.259248:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774809.271266:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671285632 00000100:00100000:3.0:1785774809.271289:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671285632 00000100:00100000:3.0:1785774809.271404:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1785774809.271418:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1872519671285632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774809.271457:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67534272 pending 57344 free 3923472384 avail 3691950080 00000100:00100000:3.0:1785774809.271659:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1872519671285632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 243us (12410us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774809.271669:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00080000:2.0:1785774809.278091:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774809.284286:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671285632:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1785774809.894523:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774810.279494:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774810.279526:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671285760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774810.279619:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774810.281078:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671285760 00000100:00100000:0.0:1785774810.281090:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671285760 00000100:00100000:0.0:1785774810.281188:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:0.0:1785774810.281199:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671285760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774810.281250:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445085184 avail 1298845696 00000100:00100000:0.0:1785774810.281315:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671285760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774810.281323:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1785774810.283913:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671286144:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.283991:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774810.284024:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671286656:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284050:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774810.284066:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671287168:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284088:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774810.284124:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1785774810.284131:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671286016:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284180:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774810.284199:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671286528:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284222:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774810.284244:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671287040:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284268:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774810.284303:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286144 00000100:00100000:2.0:1785774810.284312:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286144 00000100:00100000:2.0:1785774810.284360:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1785774810.284368:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:3656:x1872519671286144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284430:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:3656:x1872519671286144:12345-0@lo:400:kworker.0 Request processed in 62us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774810.284438:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1785774810.284463:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286016 00000100:00100000:2.0:1785774810.284467:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286016 00000100:00100000:2.0:1785774810.284493:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286528 00000100:00100000:2.0:1785774810.284496:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286528 00000100:00100000:2.0:1785774810.284526:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671287040 00000100:00100000:2.0:1785774810.284529:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671287040 00000100:00100000:2.0:1785774810.284544:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1785774810.284550:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671286016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284582:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671286016:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774810.284589:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1785774810.284602:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1785774810.284607:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671286528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284633:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671286528:12345-0@lo:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774810.284638:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1785774810.284648:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1785774810.284652:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671287040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284674:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671287040:12345-0@lo:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774810.284679:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1785774810.284720:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671286016:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284730:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671286528:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284737:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671287040:0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.284746:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671286144:0@lo:400:kworker.0 00000100:00080000:2.0:1785774810.284772:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774810.284939:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286656 00000100:00100000:3.0:1785774810.284944:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286656 00000100:00100000:3.0:1785774810.284982:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671287168 00000100:00100000:3.0:1785774810.284986:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671287168 00000100:00100000:3.0:1785774810.285016:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1785774810.285023:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3656:x1872519671286656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285065:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3656:x1872519671286656:12345-0@lo:400:kworker.0 Request processed in 43us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774810.285072:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1785774810.285085:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1785774810.285091:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3656:x1872519671287168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285154:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3656:x1872519671287168:12345-0@lo:400:kworker.0 Request processed in 64us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774810.285182:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00080000:3.0:1785774810.285201:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774810.285225:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671286656:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285236:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671287168:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285257:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671285888:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285298:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774810.285322:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671286400:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285347:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774810.285363:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671286912:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285382:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774810.285402:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968517 gen 2 00000004:00080000:3.0:1785774810.285408:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968512 committed transno 4294968517 00000020:00080000:3.0:1785774810.285415:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605cec300 refcount 2 committed 0 result 0 batchid 415 00000020:00080000:3.0:1785774810.285419:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cecd80 00000020:00080000:3.0:1785774810.285422:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cec0c0 00000020:00080000:3.0:1785774810.285425:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].403 00000020:00080000:3.0:1785774810.285428:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604d79000 00000020:00080000:3.0:1785774810.285431:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].403 00000004:00080000:3.0:1785774810.285457:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968513 committed transno 4294968517 00000020:00080000:3.0:1785774810.285461:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605cec540 refcount 2 committed 0 result 0 batchid 416 00000020:00080000:3.0:1785774810.285464:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760632b000 00000020:00080000:3.0:1785774810.285467:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605ceca80 00000020:00080000:3.0:1785774810.285470:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].404 00000020:00080000:3.0:1785774810.285472:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604d79800 00000020:00080000:3.0:1785774810.285475:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].404 00000004:00080000:3.0:1785774810.285490:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968514 committed transno 4294968517 00000020:00080000:3.0:1785774810.285494:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b760632b900 refcount 2 committed 0 result 0 batchid 417 00000020:00080000:3.0:1785774810.285497:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760632b600 00000020:00080000:3.0:1785774810.285500:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760632b9c0 00000020:00080000:3.0:1785774810.285502:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].405 00000020:00080000:3.0:1785774810.285506:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7735ae5600 00000020:00080000:3.0:1785774810.285508:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].405 00000004:00080000:3.0:1785774810.285519:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968515 committed transno 4294968517 00000020:00080000:3.0:1785774810.285523:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b77093ad900 refcount 2 committed 0 result 0 batchid 418 00000020:00080000:3.0:1785774810.285525:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7602557800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b77012edc00 00000020:00080000:3.0:1785774810.285528:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7602557c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b760632b180 00000020:00080000:3.0:1785774810.285531:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].406 00000020:00080000:3.0:1785774810.285533:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76027d7600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7715cd1200 00000020:00080000:3.0:1785774810.285536:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].406 00000004:00080000:3.0:1785774810.285547:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968516 committed transno 4294968517 00000020:00080000:3.0:1785774810.285551:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7605f84480 refcount 2 committed 0 result 0 batchid 419 00000020:00080000:3.0:1785774810.285553:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605f84900 00000020:00080000:3.0:1785774810.285556:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0cb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605f84cc0 00000020:00080000:3.0:1785774810.285558:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].407 00000020:00080000:3.0:1785774810.285560:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7603d0c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7735ae4e00 00000020:00080000:3.0:1785774810.285563:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].407 00000004:00080000:3.0:1785774810.285573:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968517 committed transno 4294968517 00000020:00080000:3.0:1785774810.285576:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b770efa3180 refcount 2 committed 0 result 0 batchid 420 00000020:00080000:3.0:1785774810.285579:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054abc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7735a4d9c0 00000020:00080000:3.0:1785774810.285582:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7602557300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7605cec480 00000020:00080000:3.0:1785774810.285585:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].408 00000020:00080000:3.0:1785774810.285587:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7602557600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7603f8ee00 00000020:00080000:3.0:1785774810.285590:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].408 00000100:00100000:3.0:1785774810.285612:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671285760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774810.285625:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1785774810.285631:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671286272:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285657:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774810.285675:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671286784:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285696:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774810.285712:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671287296:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.285734:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1785774810.285929:0:9844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1052136767746ns, next at 1053136764163ns, rc = 0 00000100:00100000:3.0:1785774810.288927:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671287424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774810.289006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774810.289075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671285888 00000100:00100000:3.0:1785774810.289084:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671285888 00000100:00100000:3.0:1785774810.289179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1785774810.289201:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671285888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.289269:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671285888:12345-0@lo:400:kworker.0 Request processed in 81us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774810.289278:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1785774810.289319:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286400 00000100:00100000:3.0:1785774810.289323:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286400 00000100:00100000:3.0:1785774810.289355:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286912 00000100:00100000:3.0:1785774810.289358:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286912 00000100:00100000:3.0:1785774810.289369:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286272 00000100:00100000:3.0:1785774810.289372:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286272 00000100:00100000:3.0:1785774810.289383:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1785774810.289388:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671286400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.289418:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671286400:12345-0@lo:400:kworker.0 Request processed in 30us (4070us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774810.289424:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1785774810.289435:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1785774810.289441:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671286912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.289805:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671286784 00000100:00100000:2.0:1785774810.289810:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671286784 00000100:00100000:2.0:1785774810.289840:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671287296 00000100:00100000:2.0:1785774810.289844:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671287296 00000100:00100000:2.0:1785774810.289867:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1785774810.289874:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3654:x1872519671286784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.289918:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3654:x1872519671286784:12345-0@lo:400:kworker.0 Request processed in 45us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774810.289925:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1785774810.289937:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1785774810.289944:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3654:x1872519671287296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.289974:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3654:x1872519671287296:12345-0@lo:400:kworker.0 Request processed in 31us (4239us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774810.289979:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1785774810.289999:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1785774810.290005:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671286272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774810.290032:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671286272:12345-0@lo:400:kworker.0 Request processed in 28us (4375us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774810.290038:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1785774810.290189:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671287424 00000100:00100000:1.0:1785774810.290194:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671287424 00000100:00100000:1.0:1785774810.290229:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1785774810.290236:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1872519671287424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774810.290262:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67595712 pending 86016 free 3923513344 avail 3691991040 00000100:00100000:1.0:1785774810.290300:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1872519671287424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774810.290306:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000020:00080000:2.0:1785774810.292357:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 420 committed batchid 414 00000020:00080000:2.0:1785774810.292449:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 414 00000100:00100000:3.0:1785774810.296956:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671286912:12345-0@lo:400:kworker.0 Request processed in 7509us (11566us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774810.296969:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00080000:3.0:1785774810.297035:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774810.297042:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774810.298892:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671287424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774810.298931:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671286272:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.298947:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671286784:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.298973:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671287296:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.298986:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671285888:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.298999:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671286400:0@lo:400:kworker.0 00000100:00100000:3.0:1785774810.299011:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671286912:0@lo:400:kworker.0 00000100:00100000:1.0:1785774810.788406:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671287552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774810.788512:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774810.788604:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671287552 00000100:00100000:1.0:1785774810.788614:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671287552 00000100:00100000:1.0:1785774810.788673:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1785774810.788683:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3655:x1872519671287552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785774810.788713:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67595712 pending 86016 free 3923513344 avail 3691991040 00000100:00100000:1.0:1785774810.788765:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3655:x1872519671287552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774810.788773:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1785774810.789055:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671287552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785774810.922230:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774811.957350:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785774812.328862:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969892 is committed 00000001:00080000:3.0:1785774812.328879:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969891 is committed 00000001:00080000:3.0:1785774812.328898:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969887 is committed 00000001:00080000:3.0:1785774812.334795:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969895 is committed 00000001:00080000:3.0:1785774812.334812:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969894 is committed 00000001:00080000:3.0:1785774812.334837:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969889 is committed 00010000:00010000:1.0:1785774812.964407:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774813.348610:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671287680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774813.348712:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774813.349036:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671287680 00000100:00100000:3.0:1785774813.349046:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671287680 00000100:00100000:3.0:1785774813.349133:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:3.0:1785774813.349144:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:3656:x1872519671287680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774813.349224:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444057088 avail 1297817600 00000100:00100000:3.0:1785774813.349301:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:3656:x1872519671287680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774813.349308:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:3.0:1785774813.349366:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671287680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774813.834819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774813.834868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774813.834898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774813.834929:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532096 00000100:00100000:3.0:1785774813.834941:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532096 00000100:00100000:3.0:1785774813.835010:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 609 00000100:00100000:3.0:1785774813.835020:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648532096:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774813.835115:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648532096:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774813.835123:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 609 00000100:00100000:3.0:1785774813.835149:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648531712 00000100:00100000:3.0:1785774813.835153:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648531712 00000100:00100000:3.0:1785774813.835221:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 554 00000100:00100000:3.0:1785774813.835228:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648531712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774813.835258:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648531712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774813.835375:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648531840 00000100:00100000:1.0:1785774813.835380:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648531840 00000100:00100000:1.0:1785774813.835431:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1014 00000100:00100000:1.0:1785774813.835439:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648531840:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774813.835473:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648531840:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774813.835480:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1014 00000100:00100000:3.0:1785774813.835622:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 554 00000100:00080000:3.0:1785774813.835654:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774813.835659:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774813.853405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774813.853473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774813.853514:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532224 00000100:00100000:3.0:1785774813.853525:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532224 00000100:00100000:3.0:1785774813.853595:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 610 00000100:00100000:3.0:1785774813.853606:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648532224:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774813.853690:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648532224:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774813.853698:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 610 00000100:00080000:3.0:1785774813.853734:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774813.854095:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648531968 00000100:00100000:0.0:1785774813.854100:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648531968 00000100:00100000:0.0:1785774813.854142:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1015 00000100:00100000:0.0:1785774813.854149:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2416:x1872519648531968:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774813.854212:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2416:x1872519648531968:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 64us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774813.854219:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1015 00000100:00080000:3.0:1785774813.854541:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00080000:1.0:1785774813.872307:0:6508:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 420 batchid updated 00000001:00080000:1.0:1785774813.872340:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983625 is committed 00000020:00080000:1.0:1785774813.872360:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 420 00000004:00080000:1.0:1785774813.872449:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b773bb70e40 with version 774 00000020:00080000:1.0:1785774813.872463:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 415 cancel update log [0x240000401:0x3:0x0].403: rc = 0 00000020:00080000:1.0:1785774813.872558:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 415 cancel update log [0x200000400:0x3:0x0].403: rc = 0 00000004:00080000:1.0:1785774813.872585:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b773bb70480 with version 775 00000020:00080000:1.0:1785774813.872589:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 416 cancel update log [0x240000401:0x3:0x0].404: rc = 0 00000020:00080000:1.0:1785774813.872612:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 416 cancel update log [0x200000400:0x3:0x0].404: rc = 0 00000004:00080000:1.0:1785774813.872631:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b773bb70900 with version 776 00000020:00080000:1.0:1785774813.872634:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 417 cancel update log [0x240000401:0x3:0x0].405: rc = 0 00000020:00080000:1.0:1785774813.872652:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 417 cancel update log [0x200000400:0x3:0x0].405: rc = 0 00000004:00080000:1.0:1785774813.872672:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b773bb70a80 with version 777 00000020:00080000:1.0:1785774813.872675:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 418 cancel update log [0x240000401:0x3:0x0].406: rc = 0 00000020:00080000:1.0:1785774813.872690:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 418 cancel update log [0x200000400:0x3:0x0].406: rc = 0 00000004:00080000:1.0:1785774813.872706:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b773bb70b40 with version 778 00000020:00080000:1.0:1785774813.872723:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 419 cancel update log [0x240000401:0x3:0x0].407: rc = 0 00000020:00080000:1.0:1785774813.872743:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 419 cancel update log [0x200000400:0x3:0x0].407: rc = 0 00000004:00080000:1.0:1785774813.872780:0:6562:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9b760632b900 with version 779 00000020:00080000:1.0:1785774813.872784:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 420 cancel update log [0x240000401:0x3:0x0].408: rc = 0 00000020:00080000:1.0:1785774813.872804:0:6562:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 420 cancel update log [0x200000400:0x3:0x0].408: rc = 0 00000020:00080000:1.0:1785774813.872811:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 420 00000004:00080000:1.0:1785774813.872822:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 774 rpc_version 774 00000020:00100000:1.0:1785774813.872866:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774813.872882:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7735aa8000 x1872519671287936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774813.872911:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671287936:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.873001:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774813.873057:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7707e8f240 going to sleep for 11 seconds 00000100:00100000:3.0:1785774813.873884:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671287936 00000100:00100000:3.0:1785774813.873895:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671287936 00000100:00100000:3.0:1785774813.873966:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:3.0:1785774813.873976:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:7689:x1872519671287936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774813.874155:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671287936:12345-0@lo:1000:osp_up1-0.0 Request processed in 181us (1154us total) trans 4294968542 rc 0/0 00000100:00100000:3.0:1785774813.874181:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000004:00080000:3.0:1785774813.874648:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 7 committed 00010000:00010000:3.0:1785774813.874687:0:7462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774813.875418:0:7462:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.875518:0:7462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.875525:0:7462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785774813.875550:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b773c35a000/0x7b7109e1d09fc7b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d09fc82 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774813.875574:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968541 is committed 00000004:00080000:3.0:1785774813.875594:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 6 committed 00000004:00080000:3.0:1785774813.875601:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 5 committed 00000100:00100000:1.0:1785774813.875973:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671287936:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1785774813.875989:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 775 rpc_version 775 00000020:00100000:1.0:1785774813.876007:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774813.876014:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7735aa8700 x1872519671288704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774813.876031:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671288704:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.876091:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774813.876125:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77062b5cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1785774813.876145:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.876153:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.876182:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774813.877393:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671288192:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1785774813.877583:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671288064:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1785774813.877625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785774813.877857:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35aa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774813.877863:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877875:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877893:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x391d5834 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774813.877897:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774813.877903:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877909:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fb40 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877936:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877943:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877949:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877960:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774813.877962:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877968:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877975:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xdcc87686 (ffff9b7605dfe200) 00010000:00010000:1.0:1785774813.877978:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774813.877981:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.877987:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fb78 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878002:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878008:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878013:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878018:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774813.878021:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878026:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878037:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x18618557 (ffff9b77199f5d00) 00010000:00010000:1.0:1785774813.878040:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774813.878043:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878049:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fbb0 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878084:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878090:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878096:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878101:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774813.878104:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878110:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878118:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xbc0ca3a9 (ffff9b7702bc0900) 00010000:00010000:1.0:1785774813.878120:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774813.878124:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878130:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fbe8 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878145:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878151:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878157:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878197:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774813.878200:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878206:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878214:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x84832a57 (ffff9b7605fcc000) 00010000:00010000:1.0:1785774813.878217:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774813.878219:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878225:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d09fc20 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878240:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878246:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878252:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.878258:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774813.878261:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774813.878395:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774813.878998:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671288320:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1785774813.879030:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774813.879050:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671289088:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1785774813.879090:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774813.879115:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774813.879122:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671288448:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1785774813.879143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774813.879220:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671288704 00000100:00100000:3.0:1785774813.879228:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671288704 00000100:00100000:2.0:1785774813.879570:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671288832:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1785774813.879601:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774813.879621:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774813.879626:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671288960:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1785774813.879644:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774813.879668:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671288192 00000100:00100000:2.0:1785774813.879672:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671288192 00000100:00100000:0.0:1785774813.879860:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671288320 00000100:00100000:0.0:1785774813.879865:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671288320 00000100:00100000:0.0:1785774813.879893:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671289088 00000100:00100000:0.0:1785774813.879896:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671289088 00000100:00100000:0.0:1785774813.879917:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671288448 00000100:00100000:0.0:1785774813.879921:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671288448 00000100:00100000:0.0:1785774813.879936:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671288832 00000100:00100000:0.0:1785774813.879939:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671288832 00000100:00100000:0.0:1785774813.879954:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671288960 00000100:00100000:0.0:1785774813.879957:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671288960 00000100:00100000:0.0:1785774813.879973:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229 00000100:00100000:0.0:1785774813.879984:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3654:x1872519671288192:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1785774813.880018:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2508 count 1 00010000:00010000:0.0:1785774813.880050:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880085:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 8 pid: 14722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880095:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1785774813.880100:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.880106:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880138:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 8 pid: 14722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880154:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 8 pid: 14722 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.880243:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1872519671289216:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774813.880558:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785774813.880579:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5230 00000100:00100000:0.0:1785774813.880587:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3655:x1872519671288320:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1785774813.880601:0:14530:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2507 count 1 00010000:00010000:0.0:1785774813.880614:0:14530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880628:0:14530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 8 pid: 14719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880635:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1785774813.880638:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.880642:0:14530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880663:0:14530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 8 pid: 14719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.880673:0:14530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 8 pid: 14719 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.880684:0:14530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14530:1872519671289344:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774813.880722:0:14530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774813.880742:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5231 00000100:00100000:0.0:1785774813.880750:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3655:x1872519671289088:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1785774813.880955:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232 00000100:00100000:2.0:1785774813.880964:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3655:x1872519671288448:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1785774813.880978:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2509 count 1 00010000:00010000:2.0:1785774813.880992:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.881005:0:14722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.881011:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1785774813.881014:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774813.881018:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.881039:0:14722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.881049:0:14722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 8 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774813.881070:0:14722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14722:1872519671289472:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774813.881099:0:14722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b760263bf00 going to sleep for 11 seconds 00000100:00080000:2.0:1785774813.881200:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785774813.881205:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774813.884577:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:3.0:1785774813.884604:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7689:x1872519671288704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774813.884860:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671288704:12345-0@lo:1000:osp_up1-0.0 Request processed in 269us (8767us total) trans 4294968543 rc 0/0 00000100:00100000:3.0:1785774813.884868:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:3.0:1785774813.884908:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233 00000100:00100000:3.0:1785774813.884917:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671288832:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1785774813.884938:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2504 count 1 00010000:00010000:3.0:1785774813.884964:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.884988:0:8661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 11 pid: 14530 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.884998:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=11s v=(0 0) 00010000:00010000:3.0:1785774813.885003:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774813.885007:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.885042:0:8661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 11 pid: 14530 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.885055:0:8661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 11 pid: 14530 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774813.885088:0:8661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8661:1872519671289600:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774813.885149:0:8661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1785774813.885190:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234 00000100:00100000:3.0:1785774813.885198:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3653:x1872519671288960:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1785774813.885212:0:14729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2506 count 1 00010000:00010000:3.0:1785774813.885224:0:14729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.885236:0:14729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 11 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.885243:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1785774813.885246:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774813.885250:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.885271:0:14729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 11 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774813.885280:0:14729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 11 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774813.885289:0:14729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14729:1872519671289728:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774813.885401:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.885421:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0xb62e0cbf (ffff9b7605dfea00) 00010000:00010000:1.0:1785774813.885425:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774813.885431:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.885439:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fc58 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774813.885616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671288064 00000100:00100000:1.0:1785774813.885625:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671288064 00000100:00100000:1.0:1785774813.885677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1785774813.885684:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671288064:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1785774813.885694:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774813.885713:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d09fc82 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d09fc7b expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.885725:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9b7605fcc300) 00010000:00010000:1.0:1785774813.885733:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774813.885771:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671288064:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 88us (8146us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774813.885778:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1785774813.885835:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671288704:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1785774813.885849:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 776 rpc_version 776 00000020:00100000:1.0:1785774813.885867:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774813.885874:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7735aa8380 x1872519671289984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774813.885891:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671289984:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.885921:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774813.885940:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77062b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774813.885969:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671288064:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1785774813.885994:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671289984 00000100:00100000:1.0:1785774813.885997:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671289984 00000100:00100000:1.0:1785774813.886022:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1785774813.886027:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7689:x1872519671289984:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.886142:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671289984:12345-0@lo:1000:osp_up1-0.0 Request processed in 113us (220us total) trans 4294968544 rc 0/0 00000100:00100000:1.0:1785774813.886149:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1785774813.886189:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa8380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671289984:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1785774813.886196:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 777 rpc_version 777 00000020:00100000:1.0:1785774813.886208:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774813.886213:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7603c5d180 x1872519671290240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774813.886226:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671290240:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.886250:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774813.886415:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671290240 00000100:00100000:2.0:1785774813.886420:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671290240 00000100:00100000:2.0:1785774813.886502:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:2.0:1785774813.886510:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7689:x1872519671290240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1785774813.886583:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671290240:12345-0@lo:1000:osp_up1-0.0 Request processed in 74us (332us total) trans 4294968545 rc 0/0 00000100:00100000:2.0:1785774813.886593:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00002000:00080000:0.0:1785774813.886782:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2508 count 1 00010000:00010000:0.0:1785774813.886801:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.886820:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 11 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.886829:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1785774813.886833:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.886837:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.886859:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 11 pid: 14729 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.886871:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 11 pid: 14729 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.886882:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1872519671290368:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774813.886926:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebb600 going to sleep for 11 seconds 00000100:00100000:1.0:1785774813.889538:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77062b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774813.889587:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671290240:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1785774813.889601:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 778 rpc_version 778 00000020:00100000:1.0:1785774813.889627:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1785774813.889633:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b7605c95180 x1872519671290624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785774813.889652:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671290624:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.889704:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774813.890071:0:14729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4db40 going to sleep for 11 seconds 00000100:00100000:1.0:1785774813.890187:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b77062b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774813.890208:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671290624 00000100:00100000:1.0:1785774813.890214:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671290624 00000100:00100000:1.0:1785774813.891251:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:1.0:1785774813.891279:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7689:x1872519671290624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.891500:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671290624:12345-0@lo:1000:osp_up1-0.0 Request processed in 237us (1795us total) trans 4294968546 rc 0/0 00000100:00100000:3.0:1785774813.891622:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671290624:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1785774813.891632:0:7689:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b7712d14d80 version 779 rpc_version 779 00000020:00100000:3.0:1785774813.891653:0:7689:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774813.891659:0:7689:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760474ea00 x1872519671290880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774813.891677:0:7689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671290880:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1785774813.891724:0:7689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774813.891741:0:7689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774813.893431:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671290880 00000100:00100000:0.0:1785774813.893451:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671290880 00000100:00100000:1.0:1785774813.897892:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:0.0:1785774813.898046:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1785774813.898076:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7689:x1872519671290880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1785774813.898550:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7689:x1872519671290880:12345-0@lo:1000:osp_up1-0.0 Request processed in 493us (6824us total) trans 4294968547 rc 0/0 00000100:00100000:0.0:1785774813.898558:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1785774813.898866:0:7689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7689:1872519671290880:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1785774813.914478:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1872519671289216:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774813.914478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774813.914501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:1.0:1785774813.914514:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.914553:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1872519671290368:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774813.914568:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.914599:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532480 00000100:00100000:0.0:1785774813.914606:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532480 00000100:00100000:2.0:1785774813.914643:0:8661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8661:1872519671289600:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774813.914651:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 12 pid: 14530 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.914658:0:8661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774813.914685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532608 00000100:00100000:2.0:1785774813.914689:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532608 00000100:00100000:0.0:1785774813.914694:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1667 00000100:00100000:0.0:1785774813.914702:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648532480:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774813.914705:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 13 pid: 14729 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.914723:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1785774813.914727:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1668 00010000:00010000:0.0:1785774813.914729:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 13 pid: 14530 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774813.914733:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648532608:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774813.914740:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774813.914743:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 13 pid: 14530 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.914745:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 13 pid: 14729 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.914754:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 13 pid: 14729 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.914774:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f280ab/0x7b7109e1d09fa6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1ca expref: 13 pid: 14729 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.914774:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d09f088 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259bf4d expref: 13 pid: 14530 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.914793:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.914793:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774813.914799:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.914799:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774813.914806:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.914806:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.914819:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.914820:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.914842:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774813.914842:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774813.914896:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648532480:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 194us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774813.914903:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1667 00000100:00100000:2.0:1785774813.924579:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648532608:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 9825us (10055us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774813.924599:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1668 00000100:00100000:2.0:1785774813.924697:0:14722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14722:1872519671289472:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774813.924731:0:14722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.924771:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.924781:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.924795:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.924804:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.924824:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774813.925086:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3655:x1872519671289088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 44336us (45993us total) trans 4294969893 rc 0/0 00000100:00100000:2.0:1785774813.925096:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5231 00000100:00100000:2.0:1785774813.925142:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969887 gen 2 00000004:00080000:2.0:1785774813.925149:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471ca80, transno 4294969887 00000100:00100000:2.0:1785774813.925181:0:3655:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b773fb4ad80 x1872519671289088/t4294969893(4294969893) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774829 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1785774813.925206:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb4ad80/2, rc 0, transno 4294969893 00000100:00100000:2.0:1785774813.925212:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671289088:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1785774813.925342:0:8661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925352:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925361:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925370:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925386:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774813.925471:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3653:x1872519671288832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 40555us (45868us total) trans 4294969894 rc 0/0 00000100:00100000:2.0:1785774813.925478:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233 00010000:00010000:2.0:1785774813.925500:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774813.925507:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925517:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774813.925521:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925530:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925554:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925563:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084080eda/0x7b7109e1d09fcd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925581:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774813.925584:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925591:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774813.925594:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925600:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925611:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925619:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005455c973/0x7b7109e1d09fcc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.925631:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774813.925633:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774813.925635:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774813.925657:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603d7aa00/2, rc 0, transno 4294969894 00000100:00100000:2.0:1785774813.925667:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671288832:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1785774813.926649:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774813.926899:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774813.926927:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774813.926968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774813.926993:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532736 00000100:00100000:0.0:1785774813.927006:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532736 00010000:00010000:0.0:1785774813.927040:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 9 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.927078:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532864 00000100:00100000:0.0:1785774813.927081:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532864 00010000:00010000:0.0:1785774813.927096:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 10 pid: 14719 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.927110:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532992 00000100:00100000:0.0:1785774813.927113:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532992 00010000:00010000:0.0:1785774813.927125:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 10 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.927140:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1669 00000100:00100000:0.0:1785774813.927150:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648532736:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774813.927198:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774813.927206:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 10 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927218:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 10 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927242:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b91ad16/0x7b7109e1d09fa2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1b5 expref: 10 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927259:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.927264:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.927272:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927283:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774813.927289:0:14530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14530:1872519671289344:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774813.927306:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774813.927316:0:14530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.927343:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648532736:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 194us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774813.927351:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1669 00000100:00100000:0.0:1785774813.927368:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1670 00000100:00100000:0.0:1785774813.927374:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7707d73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648532864:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774813.927386:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774813.927391:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 8 pid: 14719 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927402:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 8 pid: 14719 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927415:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023490bb6/0x7b7109e1d09f9f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1a0 expref: 8 pid: 14719 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927425:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.927429:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.927551:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927559:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927583:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774813.927605:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7707d73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2417:x1872519648532864:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 231us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774813.927612:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1670 00000100:00100000:0.0:1785774813.927655:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1671 00000100:00100000:0.0:1785774813.927661:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2419:x1872519648532992:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774813.927670:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774813.927676:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 10 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927687:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 10 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927701:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.927704:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.927709:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927718:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927730:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774813.927747:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2419:x1872519648532992:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 86us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774813.927755:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1671 00010000:00010000:0.0:1785774813.927787:0:14729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdfaadf8/0x7b7109e1d09f1ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c00a expref: 9 pid: 8445 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.927811:0:14729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14729:1872519671289728:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774813.927820:0:14530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927825:0:14729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.927830:0:14530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927834:0:14729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.927841:0:14530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927842:0:14729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.927850:0:14530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927851:0:14729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.927858:0:14729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.927868:0:14530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774813.928043:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3655:x1872519671288320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 47457us (49011us total) trans 4294969896 rc 0/0 00000100:00100000:1.0:1785774813.928050:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5230 00000100:00100000:2.0:1785774813.928185:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969889 gen 2 00000004:00080000:2.0:1785774813.928201:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76056d4380, transno 4294969888 00000004:00080000:2.0:1785774813.928213:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76056d5500, transno 4294969889 00000100:00100000:2.0:1785774813.928220:0:3655:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b7603d7ad80 x1872519671288320/t4294969896(4294969896) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774829 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1785774813.928230:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603d7ad80/2, rc 0, transno 4294969896 00000100:00100000:2.0:1785774813.928234:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671288320:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1785774813.928553:0:14722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.928564:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.928572:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774813.928580:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774813.931950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:0.0:1785774813.932306:0:14729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1785774813.932712:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648532352 00000100:00100000:0.0:1785774813.932723:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648532352 00010000:00010000:0.0:1785774813.932768:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 7 pid: 14722 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774813.932812:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1672 00000100:00100000:0.0:1785774813.932822:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648532352:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774813.932839:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774813.932845:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 7 pid: 14722 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.932860:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 7 pid: 14722 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.932891:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d21ca8a/0x7b7109e1d09fac2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c1fb expref: 7 pid: 14722 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.932909:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.932915:0:19895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774813.932921:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.932932:0:19895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774813.932961:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774813.933013:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648532352:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 192us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774813.933022:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1672 00010000:00010000:1.0:1785774813.933184:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785774813.933204:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933213:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774813.933218:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933230:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933244:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933253:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c4999fc/0x7b7109e1d09fcba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933460:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774813.933467:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933475:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774813.933478:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933487:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933499:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933506:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087442b5d/0x7b7109e1d09fccf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933522:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774813.933526:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933533:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774813.933536:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933543:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933551:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933558:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933560:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933561:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933575:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933583:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933591:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933598:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933613:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774813.933675:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3653:x1872519671288960:12345-0@lo:6:osp-syn-0-1.0 Request processed in 48476us (54028us total) trans 4294969895 rc 0/0 00000100:00100000:0.0:1785774813.933684:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234 00000100:00100000:1.0:1785774813.933710:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3654:x1872519671288192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 53729us (55315us total) trans 4294969897 rc 0/0 00000100:00100000:1.0:1785774813.933721:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229 00010000:00010000:1.0:1785774813.933746:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774813.933750:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933757:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774813.933760:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933767:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933778:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933784:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008096aa70/0x7b7109e1d09fcb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774813.933809:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933811:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933812:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933818:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933819:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.933820:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1785774813.934130:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603d7a300/2, rc 0, transno 4294969895 00000100:00100000:3.0:1785774813.934152:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671288960:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1785774813.934273:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c95880/2, rc 0, transno 4294969897 00000100:00100000:3.0:1785774813.934279:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671288192:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1785774813.934627:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785774813.934635:0:14722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c0c4a8f/0x7b7109e1d09fcc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774813.934739:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3655:x1872519671288448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 53777us (55595us total) trans 4294969898 rc 0/0 00000100:00100000:2.0:1785774813.934747:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232 00000004:00080000:3.0:1785774813.934827:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603d78380/2, rc 0, transno 4294969898 00000100:00100000:3.0:1785774813.934833:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671288448:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1785774813.934893:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774813.989571:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774814.374456:0:8653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1056225292149ns, next at 1057225288597ns, rc = 0 00000100:00100000:1.0:1785774814.374542:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671291008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774814.374625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774814.374704:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291008 00000100:00100000:1.0:1785774814.374714:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291008 00000100:00100000:1.0:1785774814.374765:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1785774814.374773:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3656:x1872519671291008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774814.374810:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1785774814.374854:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3656:x1872519671291008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774814.374861:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1785774814.374911:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671291008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774814.375450:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671291136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774814.375484:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774814.375555:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291136 00000100:00100000:1.0:1785774814.375560:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291136 00000100:00100000:1.0:1785774814.375608:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1785774814.375615:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671291136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774814.375628:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1785774814.375662:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671291136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774814.375668:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1785774814.375696:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969892 gen 2 00000004:00080000:1.0:1785774814.375703:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969888 committed transno 4294969892 00000004:00080000:1.0:1785774814.375722:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969890 committed transno 4294969892 00000004:00080000:1.0:1785774814.375735:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969892 committed transno 4294969892 00000100:00100000:1.0:1785774814.375751:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671291136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785774814.375808:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785774815.021466:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774815.398581:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774815.398614:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671291264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774815.398709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774815.398943:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774815.398956:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671291392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774815.398992:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774815.399029:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291392 00000100:00100000:1.0:1785774815.399038:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291392 00000100:00100000:1.0:1785774815.399120:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1785774815.399132:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3656:x1872519671291392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774815.399204:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774815.399256:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3656:x1872519671291392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774815.399264:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00080000:1.0:1785774815.399301:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774815.399351:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671291392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774815.400003:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291264 00000100:00100000:3.0:1785774815.400024:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291264 00000100:00100000:3.0:1785774815.400088:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:3.0:1785774815.400096:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:3653:x1872519671291264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1785774815.400136:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445089280 avail 1298849792 00000100:00100000:3.0:1785774815.400229:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:3653:x1872519671291264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774815.400237:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:2.0:1785774815.400401:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671291264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774815.401393:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671291904:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401456:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774815.401497:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671292416:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401526:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774815.401562:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1785774815.401567:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671291520:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401593:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774815.401609:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671292032:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401626:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774815.401641:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671292544:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401658:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774815.401682:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292416 00000100:00100000:0.0:1785774815.401687:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292416 00000100:00100000:0.0:1785774815.401729:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1785774815.401737:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671292416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401779:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671292416:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774815.401786:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1785774815.401807:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291904 00000100:00100000:0.0:1785774815.401810:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291904 00000100:00100000:0.0:1785774815.401832:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292032 00000100:00100000:0.0:1785774815.401834:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292032 00000100:00100000:0.0:1785774815.401854:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292544 00000100:00100000:0.0:1785774815.401855:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292544 00000100:00100000:0.0:1785774815.401866:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1785774815.401871:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401896:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671291904:12345-0@lo:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774815.401902:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1785774815.401923:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1785774815.401929:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671292032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401951:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671292032:12345-0@lo:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774815.401956:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1785774815.401964:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1785774815.401969:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671292544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.401988:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671292544:12345-0@lo:400:kworker.0 Request processed in 19us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774815.401993:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1785774815.402027:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671292032:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.402036:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671292544:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.402069:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671291904:0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.402079:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671292416:0@lo:400:kworker.0 00000100:00080000:1.0:1785774815.406448:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774815.406731:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671291776:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.406826:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774815.406884:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671292288:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.406927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774815.406957:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671292800:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.406978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774815.407007:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1785774815.407014:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671291648:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407036:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774815.407065:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671292160:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774815.407102:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671292672:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774815.407201:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292288 00000100:00100000:2.0:1785774815.407211:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292288 00000100:00100000:2.0:1785774815.407268:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292800 00000100:00100000:2.0:1785774815.407272:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292800 00000100:00100000:2.0:1785774815.407315:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1785774815.407324:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3654:x1872519671292288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407384:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3654:x1872519671292288:12345-0@lo:400:kworker.0 Request processed in 60us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774815.407390:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1785774815.407407:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1785774815.407412:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671292800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407449:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671292800:12345-0@lo:400:kworker.0 Request processed in 37us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774815.407456:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1785774815.407479:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291648 00000100:00100000:2.0:1785774815.407482:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291648 00000100:00100000:2.0:1785774815.407503:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292160 00000100:00100000:2.0:1785774815.407506:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292160 00000100:00100000:2.0:1785774815.407517:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292672 00000100:00100000:2.0:1785774815.407519:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292672 00000100:00100000:2.0:1785774815.407533:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1785774815.407538:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671291648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407581:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671291648:12345-0@lo:400:kworker.0 Request processed in 42us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774815.407587:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1785774815.407599:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1785774815.407605:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671292160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407631:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671292160:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774815.407637:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1785774815.407646:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1785774815.407651:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671292672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407672:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671292672:12345-0@lo:400:kworker.0 Request processed in 20us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774815.407676:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1785774815.407728:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671291648:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407739:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671292160:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407748:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671292672:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407758:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671292288:0@lo:400:kworker.0 00000100:00100000:2.0:1785774815.407765:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969895 gen 2 00000004:00080000:2.0:1785774815.407770:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969891 committed transno 4294969895 00000004:00080000:2.0:1785774815.407792:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969893 committed transno 4294969895 00000004:00080000:2.0:1785774815.407801:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969895 committed transno 4294969895 00000100:00100000:2.0:1785774815.407811:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671292800:0@lo:400:kworker.0 00000100:00100000:3.0:1785774815.408448:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291520 00000100:00100000:3.0:1785774815.408454:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291520 00000100:00100000:3.0:1785774815.408491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1785774815.408498:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671291520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774815.408558:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671291520:12345-0@lo:400:kworker.0 Request processed in 50us (6953us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774815.408571:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00080000:1.0:1785774815.408755:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774815.408761:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774815.408763:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774815.408859:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671291776 00000100:00100000:0.0:1785774815.408864:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671291776 00000100:00100000:0.0:1785774815.408903:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:0.0:1785774815.408917:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671291776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774815.408968:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671291776:12345-0@lo:400:kworker.0 Request processed in 59us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774815.408974:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:0.0:1785774815.409006:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671291520:0@lo:400:kworker.0 00000100:00100000:1.0:1785774815.409130:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983625 gen 2 00000004:00080000:1.0:1785774815.409136:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983625 committed transno 4294983625 00000020:00080000:1.0:1785774815.409142:0:3654:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b7735a4d900 refcount 2 committed 0 result 0 batchid 407 00000020:00080000:1.0:1785774815.409147:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054ab300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7735a4d300 00000020:00080000:1.0:1785774815.409150:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].406 00000020:00080000:1.0:1785774815.409186:0:3654:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b76054ab400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7604ca2e00 00000020:00080000:1.0:1785774815.409189:0:3654:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].406 00000100:00100000:1.0:1785774815.409213:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671291776:0@lo:400:kworker.0 00000020:00080000:0.0:1785774815.409397:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 407 committed batchid 406 00000020:00080000:0.0:1785774815.409490:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 406 00000100:00100000:0.0:1785774815.909130:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671292928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774815.909277:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774815.909624:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671292928 00000100:00100000:3.0:1785774815.909634:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671292928 00000100:00100000:3.0:1785774815.909695:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1785774815.909706:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671292928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774815.909737:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774815.909794:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671292928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774815.909801:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1785774815.910201:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671292928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785774816.036485:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774817.065627:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785774817.266095:0:21238:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60i skipping SLOW test 60i 00010000:00010000:1.0:1785774818.084574:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774818.470502:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774818.470525:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671293056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774818.470591:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774818.470766:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671293056 00000100:00100000:3.0:1785774818.470774:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671293056 00000100:00100000:3.0:1785774818.470826:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:3.0:1785774818.470835:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671293056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774818.470879:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444057088 avail 1297817600 00000100:00100000:3.0:1785774818.470927:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671293056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774818.470934:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:0.0:1785774818.471073:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671293056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774818.951337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774818.951396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774818.951426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774818.951444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774818.951480:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774818.951525:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648533376 00000100:00100000:3.0:1785774818.951537:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648533376 00000100:00100000:3.0:1785774818.951605:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648533248 00000100:00100000:3.0:1785774818.951607:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648533248 00000100:00100000:3.0:1785774818.951632:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1022 00000100:00100000:3.0:1785774818.951642:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648533376:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774818.951748:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648533376:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774818.951756:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1022 00000100:00100000:3.0:1785774818.951774:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1023 00000100:00100000:3.0:1785774818.951781:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648533248:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774818.951802:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648533248:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774818.951808:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1023 00000100:00100000:3.0:1785774818.951825:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648533632 00000100:00100000:3.0:1785774818.951828:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648533632 00000100:00100000:3.0:1785774818.951853:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648533504 00000100:00100000:3.0:1785774818.951855:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648533504 00000100:00100000:3.0:1785774818.951874:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 614 00000100:00100000:3.0:1785774818.951880:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648533632:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774818.951903:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648533632:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774818.951909:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 614 00000100:00100000:3.0:1785774818.951920:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 615 00000100:00100000:3.0:1785774818.951925:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648533504:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774818.951945:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648533504:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 21us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774818.951951:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 615 00000100:00080000:3.0:1785774818.951972:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785774818.951977:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774818.951980:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774818.951982:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774818.952455:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648533120 00000100:00100000:1.0:1785774818.952460:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648533120 00000100:00100000:1.0:1785774818.952499:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 556 00000100:00100000:1.0:1785774818.952506:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648533120:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774818.952550:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648533120:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 44us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774818.952557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 556 00010000:00010000:1.0:1785774819.113342:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774819.494830:0:8653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1061345666486ns, next at 1062345662972ns, rc = 0 00000100:00100000:1.0:1785774819.494913:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774819.494939:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671293184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774819.495042:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774819.495113:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671293184 00000100:00100000:1.0:1785774819.495122:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671293184 00000100:00100000:1.0:1785774819.495216:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1785774819.495227:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3654:x1872519671293184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774819.495265:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1785774819.495318:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3654:x1872519671293184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774819.495326:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1785774819.495380:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671293184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774819.503690:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671293312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774819.503786:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785774819.503924:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774819.504082:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671293312 00000100:00100000:1.0:1785774819.504093:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671293312 00000100:00100000:1.0:1785774819.504153:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1785774819.504180:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671293312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774819.504212:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1785774819.504268:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671293312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774819.504275:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1785774819.504335:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671293312:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1785774819.507360:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 7 committed 00000020:00080000:3.0:1785774819.507391:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 407 batchid updated 00000004:00080000:3.0:1785774819.507404:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 6 committed 00000001:00080000:3.0:1785774819.507417:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968547 is committed 00000020:00080000:3.0:1785774819.507525:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 407 00000004:00080000:3.0:1785774819.507601:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7735a4d3c0 with version 778 00000020:00080000:3.0:1785774819.507611:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 407 cancel update log [0x200000401:0x3:0x0].406: rc = 0 00000100:00100000:2.0:1785774819.508086:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671293568:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1785774819.508174:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774819.508224:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774819.508231:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671293440:0@lo:6:osp-syn-0-1.0 00000100:00080000:0.0:1785774819.508467:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1785774819.509951:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 407 cancel update log [0x240000400:0x3:0x0].406: rc = 0 00000020:00080000:3.0:1785774819.509965:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 407 00000004:00080000:3.0:1785774819.509983:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 778 rpc_version 778 00000020:00100000:3.0:1785774819.510027:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774819.510038:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b760474fb80 x1872519671293824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774819.510059:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671293824:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774819.510211:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671293568 00000100:00100000:0.0:1785774819.510220:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671293568 00000100:00100000:0.0:1785774819.510280:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235 00000100:00100000:0.0:1785774819.510291:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3656:x1872519671293568:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1785774819.510325:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2509 count 1 00010000:00010000:0.0:1785774819.510354:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.510381:0:14722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 8 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.510390:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=11s v=(0 0) 00010000:00010000:0.0:1785774819.510396:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774819.510401:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.510435:0:14722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 8 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.510451:0:14722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 8 pid: 8447 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774819.510463:0:14722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14722:1872519671293952:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774819.513892:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774819.513961:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1785774819.514281:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671293824 00000100:00100000:1.0:1785774819.514292:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671293824 00000100:00100000:1.0:1785774819.514356:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1785774819.514367:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7474:x1872519671293824:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1785774819.514626:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671293824:12345-0@lo:1000:osp_up0-1.0 Request processed in 260us (742us total) trans 4294983626 rc 0/0 00000100:00100000:1.0:1785774819.514635:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1785774819.514945:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671293824:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774819.521055:0:14722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1785774819.522934:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774819.523961:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671293440 00000100:00100000:3.0:1785774819.523975:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671293440 00000100:00100000:3.0:1785774819.524047:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236 00000100:00100000:1.0:1785774819.524052:0:14722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14722:1872519671293952:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774819.524059:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3656:x1872519671293440:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1785774819.524086:0:14722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1785774819.524102:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2507 count 1 00010000:00010000:3.0:1785774819.524137:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.524156:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 8 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.524190:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=12s v=(0 0) 00010000:00010000:3.0:1785774819.524195:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774819.524200:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.524243:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 8 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.524494:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 8 pid: 14712 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774819.524512:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1872519671294080:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774819.524641:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7735a4d300 going to sleep for 11 seconds 00000001:00080000:1.0:1785774819.530700:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983626 is committed 00000100:00100000:2.0:1785774819.544080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774819.545331:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648533760 00000100:00100000:0.0:1785774819.545345:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648533760 00010000:00010000:0.0:1785774819.545401:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 9 pid: 8447 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774819.545456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1673 00000100:00100000:0.0:1785774819.545468:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648533760:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774819.545487:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774819.545493:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 9 pid: 8447 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.545521:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 9 pid: 8447 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.545552:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ed2f720/0x7b7109e1d09fb01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c210 expref: 9 pid: 8447 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774819.553833:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1872519671294080:192.168.202.31@tcp:104: 00010000:00010000:3.0:1785774819.553937:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.555326:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774819.555335:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774819.555346:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.555360:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.555399:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774819.555488:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648533760:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 10019us (11421us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774819.555501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1673 00010000:00010000:1.0:1785774819.557618:0:14722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774819.557639:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774819.557654:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774819.557670:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774819.557707:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774819.557969:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3656:x1872519671293568:12345-0@lo:6:osp-syn-0-1.0 Request processed in 47676us (49806us total) trans 4294969896 rc 0/0 00000100:00100000:1.0:1785774819.557980:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235 00000004:00080000:1.0:1785774819.558061:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760474df80/2, rc 0, transno 4294969896 00000100:00100000:1.0:1785774819.558068:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671293568:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1785774819.558134:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774819.558143:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.558153:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774819.558176:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.558197:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.558220:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.558233:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009950ac62/0x7b7109e1d09fcdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.558254:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774819.558256:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774819.558258:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774819.563723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774819.563845:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648533888 00000100:00100000:0.0:1785774819.563857:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648533888 00010000:00010000:0.0:1785774819.563906:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 8 pid: 14712 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774819.563961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1674 00000100:00100000:0.0:1785774819.563972:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648533888:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774819.563990:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774819.563997:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 8 pid: 14712 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.564023:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 8 pid: 14712 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.564053:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3ffdd6/0x7b7109e1d09f9b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c18b expref: 8 pid: 14712 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.564073:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774819.564079:0:6514:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774819.564086:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.564097:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774819.564133:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774819.564410:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774819.564423:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774819.564434:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774819.564443:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774819.564467:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774819.564696:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3656:x1872519671293440:12345-0@lo:6:osp-syn-0-1.0 Request processed in 40637us (41769us total) trans 4294969897 rc 0/0 00000100:00100000:2.0:1785774819.564707:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236 00000100:00100000:0.0:1785774819.565405:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648533888:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1431us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774819.565415:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1674 00010000:00010000:3.0:1785774819.566404:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774819.566415:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.566427:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774819.566433:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.566449:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.566469:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.566476:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fc7118c/0x7b7109e1d09fce4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774819.566499:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774819.566501:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774819.566503:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785774819.567112:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760474ca80/2, rc 0, transno 4294969897 00000100:00100000:0.0:1785774819.567121:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671293440:0@lo:6:osp-syn-0-1.0 00000001:00080000:0.0:1785774819.569627:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969896 is committed 00000001:00080000:3.0:1785774820.008143:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969898 is committed 00000001:02000400:1.0:1785774820.031874:0:21287:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60j: llog_reader reports corruptions ====== 12:33:36 (1785774816) 00010000:00010000:3.0:1785774820.132347:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774820.516669:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671294208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774820.516768:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774820.517032:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671294336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774820.517072:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774820.517137:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671294208 00000100:00100000:3.0:1785774820.517147:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671294208 00000100:00100000:3.0:1785774820.517233:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:3.0:1785774820.517257:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671294208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1785774820.517301:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445089280 avail 1298849792 00000100:00100000:3.0:1785774820.517352:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671294208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774820.517360:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:0.0:1785774820.517552:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968547 gen 2 00000004:00080000:0.0:1785774820.517559:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968542 committed transno 4294968547 00000004:00080000:0.0:1785774820.517583:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968543 committed transno 4294968547 00000004:00080000:0.0:1785774820.517610:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968544 committed transno 4294968547 00000004:00080000:0.0:1785774820.517620:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968545 committed transno 4294968547 00000004:00080000:0.0:1785774820.517630:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968546 committed transno 4294968547 00000004:00080000:0.0:1785774820.517637:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968547 committed transno 4294968547 00000100:00100000:1.0:1785774820.518566:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671294336 00000100:00100000:1.0:1785774820.518572:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671294336 00000100:00100000:1.0:1785774820.518619:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1785774820.518628:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671294336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774820.518665:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774820.518710:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671294336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774820.518717:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1785774820.518751:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969898 gen 2 00000004:00080000:1.0:1785774820.518756:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603d7ad80, transno 4294969896 00000004:00080000:1.0:1785774820.518765:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c95880, transno 4294969897 00000004:00080000:1.0:1785774820.518768:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603d78380, transno 4294969898 00000100:00100000:1.0:1785774820.518778:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671294336:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1785774820.518927:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1785774820.521707:0:9843:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1785774820.521850:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671294464:0@lo:400:kworker.0 00000100:00100000:3.0:1785774820.521946:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774820.522073:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671294464 00000100:00100000:1.0:1785774820.522082:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671294464 00000100:00100000:1.0:1785774820.522139:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1785774820.522150:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774820.524417:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671294208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774820.524482:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671294592:0@lo:400:kworker.0 00000100:00100000:0.0:1785774820.524556:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774820.524939:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671294464:12345-0@lo:400:kworker.0 Request processed in 2789us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774820.524951:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1785774820.525022:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671294592 00000100:00100000:1.0:1785774820.525030:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671294592 00000100:00100000:1.0:1785774820.525077:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1785774820.525087:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671294592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774820.525138:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671294592:12345-0@lo:400:kworker.0 Request processed in 53us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774820.525145:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1785774820.525204:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671294592:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.527564:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671295104:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.527625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.527843:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671295616:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.527867:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.527890:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785774820.527895:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671294976:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.527915:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.527937:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671295488:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.527955:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.527985:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671295104 00000100:00100000:2.0:1785774820.527992:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671295104 00000100:00100000:2.0:1785774820.528051:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671295616 00000100:00100000:2.0:1785774820.528054:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671295616 00000100:00100000:2.0:1785774820.528065:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671294976 00000100:00100000:2.0:1785774820.528067:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671294976 00000100:00100000:2.0:1785774820.528077:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671295488 00000100:00100000:2.0:1785774820.528079:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671295488 00000100:00100000:2.0:1785774820.528093:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1785774820.528099:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671295104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528152:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671295104:12345-0@lo:400:kworker.0 Request processed in 51us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.528183:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1785774820.528200:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1785774820.528206:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671295616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528233:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671295616:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.528309:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1785774820.528322:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1785774820.528328:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671294976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528358:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671294976:12345-0@lo:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.528363:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1785774820.528373:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1785774820.528389:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671295488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528413:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671295488:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.528419:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00080000:2.0:1785774820.528554:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785774820.528559:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774820.528782:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671294848:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528813:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.528832:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671295360:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528858:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.528879:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1785774820.528885:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671294720:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528910:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.528929:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671295232:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528951:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.528969:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671295744:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.528989:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774820.529028:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671295360 00000100:00100000:2.0:1785774820.529033:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671295360 00000100:00100000:2.0:1785774820.529061:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671295232 00000100:00100000:2.0:1785774820.529064:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671295232 00000100:00100000:2.0:1785774820.529081:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671295744 00000100:00100000:2.0:1785774820.529083:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671295744 00000100:00100000:2.0:1785774820.529106:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1785774820.529112:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671295360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.529150:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671295360:12345-0@lo:400:kworker.0 Request processed in 38us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.529157:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1785774820.529191:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1785774820.529198:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1872519671295232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.529222:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1872519671295232:12345-0@lo:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.529227:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1785774820.529234:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1785774820.529547:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671294848 00000100:00100000:0.0:1785774820.529553:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671294848 00000100:00100000:0.0:1785774820.529586:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1785774820.529593:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671294848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774820.529631:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671294848:12345-0@lo:400:kworker.0 Request processed in 40us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774820.529638:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1785774820.530341:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671295744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.530588:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671295744:12345-0@lo:400:kworker.0 Request processed in 42us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.530596:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1785774820.530623:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671294720 00000100:00100000:2.0:1785774820.530627:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671294720 00000100:00100000:2.0:1785774820.531351:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:2.0:1785774820.531361:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671294720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774820.531621:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671294976:0@lo:400:kworker.0 00000100:00100000:0.0:1785774820.531638:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671295488:0@lo:400:kworker.0 00000100:00100000:0.0:1785774820.531823:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671295104:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.534398:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671294720:12345-0@lo:400:kworker.0 Request processed in 3028us (5476us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774820.534414:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00080000:2.0:1785774820.534495:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774820.534550:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983626 gen 2 00000004:00080000:2.0:1785774820.534558:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983626 committed transno 4294983626 00000100:00100000:2.0:1785774820.534587:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671294720:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.534604:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969896 gen 2 00000004:00080000:2.0:1785774820.534608:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb4ad80, transno 4294969893 00000004:00080000:2.0:1785774820.534627:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603d7aa00, transno 4294969894 00000004:00080000:2.0:1785774820.534630:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603d7a300, transno 4294969895 00000004:00080000:2.0:1785774820.534632:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760474df80, transno 4294969896 00000100:00100000:2.0:1785774820.534641:0:3654:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b760474ca80 x1872519671293440/t4294969897(4294969897) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774835 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785774820.534664:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671295232:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.534681:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671295744:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.534696:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671294848:0@lo:400:kworker.0 00000100:00100000:2.0:1785774820.534710:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671295360:0@lo:400:kworker.0 00000004:00080000:1.0:1785774820.535666:0:8652:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1785774820.536374:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671295616:0@lo:400:kworker.0 00000100:00100000:3.0:1785774820.538368:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671294464:0@lo:400:kworker.0 00000100:00100000:2.0:1785774821.029376:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774821.029407:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671295872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774821.029513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774821.029591:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671295872 00000100:00100000:2.0:1785774821.029600:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671295872 00000100:00100000:2.0:1785774821.029651:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1785774821.029660:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671295872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774821.029690:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774821.029735:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671295872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774821.029742:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1785774821.029791:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671295872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785774821.158245:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785774821.958777:0:21335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:0.0:1785774822.181435:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774823.210753:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774823.591553:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774823.591585:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671296000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774823.591694:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774823.591774:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296000 00000100:00100000:0.0:1785774823.591783:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296000 00000100:00100000:0.0:1785774823.591849:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1785774823.591858:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671296000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785774823.591900:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444057088 avail 1297817600 00000100:00100000:0.0:1785774823.591948:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671296000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774823.591955:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1785774823.592028:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671296000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774824.067214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774824.067310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648534016 00000100:00100000:3.0:1785774824.067323:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648534016 00000100:00100000:3.0:1785774824.067389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 558 00000100:00100000:3.0:1785774824.067401:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648534016:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774824.067484:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648534016:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774824.067492:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 558 00000100:00100000:0.0:1785774824.077112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774824.077920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774824.078091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774824.078152:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648534528 00000100:00100000:1.0:1785774824.078180:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648534528 00000100:00100000:1.0:1785774824.078260:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 619 00000100:00100000:1.0:1785774824.078271:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648534528:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774824.078369:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648534528:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 100us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774824.078378:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 619 00000100:00080000:1.0:1785774824.078403:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774824.084731:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774824.084780:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648534400 00000100:00100000:1.0:1785774824.084792:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648534400 00000100:00100000:1.0:1785774824.084881:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 620 00000100:00100000:1.0:1785774824.084891:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648534400:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774824.084982:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648534400:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 93us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774824.084990:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 620 00000100:00080000:1.0:1785774824.085978:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774824.086994:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648534272 00000100:00100000:2.0:1785774824.087011:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648534272 00000100:00100000:2.0:1785774824.087086:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648534144 00000100:00100000:2.0:1785774824.087090:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648534144 00000100:00100000:2.0:1785774824.087117:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1030 00000100:00100000:2.0:1785774824.087126:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648534272:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774824.087207:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648534272:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 83us (10109us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774824.087214:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1030 00000100:00100000:2.0:1785774824.087228:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1031 00000100:00100000:2.0:1785774824.087233:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648534144:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774824.087255:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648534144:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (9166us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774824.087260:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1031 00000100:00080000:1.0:1785774824.087394:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774824.087399:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1785774824.230140:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774824.612508:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774824.612544:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671296128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774824.612644:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774824.612724:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296128 00000100:00100000:1.0:1785774824.612734:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296128 00000100:00100000:1.0:1785774824.612805:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1785774824.612816:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671296128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774824.612854:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774824.612908:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671296128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774824.612916:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00080000:1.0:1785774824.612940:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774824.613020:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671296128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774824.613227:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774824.613239:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671296256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774824.613274:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774824.613303:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296256 00000100:00100000:2.0:1785774824.613308:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296256 00000100:00100000:2.0:1785774824.613338:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1785774824.613344:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1872519671296256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785774824.613356:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1785774824.613390:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1872519671296256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774824.613396:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1785774824.613428:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671296256:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1785774824.615917:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774824.640364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774824.642069:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648534656 00000100:00100000:2.0:1785774824.642087:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648534656 00000100:00100000:2.0:1785774824.642185:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23888 00000100:00100000:2.0:1785774824.642210:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:19194:x1872519648534656:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774824.642241:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774824.642269:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c21e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774824.642349:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fcf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774824.642368:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774824.642381:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774824.642440:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774824.642444:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774824.642471:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774824.642498:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09fceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c21e expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774824.642516:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fcf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c21e expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774824.642525:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774824.642529:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774824.642532:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b000, rc 0) 00000100:00100000:2.0:1785774824.642621:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:19194:x1872519648534656:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 414us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774824.642630:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23888 00000100:00100000:3.0:1785774824.651726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774824.653572:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648534784 00000100:00100000:1.0:1785774824.653588:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648534784 00000100:00100000:1.0:1785774824.653781:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23889 00000100:00100000:1.0:1785774824.653795:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:19194:x1872519648534784:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774824.653836:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774824.653863:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09fcf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c225 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.653950:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.653981:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.653996:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654016:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654023:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654030:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654104:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654112:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654118:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654129:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654136:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774824.654140:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654148:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654187:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774824.654191:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774824.654196:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654204:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654215:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654222:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654228:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654234:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774824.654237:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654248:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654258:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774824.654261:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774824.654265:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654271:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654308:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09fcf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c225 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654319:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774824.654322:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774824.654325:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09fcf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c225 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774824.654334:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce000, rc 0) 00000100:00100000:1.0:1785774824.654429:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:19194:x1872519648534784:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 637us (2715us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774824.654438:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23889 00000100:00100000:0.0:1785774824.673367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774824.673415:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535040 00000100:00100000:0.0:1785774824.673427:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535040 00000100:00100000:0.0:1785774824.673497:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23890 00000100:00100000:0.0:1785774824.673507:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:19194:x1872519648535040:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1785774824.673584:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774824.673620:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fcf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c21e expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.673641:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774824.673647:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774824.673748:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.673765:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.673776:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.673794:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.673801:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.673808:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674516:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674527:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674535:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774824.674551:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007810a4be reply state 000000007c930dc1 transno 4294983627 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674563:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674570:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7602507400) 00010000:00010000:0.0:1785774824.674573:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774824.674576:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1785774824.674583:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1541:0x0]: returning size 4096 00010000:00010000:0.0:1785774824.674593:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674601:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674607:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674614:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674622:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774824.674628:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674636:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674646:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774824.674648:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774824.674652:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674659:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fd0e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774824.674682:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007810a4be reply state 000000007c930dc1 transno 4294983627 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674691:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774824.674697:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9b7602507b00) 00010000:00010000:0.0:1785774824.674699:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774824.674701:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1785774824.674802:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:19194:x1872519648535040:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 1295us (1448us total) trans 4294983627 rc 0/0 00000100:00100000:0.0:1785774824.674811:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23890 00000001:00080000:3.0:1785774825.127935:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969897 is committed 00010000:00010000:1.0:1785774825.253257:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774825.638415:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671296384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774825.638510:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774825.638629:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296384 00000100:00100000:2.0:1785774825.638637:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296384 00000100:00100000:2.0:1785774825.638693:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:2.0:1785774825.638703:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671296384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774825.638752:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1785774825.638820:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671296384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774825.638828:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:2.0:1785774825.638888:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671296384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774825.639263:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671296640:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639311:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.639339:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671297152:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639368:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.639394:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671297664:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639420:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.639446:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1785774825.639452:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671296512:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639484:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.639509:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671297024:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639550:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.639572:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671297536:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639597:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.639626:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296640 00000100:00100000:3.0:1785774825.639631:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296640 00000100:00100000:3.0:1785774825.639663:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297152 00000100:00100000:3.0:1785774825.639666:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297152 00000100:00100000:3.0:1785774825.639694:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297664 00000100:00100000:3.0:1785774825.639698:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297664 00000100:00100000:3.0:1785774825.639713:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1785774825.639720:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671296640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639764:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671296640:12345-0@lo:400:kworker.0 Request processed in 45us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.639772:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1785774825.639785:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297024 00000100:00100000:3.0:1785774825.639788:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297024 00000100:00100000:3.0:1785774825.639912:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297536 00000100:00100000:3.0:1785774825.639915:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297536 00000100:00100000:3.0:1785774825.639933:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1785774825.639939:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671297152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.639981:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671297152:12345-0@lo:400:kworker.0 Request processed in 42us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.640050:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1785774825.640063:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1785774825.640069:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671297664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.640096:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671297664:12345-0@lo:400:kworker.0 Request processed in 28us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.640101:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1785774825.640109:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1785774825.640114:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671297024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.640134:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671297024:12345-0@lo:400:kworker.0 Request processed in 21us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.640139:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1785774825.640147:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1785774825.640151:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671297536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.640203:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671297536:12345-0@lo:400:kworker.0 Request processed in 51us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.640209:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1785774825.640239:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296512 00000100:00100000:3.0:1785774825.640243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296512 00000100:00100000:3.0:1785774825.640273:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1785774825.640280:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671296512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.640313:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671296512:12345-0@lo:400:kworker.0 Request processed in 33us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.640319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00080000:3.0:1785774825.640363:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774825.640368:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774825.640383:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671296896:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.640409:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.640425:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671297408:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.640449:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.640466:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671297920:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.640486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.640504:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1785774825.640509:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671296768:0@lo:400:kworker.0 00000100:00100000:2.0:1785774825.640979:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671298048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774825.641022:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774825.641057:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298048 00000100:00100000:2.0:1785774825.641060:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298048 00000100:00100000:2.0:1785774825.641094:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1785774825.641100:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671298048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774825.641128:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774825.641180:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671298048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774825.641188:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1785774825.641230:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671298048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774825.642109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.642204:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671297280:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.642232:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.642260:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671297792:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.642283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774825.642321:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297408 00000100:00100000:3.0:1785774825.642329:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297408 00000100:00100000:3.0:1785774825.642368:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297920 00000100:00100000:3.0:1785774825.642371:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297920 00000100:00100000:3.0:1785774825.642396:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297280 00000100:00100000:3.0:1785774825.642399:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297280 00000100:00100000:3.0:1785774825.642419:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671297792 00000100:00100000:3.0:1785774825.642422:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671297792 00000100:00100000:3.0:1785774825.642445:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1785774825.642453:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671297408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.642497:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671297408:12345-0@lo:400:kworker.0 Request processed in 45us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.642505:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1785774825.642533:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1785774825.642542:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671297920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.642575:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671297920:12345-0@lo:400:kworker.0 Request processed in 35us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.642581:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1785774825.642735:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1785774825.642742:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671297280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.642770:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671297280:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.642780:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1785774825.642791:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1785774825.644192:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671297792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.644287:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671297792:12345-0@lo:400:kworker.0 Request processed in 1489us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774825.644299:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00080000:3.0:1785774825.644363:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774825.644553:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671296512:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.644573:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671297024:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.644588:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671297536:0@lo:400:kworker.0 00000100:00100000:2.0:1785774825.645268:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296896 00000100:00100000:2.0:1785774825.645279:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296896 00000100:00100000:2.0:1785774825.645337:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1785774825.645344:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671296896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.645460:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671296640:0@lo:400:kworker.0 00000100:00100000:0.0:1785774825.650862:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671296768 00000100:00100000:0.0:1785774825.650886:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671296768 00000100:00100000:0.0:1785774825.650978:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1785774825.654732:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671296768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774825.655005:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671296896:12345-0@lo:400:kworker.0 Request processed in 9657us (14590us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774825.655021:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1785774825.657861:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969897 gen 2 00000004:00080000:2.0:1785774825.657875:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760474ca80, transno 4294969897 00000100:00100000:2.0:1785774825.657909:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671297280:0@lo:400:kworker.0 00000100:00100000:2.0:1785774825.657929:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671297792:0@lo:400:kworker.0 00000100:00100000:2.0:1785774825.657957:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671296896:0@lo:400:kworker.0 00000100:00100000:2.0:1785774825.657975:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671297408:0@lo:400:kworker.0 00000100:00100000:2.0:1785774825.658001:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671297920:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.661297:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671297152:0@lo:400:kworker.0 00000100:00100000:3.0:1785774825.661325:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671297664:0@lo:400:kworker.0 00000100:00100000:0.0:1785774825.664651:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671296768:12345-0@lo:400:kworker.0 Request processed in 13653us (22532us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774825.664670:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:2.0:1785774825.664849:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671296768:0@lo:400:kworker.0 00000100:00100000:2.0:1785774826.159632:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671298176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774826.159743:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774826.159927:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298176 00000100:00100000:3.0:1785774826.159939:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298176 00000100:00100000:3.0:1785774826.160020:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1785774826.160032:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671298176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774826.160062:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774826.160120:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671298176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774826.160128:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1785774826.166447:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671298176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774826.277344:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774827.305908:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785774827.817648:0:21530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:3.0:1785774828.325690:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774828.708447:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671298304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774828.708548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774828.709378:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298304 00000100:00100000:0.0:1785774828.709390:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298304 00000100:00100000:0.0:1785774828.709454:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1785774828.709464:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671298304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785774828.709513:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444052992 avail 1297813504 00000100:00100000:0.0:1785774828.710380:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671298304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 915us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774828.710389:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1785774828.711759:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671298304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774829.191686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774829.191965:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535168 00000100:00100000:3.0:1785774829.191978:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535168 00000100:00100000:3.0:1785774829.192052:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 560 00000100:00100000:3.0:1785774829.192064:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648535168:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774829.192184:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648535168:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 100us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774829.192301:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 560 00000100:00100000:0.0:1785774829.222131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774829.223331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774829.223349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774829.223439:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535552 00000100:00100000:1.0:1785774829.223452:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535552 00000100:00100000:1.0:1785774829.223527:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 625 00000100:00100000:1.0:1785774829.223539:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648535552:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774829.223635:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648535552:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 98us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774829.223643:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 625 00000100:00080000:1.0:1785774829.223667:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774829.234828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774829.234872:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535680 00000100:00100000:1.0:1785774829.234884:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535680 00000100:00100000:1.0:1785774829.234985:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 626 00000100:00100000:1.0:1785774829.235000:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648535680:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774829.235095:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648535680:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 100us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774829.235103:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 626 00000100:00080000:1.0:1785774829.235128:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774829.242411:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535296 00000100:00100000:2.0:1785774829.242430:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535296 00000100:00100000:1.0:1785774829.243792:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535424 00000100:00080000:2.0:1785774829.244975:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774829.245102:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535424 00000100:00100000:1.0:1785774829.245184:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1038 00000100:00100000:1.0:1785774829.246085:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648535296:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774829.246406:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1039 00000100:00100000:3.0:1785774829.246419:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648535424:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774829.246475:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648535424:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 61us (23125us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774829.246483:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1039 00000100:00100000:1.0:1785774829.247019:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648535296:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1824us (24901us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774829.247027:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1038 00000100:00080000:2.0:1785774829.247374:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1785774829.374971:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1785774829.390448:0:21578:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffd9808dc90 00000004:00000080:2.0:1785774829.390473:0:21578:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9b773fb7b800 uarg=0000000000000000 00000004:00000080:2.0:1785774829.390541:0:21578:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9b773fb7b800 00000040:00080000:2.0:1785774829.390895:0:21578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785774829.391112:0:21578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1785774829.391264:0:21578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 80 off8272 00000004:00000080:2.0:1785774829.391289:0:21578:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:2.0:1785774829.391293:0:21578:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:2.0:1785774829.733047:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671298432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774829.733150:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774829.734723:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298432 00000100:00100000:2.0:1785774829.734736:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298432 00000100:00100000:2.0:1785774829.734822:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1785774829.735329:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671298432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785774829.735371:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1785774829.735453:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671298432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774829.735463:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1785774829.735500:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671298560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774829.735542:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1785774829.737344:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774829.737368:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298560 00000100:00100000:2.0:1785774829.737379:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298560 00000100:00100000:2.0:1785774829.737436:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1785774829.737446:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671298560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774829.737474:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1785774829.737546:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671298560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774829.737554:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00080000:2.0:1785774829.739770:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774829.740657:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671298560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774829.740713:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671298432:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1785774830.260429:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983627 is committed 00010000:00010000:3.0:1785774830.260498:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260514:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260523:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260529:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774830.260534:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260547:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260581:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9b7602507b00) 00010000:00010000:3.0:1785774830.260584:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774830.260590:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260596:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09fd15 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260635:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260641:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260646:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260651:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774830.260653:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260659:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260666:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7602507400) 00010000:00010000:3.0:1785774830.260669:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774830.260671:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774830.260677:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09fd1c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774830.390435:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774830.757764:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671298688:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.757888:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.757960:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671299200:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.757990:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.758013:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671299712:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758038:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.758053:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671300224:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758072:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.758098:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1785774830.758105:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671299072:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758133:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.758150:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671299584:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758195:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.758211:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671300096:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758228:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298688 00000100:00100000:1.0:1785774830.758238:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298688 00000100:00100000:2.0:1785774830.758244:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.758274:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671298816:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758294:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1785774830.758298:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774830.758304:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671298688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758312:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671299328:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758331:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774830.758346:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671299840:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758363:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671298688:12345-0@lo:400:kworker.0 Request processed in 60us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.758365:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774830.758371:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1785774830.758379:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671300352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774830.758401:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774830.758412:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299072 00000100:00100000:1.0:1785774830.758415:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299072 00000100:00100000:2.0:1785774830.758419:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1785774830.758424:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671298944:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758444:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298816 00000100:00100000:2.0:1785774830.758446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774830.758446:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298816 00000100:00100000:1.0:1785774830.758458:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299328 00000100:00100000:1.0:1785774830.758461:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299328 00000100:00100000:2.0:1785774830.758463:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671299456:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758484:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299840 00000100:00100000:2.0:1785774830.758485:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774830.758487:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299840 00000100:00100000:2.0:1785774830.758496:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671299968:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758498:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299456 00000100:00100000:1.0:1785774830.758500:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299456 00000100:00100000:1.0:1785774830.758513:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1785774830.758516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774830.758520:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671299072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758541:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299200 00000100:00100000:2.0:1785774830.758545:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299200 00000100:00100000:1.0:1785774830.758552:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671299072:12345-0@lo:400:kworker.0 Request processed in 33us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774830.758558:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1785774830.758568:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299968 00000100:00100000:1.0:1785774830.758570:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299968 00000100:00100000:2.0:1785774830.758572:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671298944 00000100:00100000:2.0:1785774830.758574:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671298944 00000100:00100000:1.0:1785774830.758585:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1785774830.758590:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671298816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758596:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1785774830.758601:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671299200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758621:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671298816:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.758648:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671299200:12345-0@lo:400:kworker.0 Request processed in 46us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.758654:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1785774830.758667:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:2.0:1785774830.758674:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671298944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758693:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1785774830.758702:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671298944:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774830.758706:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1785774830.758708:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1785774830.758711:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671299328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758727:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299712 00000100:00100000:2.0:1785774830.758730:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299712 00000100:00100000:1.0:1785774830.758743:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671299328:12345-0@lo:400:kworker.0 Request processed in 32us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774830.758749:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1785774830.758754:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300224 00000100:00100000:2.0:1785774830.758756:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300224 00000100:00100000:1.0:1785774830.758759:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1785774830.758764:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671299840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758773:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671299584 00000100:00100000:2.0:1785774830.758776:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671299584 00000100:00100000:1.0:1785774830.758789:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671299840:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.758792:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300096 00000100:00100000:2.0:1785774830.758794:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300096 00000100:00100000:1.0:1785774830.758795:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1785774830.758805:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1785774830.758810:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671299456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758813:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1785774830.758818:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671299712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758850:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671299712:12345-0@lo:400:kworker.0 Request processed in 31us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.758856:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1785774830.758868:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1785774830.758874:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671300224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758912:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671300224:12345-0@lo:400:kworker.0 Request processed in 38us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774830.758912:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671299456:12345-0@lo:400:kworker.0 Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.758920:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1785774830.758920:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1785774830.758933:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1785774830.758933:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1785774830.758940:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671299584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.758940:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671299968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.758966:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671299584:12345-0@lo:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774830.758966:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671299968:12345-0@lo:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.758973:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1785774830.758973:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1785774830.758983:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1785774830.758988:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671300096:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785774830.758994:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774830.758999:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774830.759001:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774830.759012:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671300096:12345-0@lo:400:kworker.0 Request processed in 24us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.759018:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1785774830.759034:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300352 00000100:00100000:1.0:1785774830.759035:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671298944:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.759037:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300352 00000100:00100000:1.0:1785774830.759047:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671299456:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759055:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671299968:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.759058:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1785774830.759064:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671300352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774830.759066:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671298816:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759074:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671299328:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759082:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671299840:0@lo:400:kworker.0 00002000:00000024:2.0:1785774830.759087:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774830.759117:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671299072:0@lo:400:kworker.0 00000100:00100000:2.0:1785774830.759121:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671300352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774830.759127:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1785774830.759271:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671299584:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759285:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671300096:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759294:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671298688:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759303:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671299200:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759311:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671299712:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759320:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671300224:0@lo:400:kworker.0 00000100:00100000:1.0:1785774830.759354:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671300352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774830.760433:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774830.760447:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671300480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774830.760489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774830.760525:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300480 00000100:00100000:1.0:1785774830.760531:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300480 00000100:00100000:1.0:1785774830.760565:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:1.0:1785774830.760573:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671300480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774830.760606:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1785774830.761319:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671300480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 745us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774830.761330:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:1.0:1785774830.761379:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671300480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774831.275234:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671300608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774831.275349:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774831.288517:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300608 00000100:00100000:0.0:1785774831.288538:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300608 00000100:00100000:0.0:1785774831.288622:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1785774831.288644:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671300608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774831.288681:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774831.288770:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671300608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (13420us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774831.288778:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1785774831.289060:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671300608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785774831.396412:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774832.421062:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785774832.438901:0:21675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:1.0:1785774833.451590:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774833.828730:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671300736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774833.828823:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774833.828948:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300736 00000100:00100000:0.0:1785774833.828959:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300736 00000100:00100000:0.0:1785774833.829021:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:0.0:1785774833.829030:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671300736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785774833.829074:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444020224 avail 1297780736 00000100:00100000:0.0:1785774833.829129:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671300736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774833.829136:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:0.0:1785774833.829208:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671300736:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1785774834.166452:0:21723:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffdc1d73c30 00000004:00000080:3.0:1785774834.166476:0:21723:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=424066b1 len=576 karg=ffff9b771189d400 uarg=0000000000000000 00000004:00000080:3.0:1785774834.166659:0:21723:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b1 len=576 karg=ffff9b771189d400 00000040:00080000:3.0:1785774834.167041:0:21723:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785774834.167289:0:21723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1785774834.167438:0:21723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:3.0:1785774834.167459:0:21723:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0001: registered changelog user 'cl1', mask 0x0 00000004:02000000:3.0:1785774834.167463:0:21723:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0001: changelog on 00000100:00100000:1.0:1785774834.324323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774834.324474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535808 00000100:00100000:0.0:1785774834.324488:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535808 00000100:00100000:0.0:1785774834.324570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 562 00000100:00100000:0.0:1785774834.324581:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648535808:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774834.324667:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648535808:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774834.324675:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 562 00000100:00100000:1.0:1785774834.324836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774834.325499:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648535936 00000100:00100000:0.0:1785774834.325506:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648535936 00000100:00100000:0.0:1785774834.325578:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1046 00000100:00100000:0.0:1785774834.325586:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648535936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774834.325633:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648535936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 49us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774834.325641:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1046 00000100:00080000:1.0:1785774834.325878:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774834.330835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774834.330898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774834.330982:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774834.331024:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648536064 00000100:00100000:2.0:1785774834.331036:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648536064 00000100:00100000:2.0:1785774834.331119:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1047 00000100:00100000:2.0:1785774834.331130:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648536064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774834.331249:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648536064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 121us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774834.331258:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1047 00000100:00080000:2.0:1785774834.331287:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774834.346465:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648536320 00000100:00100000:0.0:1785774834.346483:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648536320 00000100:00100000:0.0:1785774834.346589:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648536192 00000100:00100000:0.0:1785774834.346593:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648536192 00000100:00100000:0.0:1785774834.346625:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 631 00000100:00100000:0.0:1785774834.346639:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648536320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774834.346757:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648536320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 121us (15858us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774834.346765:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 631 00000100:00100000:0.0:1785774834.346785:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 632 00000100:00100000:0.0:1785774834.346790:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648536192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774834.346813:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648536192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (15832us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774834.346819:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 632 00000100:00080000:2.0:1785774834.347075:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785774834.347080:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785774834.480333:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774834.855188:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671300864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774834.855293:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774834.855623:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300864 00000100:00100000:2.0:1785774834.855634:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300864 00000100:00100000:2.0:1785774834.855712:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1785774834.855733:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671300864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785774834.855772:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1785774834.855829:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671300864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774834.855838:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1785774834.855911:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671300864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774834.856622:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774834.856632:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671300992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774834.856663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774834.856698:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671300992 00000100:00100000:1.0:1785774834.856702:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671300992 00000100:00100000:1.0:1785774834.856743:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1785774834.856749:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671300992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774834.856761:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774834.856791:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671300992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774834.856797:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1785774834.856824:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671300992:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785774834.857535:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785774835.492521:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774835.877036:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671301120:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877108:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774835.877156:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671301632:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877204:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774835.877224:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671302144:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877245:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774835.877261:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671302656:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877278:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774835.877304:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1785774835.877310:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671301248:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877333:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774835.877372:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671301760:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877393:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774835.877409:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671302272:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877427:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774835.877455:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671301120 00000100:00100000:2.0:1785774835.877462:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671301120 00000100:00100000:2.0:1785774835.877505:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1785774835.877525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671301120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671301120:12345-0@lo:400:kworker.0 Request processed in 58us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.877576:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1785774835.877618:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671301632 00000100:00100000:2.0:1785774835.877622:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671301632 00000100:00100000:2.0:1785774835.877648:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:2.0:1785774835.877654:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671301632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877688:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671301632:12345-0@lo:400:kworker.0 Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.877697:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:2.0:1785774835.877715:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302144 00000100:00100000:2.0:1785774835.877718:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302144 00000100:00100000:2.0:1785774835.877742:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302656 00000100:00100000:2.0:1785774835.877744:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302656 00000100:00100000:2.0:1785774835.877767:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1785774835.877773:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671302144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877801:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671302144:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.877807:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1785774835.877817:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1785774835.877823:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671302656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.877847:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671302656:12345-0@lo:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.877867:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1785774835.878491:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671301376:0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.878532:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774835.878552:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671301888:0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.878582:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774835.878604:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671302400:0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.878638:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671301504:0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.878669:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774835.878701:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671302016:0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.878729:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774835.878737:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774835.878759:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671302528:0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.878784:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774835.878805:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774835.878812:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671302912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774835.878816:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671301376 00000100:00100000:1.0:1785774835.878821:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671301376 00000100:00100000:0.0:1785774835.878838:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774835.878893:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671301248 00000100:00100000:0.0:1785774835.878897:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671301248 00000100:00100000:0.0:1785774835.878917:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671301760 00000100:00100000:0.0:1785774835.878920:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671301760 00000100:00100000:0.0:1785774835.878942:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302272 00000100:00100000:0.0:1785774835.878945:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302272 00000100:00100000:0.0:1785774835.878955:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671301888 00000100:00100000:0.0:1785774835.878957:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671301888 00000100:00100000:0.0:1785774835.878967:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671301504 00000100:00100000:0.0:1785774835.878969:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671301504 00000100:00100000:0.0:1785774835.878977:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302400 00000100:00100000:0.0:1785774835.878980:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302400 00000100:00100000:0.0:1785774835.878991:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1785774835.878997:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671301248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.879029:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671301248:12345-0@lo:400:kworker.0 Request processed in 31us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774835.879036:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1785774835.879048:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1785774835.879060:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671301760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.879085:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671301760:12345-0@lo:400:kworker.0 Request processed in 32us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774835.879090:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1785774835.879100:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1785774835.879106:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671302272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.879694:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1785774835.879704:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671301376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.879902:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302016 00000100:00100000:2.0:1785774835.879907:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302016 00000100:00100000:2.0:1785774835.879937:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302528 00000100:00100000:2.0:1785774835.879940:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302528 00000100:00100000:2.0:1785774835.879961:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1785774835.879967:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671302016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774835.886697:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1785774835.886716:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671301888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.890761:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671301376:12345-0@lo:400:kworker.0 Request processed in 11051us (12219us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774835.890775:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1785774835.890828:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671302784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774835.890888:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774835.890946:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1785774835.890958:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671302528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.891023:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671302528:12345-0@lo:400:kworker.0 Request processed in 70us (12240us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774835.891029:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1785774835.891050:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302784 00000100:00100000:1.0:1785774835.891058:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302784 00000100:00100000:1.0:1785774835.891091:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1785774835.891097:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671302784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774835.891123:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774835.891173:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671302784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774835.891181:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1785774835.891227:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671302528:0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.891265:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671302784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774835.891292:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671301376:0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.896695:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671302912 00000100:00100000:1.0:1785774835.896710:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671302912 00000100:00100000:1.0:1785774835.896770:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1785774835.896779:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671302912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774835.896813:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774835.897017:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671302912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 239us (18179us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774835.897025:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1785774835.897088:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671302912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774835.897496:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671302016:12345-0@lo:400:kworker.0 Request processed in 17528us (18758us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.897505:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00080000:2.0:1785774835.897706:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774835.897711:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785774835.897714:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774835.897734:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1785774835.897744:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671301504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.897790:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671301504:12345-0@lo:400:kworker.0 Request processed in 49us (19121us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.897797:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1785774835.897819:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1785774835.897821:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671302272:12345-0@lo:400:kworker.0 Request processed in 18709us (20387us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.897830:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671302400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.897836:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1785774835.898391:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671301888:12345-0@lo:400:kworker.0 Request processed in 11681us (19807us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774835.898400:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1785774835.898665:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671301504:0@lo:400:kworker.0 00000100:00100000:1.0:1785774835.898680:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671302016:0@lo:400:kworker.0 00000100:00100000:3.0:1785774835.899221:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671301248:0@lo:400:kworker.0 00000100:00100000:3.0:1785774835.899234:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671301760:0@lo:400:kworker.0 00000100:00100000:3.0:1785774835.899254:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671302272:0@lo:400:kworker.0 00000100:00100000:3.0:1785774835.899264:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671301120:0@lo:400:kworker.0 00000100:00100000:3.0:1785774835.899275:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671301632:0@lo:400:kworker.0 00000100:00100000:2.0:1785774835.899436:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671302400:12345-0@lo:400:kworker.0 Request processed in 1177us (20276us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774835.899444:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1785774835.899567:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671302144:0@lo:400:kworker.0 00000100:00100000:3.0:1785774835.899580:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671302656:0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.901179:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671301888:0@lo:400:kworker.0 00000100:00100000:0.0:1785774835.901197:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671302400:0@lo:400:kworker.0 00000100:00100000:3.0:1785774836.392404:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774836.392428:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671303040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774836.392495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774836.392748:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303040 00000100:00100000:1.0:1785774836.392756:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303040 00000100:00100000:1.0:1785774836.392806:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1785774836.392815:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671303040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785774836.392835:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774836.392900:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671303040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774836.392923:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1785774836.392965:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671303040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785774836.516786:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774836.874408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774836.874467:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648536448 00000100:00100000:0.0:1785774836.874481:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648536448 00000100:00100000:0.0:1785774836.874586:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23891 00000100:00100000:0.0:1785774836.874600:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:19334:x1872519648536448:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:0.0:1785774836.874668:0:6530:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9b771edd8350 uarg=0000000000000000 00000004:00000080:0.0:1785774836.874744:0:6530:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9b771edd8350 00000004:00000080:0.0:1785774836.874752:0:6530:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:0.0:1785774836.874811:0:6530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774836.874815:0:6530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1785774836.874837:0:6530:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 0 00000040:00080000:0.0:1785774836.875211:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:0.0:1785774836.875221:0:6530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1785774836.875226:0:6530:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1785774836.876121:0:6530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1785774836.877087:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:19334:x1872519648536448:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 2483us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774836.877100:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23891 00000100:00080000:0.0:1785774836.877135:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774836.943768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774836.944020:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648536576 00000100:00100000:3.0:1785774836.944032:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648536576 00000100:00100000:3.0:1785774836.944121:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23892 00000100:00100000:3.0:1785774836.944132:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:19336:x1872519648536576:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:3.0:1785774836.944216:0:8627:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff9b771edd8530 uarg=0000000000000000 00000004:00000080:3.0:1785774836.944274:0:8627:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff9b771edd8530 00000004:00000080:3.0:1785774836.944281:0:8627:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:3.0:1785774836.944325:0:8627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785774836.944330:0:8627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1785774836.944359:0:8627:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:3.0:1785774836.944417:0:8627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1785774836.944425:0:8627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1785774836.944430:0:8627:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1785774836.945009:0:8627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1785774836.945122:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:19336:x1872519648536576:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 991us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774836.945131:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23892 00000100:00080000:2.0:1785774836.945909:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774837.003757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.003833:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648536704 00000100:00100000:2.0:1785774837.003856:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648536704 00000100:00100000:2.0:1785774837.003925:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23893 00000100:00100000:2.0:1785774837.003937:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:19337:x1872519648536704:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.003965:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.003995:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09fd23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c22c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.004077:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09fd2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.004094:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09fd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.004107:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09fd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774837.004192:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774837.004197:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774837.004223:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09fd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.004252:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09fd23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c22c expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.004562:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09fd2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c22c expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.004573:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774837.004576:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774837.004580:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a000, rc 0) 00000100:00100000:2.0:1785774837.004658:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:19337:x1872519648536704:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 723us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774837.004667:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23893 00000100:00100000:3.0:1785774837.019863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.020026:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648536832 00000100:00100000:1.0:1785774837.020040:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648536832 00000100:00100000:1.0:1785774837.020121:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23894 00000100:00100000:1.0:1785774837.020133:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:19337:x1872519648536832:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774837.020176:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774837.020205:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09fd31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c233 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020285:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020301:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020314:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020329:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020336:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020342:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020432:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09fd46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020443:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09fd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020449:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09fd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774837.020496:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1541:0x0]: returning size 4096 00000004:00200000:1.0:1785774837.020500:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1785774837.020525:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09fd46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020540:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020547:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020554:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020561:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020567:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774837.020571:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020578:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020590:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774837.020594:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774837.020599:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020605:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d09fd38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020628:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020633:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020639:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020644:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774837.020647:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020653:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020660:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774837.020663:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774837.020665:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020671:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d09fd3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020703:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d09fd31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c233 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020738:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09fd46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c233 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.020746:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605fcc000) 00010000:00010000:1.0:1785774837.020748:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774837.020751:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf000, rc 0) 00000100:00100000:1.0:1785774837.020832:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:19337:x1872519648536832:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 701us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774837.020849:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23894 00000100:00100000:1.0:1785774837.048577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.048662:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648537088 00000100:00100000:3.0:1785774837.048674:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648537088 00000100:00100000:3.0:1785774837.048745:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23895 00000100:00100000:3.0:1785774837.048756:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:19337:x1872519648537088:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774837.048800:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774837.048803:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785774837.048836:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d09fd46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c233 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.048878:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605fcc000) 00010000:00010000:3.0:1785774837.048892:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774837.048911:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fd4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c23a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.049059:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.049074:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.049087:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.049101:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.049109:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.049115:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.049645:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ce:0x0], index 0: 0 00000040:00080000:3.0:1785774837.049809:0:6531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785774837.050042:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00010000:00010000:3.0:1785774837.050304:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fd62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050317:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fd62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050325:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fd62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774837.050388:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983628 00010000:00010000:3.0:1785774837.050430:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050438:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050444:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050451:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050458:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774837.050462:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050470:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050486:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7709388400) 00010000:00010000:3.0:1785774837.050489:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774837.050494:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050501:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774837.050514:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000075455c1 reply state 00000000b7ed67c6 transno 4294983629 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050526:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050533:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b93e778 (ffff9b7709388e00) 00010000:00010000:3.0:1785774837.050535:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774837.050538:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774837.050572:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fd4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c23a expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050589:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fd62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c23a expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.050597:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9b7709388000) 00010000:00010000:3.0:1785774837.050600:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774837.050602:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0c00, rc 0) 00000100:00100000:3.0:1785774837.050691:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:19337:x1872519648537088:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1936us (2127us total) trans 4294983629 rc 0/0 00000100:00100000:3.0:1785774837.050700:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23895 00000020:00080000:3.0:1785774837.050707:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.073733:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.073784:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648537344 00000100:00100000:3.0:1785774837.073799:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648537344 00000100:00100000:3.0:1785774837.073879:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5122 00000100:00100000:3.0:1785774837.073892:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732245c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:19337:x1872519648537344:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774837.076288:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983630 00000100:00100000:3.0:1785774837.076440:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732245c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:19337:x1872519648537344:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 2546us (2716us total) trans 4294983631 rc 0/0 00000100:00100000:3.0:1785774837.076453:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5122 00000020:00080000:3.0:1785774837.076460:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.088065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.088565:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648537472 00000100:00100000:2.0:1785774837.088577:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648537472 00000100:00100000:2.0:1785774837.088641:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23896 00000100:00100000:2.0:1785774837.088651:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:19337:x1872519648537472:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.088682:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.088709:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09fd70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c241 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088791:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088808:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088823:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088852:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088860:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088867:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088981:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fd85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088990:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.088997:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774837.089057:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1541:0x0]: returning size 4096 00000004:00200000:2.0:1785774837.089063:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774837.089095:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fd85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089113:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089121:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089133:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089141:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089148:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35aa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.089154:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089185:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089199:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774837.089203:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.089208:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089215:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fd77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089229:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089235:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089241:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089246:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.089249:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089255:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089260:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9b7605dfe600) 00010000:00010000:2.0:1785774837.089262:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.089265:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089270:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fd7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089301:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09fd70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c241 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089314:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b000/0x7b7109e1d09fd85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c241 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.089322:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.089325:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1785774837.089327:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b000, rc 0) 00000100:00100000:2.0:1785774837.089415:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:19337:x1872519648537472:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 764us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774837.089423:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23896 00000100:00100000:3.0:1785774837.096131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.096203:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648537728 00000100:00100000:3.0:1785774837.096216:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648537728 00000100:00100000:3.0:1785774837.096285:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23897 00000100:00100000:3.0:1785774837.096298:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:19337:x1872519648537728:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774837.096326:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774837.096353:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fd8c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c248 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.096499:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.096517:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.096531:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.096552:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.096560:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.096567:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.100576:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ce:0x0], index 1: 0 00010000:00010000:3.0:1785774837.102045:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fda1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102076:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102093:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774837.102238:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983632 00010000:00010000:3.0:1785774837.102299:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102308:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102315:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102323:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102334:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774837.102339:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102349:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102366:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774837.102369:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774837.102375:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102382:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fd93 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774837.102397:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d67d02b8 reply state 00000000c27cbe23 transno 4294983633 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102409:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102416:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x53a9537d (ffff9b7709388400) 00010000:00010000:3.0:1785774837.102418:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774837.102422:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774837.102473:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fd8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c248 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102492:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fda1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c248 expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.102506:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9b7709388600) 00010000:00010000:3.0:1785774837.102508:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774837.102511:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:3.0:1785774837.102622:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:19337:x1872519648537728:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 6326us (6501us total) trans 4294983633 rc 0/0 00000100:00100000:3.0:1785774837.102632:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23897 00000020:00080000:3.0:1785774837.102639:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.114501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.114555:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648537984 00000100:00100000:3.0:1785774837.114568:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648537984 00000100:00100000:3.0:1785774837.114630:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5123 00000100:00100000:3.0:1785774837.114642:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:19337:x1872519648537984:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774837.115232:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983634 00000100:00100000:3.0:1785774837.115411:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:19337:x1872519648537984:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 769us (932us total) trans 4294983635 rc 0/0 00000100:00100000:3.0:1785774837.115420:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5123 00000020:00080000:3.0:1785774837.115426:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.141647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.146391:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648538240 00000100:00100000:3.0:1785774837.146412:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648538240 00000100:00100000:3.0:1785774837.146589:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23898 00000100:00100000:3.0:1785774837.146603:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:19337:x1872519648538240:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774837.146635:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774837.146662:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fdaf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c24f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.149733:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.149768:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.149783:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.149801:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.149809:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.149816:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.150300:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cf:0x0], index 0: 0 00010000:00010000:3.0:1785774837.154256:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09fdc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.154292:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.154312:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774837.157473:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983636 00010000:00010000:3.0:1785774837.158135:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158156:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158192:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158200:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158207:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774837.158212:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158221:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158241:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774837.158245:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774837.158250:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158257:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdb6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774837.158273:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d597c171 reply state 000000005a72867d transno 4294983637 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158287:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.158294:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x756ed0d2 (ffff9b7709388500) 00010000:00010000:3.0:1785774837.158297:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774837.158300:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774837.160059:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fdaf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c24f expref: 27 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.160088:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09fdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c24f expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.160097:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9b7709388300) 00010000:00010000:3.0:1785774837.160099:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774837.160102:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:2.0:1785774837.168514:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:19337:x1872519648538240:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 21883us (26850us total) trans 4294983637 rc 0/0 00000100:00100000:2.0:1785774837.168536:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23898 00000020:00080000:2.0:1785774837.168548:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.223655:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.223821:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648538496 00000100:00100000:3.0:1785774837.223834:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648538496 00000100:00100000:3.0:1785774837.223920:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5124 00000100:00100000:3.0:1785774837.223931:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:19337:x1872519648538496:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774837.224634:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983638 00000100:00100000:2.0:1785774837.225079:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:19337:x1872519648538496:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1148us (1437us total) trans 4294983639 rc 0/0 00000100:00100000:2.0:1785774837.225090:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5124 00000020:00080000:2.0:1785774837.225096:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.230506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.231057:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648538752 00000100:00100000:2.0:1785774837.231069:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648538752 00000100:00100000:2.0:1785774837.231151:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23899 00000100:00100000:2.0:1785774837.231256:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:19337:x1872519648538752:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.231289:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.231316:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09fdd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c256 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.231858:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.231877:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.231892:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.231907:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.231914:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.231920:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.235588:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cf:0x0], index 1: 0 00010000:00010000:2.0:1785774837.236256:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09fde7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.236278:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09fde7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.236292:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09fde7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.237872:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983640 00010000:00010000:2.0:1785774837.238783:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238800:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238807:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238815:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238822:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.238827:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238846:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238867:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.238872:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.238878:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238886:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fdd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.238907:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000661147d5 reply state 000000003fb18d2c transno 4294983641 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238920:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.238928:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd3ce983f (ffff9b7605dfe600) 00010000:00010000:2.0:1785774837.238931:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.238934:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.239652:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09fdd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c256 expref: 33 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.240903:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09fde7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c256 expref: 32 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.240920:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:2.0:1785774837.240924:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.240927:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ae00, rc 0) 00000100:00100000:2.0:1785774837.241534:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:19337:x1872519648538752:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 10370us (11051us total) trans 4294983641 rc 0/0 00000100:00100000:2.0:1785774837.241546:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23899 00000020:00080000:2.0:1785774837.241556:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.271094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.279607:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648539008 00000100:00100000:3.0:1785774837.279628:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648539008 00000100:00100000:0.0:1785774837.287606:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5125 00000100:00100000:0.0:1785774837.287622:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+33:19337:x1872519648539008:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774837.288137:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983642 00000100:00100000:0.0:1785774837.288292:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:19337:x1872519648539008:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 672us (17212us total) trans 4294983643 rc 0/0 00000100:00100000:0.0:1785774837.288301:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5125 00000020:00080000:0.0:1785774837.288307:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.292716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.292881:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648539264 00000100:00100000:3.0:1785774837.292895:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648539264 00000100:00100000:3.0:1785774837.292980:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23900 00000100:00100000:3.0:1785774837.292993:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:19337:x1872519648539264:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774837.293028:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774837.293058:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fdf5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c25d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.293262:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.293281:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.293296:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.293313:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.293319:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.293326:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.294936:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d0:0x0], index 0: 0 00010000:00010000:2.0:1785774837.303155:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fe0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.303207:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fe0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.303221:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fe0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.303331:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983644 00010000:00010000:2.0:1785774837.306474:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306556:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306563:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306570:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306577:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.306582:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306590:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306611:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.306614:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.306619:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306626:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09fdfc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.306646:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff8b84ff reply state 000000000e13e02e transno 4294983645 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306671:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.306678:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdb9e9594 (ffff9b7709388700) 00010000:00010000:2.0:1785774837.306681:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.306685:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.307467:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fdf5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c25d expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.307498:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fe0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c25d expref: 38 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.307506:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9b7605dfea00) 00010000:00010000:2.0:1785774837.307509:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.307512:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35ba00, rc 0) 00000100:00100000:2.0:1785774837.307621:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:19337:x1872519648539264:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 14630us (14925us total) trans 4294983645 rc 0/0 00000100:00100000:2.0:1785774837.307631:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23900 00000020:00080000:2.0:1785774837.307639:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.317805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.319450:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648539520 00000100:00100000:1.0:1785774837.319466:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648539520 00000100:00100000:1.0:1785774837.319558:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5126 00000100:00100000:1.0:1785774837.319570:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:19337:x1872519648539520:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.319962:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983646 00000100:00100000:1.0:1785774837.321111:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:19337:x1872519648539520:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1538us (3316us total) trans 4294983647 rc 0/0 00000100:00100000:1.0:1785774837.321124:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5126 00000020:00080000:1.0:1785774837.321131:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.340752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.340903:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648539776 00000100:00100000:0.0:1785774837.340916:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648539776 00000100:00100000:0.0:1785774837.340988:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23901 00000100:00100000:0.0:1785774837.340999:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+41:19337:x1872519648539776:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.341031:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.341059:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fe18 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c264 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.341219:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.341237:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.341253:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.341269:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.341276:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.341282:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774837.341752:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d0:0x0], index 1: 0 00010000:00010000:0.0:1785774837.341981:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fe2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.341992:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342002:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774837.342728:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983648 00010000:00010000:0.0:1785774837.342780:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342790:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342797:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342805:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342812:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774837.342817:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342826:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342850:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774837.342854:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774837.342860:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342867:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe1f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774837.342893:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c075e85 reply state 00000000006e07ba transno 4294983649 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342907:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342914:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe663f479 (ffff9b7706383400) 00010000:00010000:0.0:1785774837.342918:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774837.342921:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774837.342962:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fe18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c264 expref: 45 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342979:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fe2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c264 expref: 44 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.342987:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9b7706383d00) 00010000:00010000:0.0:1785774837.342989:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774837.342992:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2000, rc 0) 00000100:00100000:0.0:1785774837.348540:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:19337:x1872519648539776:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7521us (7780us total) trans 4294983649 rc 0/0 00000100:00100000:0.0:1785774837.348558:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23901 00000020:00080000:0.0:1785774837.348571:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.357550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.357710:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648540032 00000100:00100000:2.0:1785774837.357723:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648540032 00000100:00100000:2.0:1785774837.357802:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5127 00000100:00100000:2.0:1785774837.357814:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:19337:x1872519648540032:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774837.358241:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983650 00000100:00100000:2.0:1785774837.358621:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:19337:x1872519648540032:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 808us (1083us total) trans 4294983651 rc 0/0 00000100:00100000:2.0:1785774837.358630:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5127 00000020:00080000:2.0:1785774837.358637:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774837.371892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.372060:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648540288 00000100:00100000:2.0:1785774837.372073:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648540288 00000100:00100000:2.0:1785774837.372154:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23902 00000100:00100000:2.0:1785774837.372212:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:19337:x1872519648540288:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.372244:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.372271:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fe3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c26b expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.372420:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.372439:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.372452:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.372468:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.372475:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.372488:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.372904:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d1:0x0], index 0: 0 00010000:00010000:2.0:1785774837.373116:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09fe50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373128:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09fe50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373135:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09fe50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.373223:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983652 00010000:00010000:2.0:1785774837.373264:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373273:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373280:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373288:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373296:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.373301:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373310:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373325:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.373329:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.373334:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373341:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.373357:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f53ae44f reply state 00000000460db7f0 transno 4294983653 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373369:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373375:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf8b3f1ce (ffff9b7605dfe100) 00010000:00010000:2.0:1785774837.373377:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.373381:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.373415:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fe3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c26b expref: 51 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373431:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09fe50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c26b expref: 50 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.373440:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9b7605dfe800) 00010000:00010000:2.0:1785774837.373442:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.373444:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b200, rc 0) 00000100:00100000:2.0:1785774837.373527:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:19337:x1872519648540288:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1318us (1649us total) trans 4294983653 rc 0/0 00000100:00100000:2.0:1785774837.373536:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23902 00000020:00080000:2.0:1785774837.373543:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.384962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.387502:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648540544 00000100:00100000:2.0:1785774837.387522:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648540544 00000100:00100000:2.0:1785774837.387604:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5128 00000100:00100000:2.0:1785774837.387616:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732246050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:19337:x1872519648540544:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774837.388002:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983654 00000100:00100000:2.0:1785774837.388133:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732246050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:19337:x1872519648540544:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 518us (3195us total) trans 4294983655 rc 0/0 00000100:00100000:2.0:1785774837.388143:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5128 00000020:00080000:2.0:1785774837.388148:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.421122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.421591:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648540800 00000100:00100000:2.0:1785774837.421603:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648540800 00000100:00100000:2.0:1785774837.421667:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23903 00000100:00100000:2.0:1785774837.421678:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:19337:x1872519648540800:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.421716:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.421746:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fe5e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c272 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.421899:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.421918:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.421932:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.421948:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.422590:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.422598:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.424055:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d1:0x0], index 1: 0 00010000:00010000:3.0:1785774837.424628:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09fe73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.424642:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09fe73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.424652:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09fe73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774837.425791:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983656 00010000:00010000:3.0:1785774837.425857:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.425868:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.425876:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.425884:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.425891:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774837.425896:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.425904:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.425921:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774837.425924:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774837.425929:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.425936:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09fe65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774837.427125:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c6c9b86 reply state 00000000803abb81 transno 4294983657 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.427148:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.427156:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d12be7b (ffff9b7605dfeb00) 00010000:00010000:3.0:1785774837.427168:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774837.427172:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774837.427233:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09fe5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c272 expref: 57 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.427253:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09fe73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c272 expref: 56 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.427260:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9b77199f5600) 00010000:00010000:3.0:1785774837.427262:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774837.427264:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:3.0:1785774837.429453:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+57:19337:x1872519648540800:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7765us (8333us total) trans 4294983657 rc 0/0 00000100:00100000:3.0:1785774837.429467:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23903 00000020:00080000:3.0:1785774837.429476:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.452993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.454559:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648541056 00000100:00100000:2.0:1785774837.454574:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648541056 00000100:00100000:2.0:1785774837.454662:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5129 00000100:00100000:2.0:1785774837.454675:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+57:19337:x1872519648541056:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774837.455090:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983658 00000100:00100000:2.0:1785774837.455281:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:19337:x1872519648541056:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 608us (2302us total) trans 4294983659 rc 0/0 00000100:00100000:2.0:1785774837.455291:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5129 00000020:00080000:2.0:1785774837.455296:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.461220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.461329:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648541312 00000100:00100000:0.0:1785774837.461342:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648541312 00000100:00100000:0.0:1785774837.461427:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23904 00000100:00100000:0.0:1785774837.461440:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:19337:x1872519648541312:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.461474:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.461515:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fe81 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c279 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.461662:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.461680:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.461697:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.461712:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.461719:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.461725:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774837.462214:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d2:0x0], index 0: 0 00010000:00010000:0.0:1785774837.462400:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fe96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462409:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462416:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774837.462468:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983660 00010000:00010000:0.0:1785774837.462502:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462509:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462515:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462525:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462530:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774837.462534:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462541:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462568:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774837.462571:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774837.462576:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462581:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fe88 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774837.462600:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063634db4 reply state 00000000ddd4e1c4 transno 4294983661 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462625:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462631:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6e2bbd0 (ffff9b7706383600) 00010000:00010000:0.0:1785774837.462633:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774837.462635:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774837.462664:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fe81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c279 expref: 63 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462683:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c279 expref: 62 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.462690:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9b7706383200) 00010000:00010000:0.0:1785774837.462692:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774837.462694:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2c00, rc 0) 00000100:00100000:0.0:1785774837.462757:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:19337:x1872519648541312:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1320us (1601us total) trans 4294983661 rc 0/0 00000100:00100000:0.0:1785774837.462763:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23904 00000020:00080000:0.0:1785774837.462768:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.463618:0:8660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8660:1872519671303168:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1785774837.463684:0:8660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774837.463744:0:8660:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7601b5ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1785774837.463925:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303168 00000100:00100000:3.0:1785774837.463935:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303168 00000100:00100000:3.0:1785774837.464015:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5237 00000100:00100000:3.0:1785774837.464026:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:8660:x1872519671303168:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1785774837.464075:0:14722:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2530 00000100:00100000:3.0:1785774837.467387:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:8660:x1872519671303168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3135us (3473us total) trans 4294969898 rc 0/0 00000100:00100000:3.0:1785774837.467404:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5237 00000100:00100000:1.0:1785774837.469657:0:8660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8660:1872519671303168:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1785774837.474708:0:8660:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9d2:0x0]-[0x280000401:0xa01:0x0] 00000100:00080000:0.0:1785774837.482493:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774837.495533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.495873:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648541568 00000100:00100000:0.0:1785774837.495888:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648541568 00000100:00100000:0.0:1785774837.495978:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5130 00000100:00100000:0.0:1785774837.495991:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:19337:x1872519648541568:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774837.498787:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983662 00000100:00100000:3.0:1785774837.499012:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:19337:x1872519648541568:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 3018us (3605us total) trans 4294983663 rc 0/0 00000100:00100000:3.0:1785774837.499026:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5130 00000020:00080000:3.0:1785774837.499035:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.508251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.508634:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648541824 00000100:00100000:0.0:1785774837.508648:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648541824 00000100:00100000:0.0:1785774837.508733:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23905 00000100:00100000:0.0:1785774837.508743:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:19337:x1872519648541824:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.508772:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.508811:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fea4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c280 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.508954:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.508975:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.508986:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.509000:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.509006:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.509012:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774837.509576:0:9848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044cfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1872519671303296:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1785774837.509644:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774837.509713:0:9848:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e5c480 going to sleep for 11 seconds 00000100:00100000:1.0:1785774837.509875:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303296 00000100:00100000:1.0:1785774837.509882:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303296 00000100:00100000:1.0:1785774837.509943:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238 00000100:00100000:1.0:1785774837.509952:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9848:x1872519671303296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1785774837.509996:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2530 00000004:00080000:0.0:1785774837.510941:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d2:0x0], index 1: 0 00010000:00010000:0.0:1785774837.511188:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09feb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.511204:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09feb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.511216:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09feb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774837.511295:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983664 00010000:00010000:0.0:1785774837.511335:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1785774837.512592:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1785774837.513579:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.513594:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.513602:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.513610:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774837.513615:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.513626:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.513647:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774837.513650:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774837.513656:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.513663:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09feab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774837.513690:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067072e40 reply state 0000000008be0e73 transno 4294983665 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.514825:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.514843:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x40eea295 (ffff9b7706383700) 00010000:00010000:0.0:1785774837.514847:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774837.514851:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774837.514923:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fea4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c280 expref: 69 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.514945:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09feb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c280 expref: 68 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.514954:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9b7706383500) 00010000:00010000:0.0:1785774837.514956:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774837.514959:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3a00, rc 0) 00000100:00100000:0.0:1785774837.515126:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+69:19337:x1872519648541824:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 6382us (6888us total) trans 4294983665 rc 0/0 00000100:00100000:0.0:1785774837.515137:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23905 00000020:00080000:0.0:1785774837.515145:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.517075:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9848:x1872519671303296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7121us (7426us total) trans 4294969899 rc 0/0 00000100:00100000:1.0:1785774837.517088:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238 00000100:00100000:0.0:1785774837.518517:0:9848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044cfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1872519671303296:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1785774837.518539:0:9848:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9d2:0x0]-[0x2c0000401:0xa01:0x0] 00000100:00100000:1.0:1785774837.538860:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.538990:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648542080 00000100:00100000:2.0:1785774837.539004:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648542080 00000100:00100000:2.0:1785774837.539080:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5131 00000100:00100000:2.0:1785774837.539092:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+69:19337:x1872519648542080:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774837.539632:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983666 00000100:00100000:2.0:1785774837.539766:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:19337:x1872519648542080:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 676us (930us total) trans 4294983667 rc 0/0 00000100:00100000:2.0:1785774837.539776:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5131 00000020:00080000:2.0:1785774837.539784:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785774837.540492:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774837.553961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.554137:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648542336 00000100:00100000:0.0:1785774837.554149:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648542336 00000100:00100000:0.0:1785774837.554262:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23906 00000100:00100000:0.0:1785774837.554274:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:19337:x1872519648542336:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.554309:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.554345:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fec7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c287 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.554610:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.554629:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.554646:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.554662:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.554670:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.554677:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774837.555108:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d3:0x0], index 0: 0 00010000:00010000:1.0:1785774837.560032:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09fedc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560061:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09fedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560074:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09fedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774837.560237:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983668 00010000:00010000:1.0:1785774837.560280:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560289:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560296:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560305:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560312:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774837.560317:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560326:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560350:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774837.560353:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774837.560359:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560367:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09fece lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774837.560393:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a32ccf88 reply state 0000000097cd5abe transno 4294983669 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560414:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560421:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea16437d (ffff9b7706383100) 00010000:00010000:1.0:1785774837.560424:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774837.560427:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774837.560475:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09fec7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c287 expref: 75 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560642:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09fedc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c287 expref: 74 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774837.560652:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:1.0:1785774837.560654:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774837.560656:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:1.0:1785774837.560747:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:19337:x1872519648542336:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 6475us (6801us total) trans 4294983669 rc 0/0 00000100:00100000:1.0:1785774837.560758:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23906 00000020:00080000:1.0:1785774837.560765:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774837.570744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.570846:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648542592 00000100:00100000:1.0:1785774837.570862:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648542592 00000100:00100000:1.0:1785774837.570954:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5132 00000100:00100000:1.0:1785774837.570966:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:19337:x1872519648542592:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.571380:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983670 00000100:00100000:1.0:1785774837.571578:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:19337:x1872519648542592:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 614us (847us total) trans 4294983671 rc 0/0 00000100:00100000:1.0:1785774837.571587:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5132 00000020:00080000:1.0:1785774837.571593:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.586864:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.587036:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648542848 00000100:00100000:3.0:1785774837.587050:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648542848 00000100:00100000:3.0:1785774837.587140:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23907 00000100:00100000:3.0:1785774837.587152:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:19337:x1872519648542848:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774837.587215:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774837.587244:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09feea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c28e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.588938:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.588966:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.588985:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.589005:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.589014:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.589021:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.590940:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d3:0x0], index 1: 0 00010000:00010000:2.0:1785774837.591181:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09feff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591197:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09feff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591208:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09feff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.591281:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983672 00010000:00010000:2.0:1785774837.591317:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591325:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591331:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591745:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591753:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.591758:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591766:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591795:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.591799:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.591804:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591811:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09fef1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.591830:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000930152d reply state 0000000055293c03 transno 4294983673 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591869:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591874:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9897527d (ffff9b77199f5d00) 00010000:00010000:2.0:1785774837.591877:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.591880:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.591922:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09feea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c28e expref: 81 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591938:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09feff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c28e expref: 80 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.591945:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:2.0:1785774837.591947:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.591949:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35a600, rc 0) 00000100:00100000:2.0:1785774837.592085:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:19337:x1872519648542848:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4935us (5249us total) trans 4294983673 rc 0/0 00000100:00100000:2.0:1785774837.592094:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23907 00000020:00080000:2.0:1785774837.592100:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774837.615931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.624520:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648543104 00000100:00100000:1.0:1785774837.624542:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648543104 00000100:00100000:1.0:1785774837.624639:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5133 00000100:00100000:1.0:1785774837.624652:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:19337:x1872519648543104:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.625272:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983674 00000100:00100000:1.0:1785774837.625405:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:19337:x1872519648543104:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 755us (9485us total) trans 4294983675 rc 0/0 00000100:00100000:1.0:1785774837.625415:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5133 00000020:00080000:1.0:1785774837.625421:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.636465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.644360:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648543360 00000100:00100000:2.0:1785774837.644382:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648543360 00000100:00100000:2.0:1785774837.644627:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23908 00000100:00100000:2.0:1785774837.644640:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:19337:x1872519648543360:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.644675:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.644852:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ff0d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c295 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.644997:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.645015:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.645028:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.645042:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.645048:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.645053:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.645907:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d4:0x0], index 0: 0 00010000:00010000:2.0:1785774837.646117:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ff22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.646128:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ff22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.646138:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ff22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.646241:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983676 00010000:00010000:2.0:1785774837.646280:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.646290:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.646297:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.648567:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.648587:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.648593:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.648603:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.648628:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.648632:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.648638:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.648646:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff14 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.648663:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000736412ed reply state 000000008c32692a transno 4294983677 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.649540:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.649556:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe423257d (ffff9b7605dfe000) 00010000:00010000:2.0:1785774837.649560:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.649566:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.649649:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ff0d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c295 expref: 87 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.649670:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ff22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c295 expref: 86 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.649678:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9b7605dfe500) 00010000:00010000:2.0:1785774837.649681:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.649683:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35be00, rc 0) 00000100:00100000:2.0:1785774837.649961:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:19337:x1872519648543360:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 5322us (13563us total) trans 4294983677 rc 0/0 00000100:00100000:2.0:1785774837.649972:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23908 00000020:00080000:2.0:1785774837.649980:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.672392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.672800:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648543616 00000100:00100000:1.0:1785774837.672814:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648543616 00000100:00100000:1.0:1785774837.672903:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5134 00000100:00100000:1.0:1785774837.672914:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:19337:x1872519648543616:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.673755:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983678 00000100:00100000:1.0:1785774837.673917:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:19337:x1872519648543616:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1002us (1537us total) trans 4294983679 rc 0/0 00000100:00100000:1.0:1785774837.673927:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5134 00000020:00080000:1.0:1785774837.673934:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.682940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.683139:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648543872 00000100:00100000:3.0:1785774837.683153:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648543872 00000100:00100000:3.0:1785774837.683285:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23909 00000100:00100000:3.0:1785774837.683297:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:19337:x1872519648543872:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774837.683330:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774837.683366:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09ff30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c29c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.683518:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.683534:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.683547:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.683560:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.683566:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.683572:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.683992:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d4:0x0], index 1: 0 00010000:00010000:3.0:1785774837.684203:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09ff45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684212:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684220:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774837.684282:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983680 00010000:00010000:3.0:1785774837.684317:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684325:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684332:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684339:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684346:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774837.684351:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684358:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684371:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774837.684374:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774837.684378:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684385:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d09ff37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774837.684401:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041632221 reply state 00000000222ef865 transno 4294983681 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684414:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684421:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x970cb47d (ffff9b77199f5400) 00010000:00010000:3.0:1785774837.684424:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774837.684426:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774837.684456:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d09ff30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c29c expref: 93 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684471:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09ff45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c29c expref: 92 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.684480:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:3.0:1785774837.684483:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774837.684485:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:3.0:1785774837.684564:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:19337:x1872519648543872:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1269us (1641us total) trans 4294983681 rc 0/0 00000100:00100000:3.0:1785774837.684572:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23909 00000020:00080000:3.0:1785774837.684578:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.693853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.694088:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648544128 00000100:00100000:1.0:1785774837.694103:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648544128 00000100:00100000:1.0:1785774837.694238:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5135 00000100:00100000:1.0:1785774837.694251:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:19337:x1872519648544128:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.695864:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983682 00000100:00100000:1.0:1785774837.696011:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:19337:x1872519648544128:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1759us (2178us total) trans 4294983683 rc 0/0 00000100:00100000:1.0:1785774837.696023:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5135 00000020:00080000:1.0:1785774837.696029:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.701215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.701311:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648544384 00000100:00100000:2.0:1785774837.701324:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648544384 00000100:00100000:2.0:1785774837.701399:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23910 00000100:00100000:2.0:1785774837.701416:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:19337:x1872519648544384:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.701447:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.701488:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ff53 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2a3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.701621:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.701639:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.701656:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.701673:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.701679:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.701685:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.702314:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d5:0x0], index 0: 0 00010000:00010000:2.0:1785774837.708000:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d09ff68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708030:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d09ff68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708045:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d09ff68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.708247:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983684 00010000:00010000:2.0:1785774837.708324:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708334:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708340:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708354:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708361:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.708366:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708376:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708391:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.708394:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.708400:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708408:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d09ff5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.708424:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7fca98e reply state 0000000094932b42 transno 4294983685 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708437:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708444:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5239df7d (ffff9b7605dfec00) 00010000:00010000:2.0:1785774837.708447:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.708450:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.708499:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d09ff53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2a3 expref: 99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708524:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d09ff68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2a3 expref: 98 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.708533:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9b7605dfe300) 00010000:00010000:2.0:1785774837.708536:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.708538:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045200, rc 0) 00000100:00100000:2.0:1785774837.708640:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:19337:x1872519648544384:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7224us (7438us total) trans 4294983685 rc 0/0 00000100:00100000:2.0:1785774837.708651:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23910 00000020:00080000:2.0:1785774837.708657:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.733872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.733990:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648544640 00000100:00100000:1.0:1785774837.734003:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648544640 00000100:00100000:1.0:1785774837.734076:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5136 00000100:00100000:1.0:1785774837.734088:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:19337:x1872519648544640:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.734475:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983686 00000100:00100000:1.0:1785774837.734614:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+101:19337:x1872519648544640:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 528us (755us total) trans 4294983687 rc 0/0 00000100:00100000:1.0:1785774837.734623:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5136 00000020:00080000:1.0:1785774837.734629:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.759757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.759922:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648544896 00000100:00100000:2.0:1785774837.759935:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648544896 00000100:00100000:2.0:1785774837.760015:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23911 00000100:00100000:2.0:1785774837.760028:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+101:19337:x1872519648544896:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.760062:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.760090:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d09ff76 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.760278:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.760297:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.760312:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.760335:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.760343:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.760350:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774837.760938:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d5:0x0], index 1: 0 00010000:00010000:0.0:1785774837.761313:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09ff8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.761326:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09ff8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.761336:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09ff8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774837.761411:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983688 00010000:00010000:0.0:1785774837.762032:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762043:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762050:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762057:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762064:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774837.762069:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762077:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762092:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774837.762095:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774837.762100:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762106:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d09ff7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774837.762122:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009585a453 reply state 0000000011243fae transno 4294983689 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762135:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762143:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa5436e7d (ffff9b7605dfef00) 00010000:00010000:0.0:1785774837.762145:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774837.762148:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774837.762223:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d09ff76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2aa expref: 105 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762241:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09ff8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2aa expref: 104 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.762251:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9b7706383f00) 00010000:00010000:0.0:1785774837.762253:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774837.762256:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec2600, rc 0) 00000100:00100000:0.0:1785774837.762366:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+105:19337:x1872519648544896:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2340us (2624us total) trans 4294983689 rc 0/0 00000100:00100000:0.0:1785774837.762376:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23911 00000020:00080000:0.0:1785774837.762383:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.774799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.774888:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648545152 00000100:00100000:1.0:1785774837.774903:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648545152 00000100:00100000:1.0:1785774837.775032:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5137 00000100:00100000:1.0:1785774837.775045:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+105:19337:x1872519648545152:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.775551:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983690 00000100:00100000:1.0:1785774837.775673:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+107:19337:x1872519648545152:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 630us (889us total) trans 4294983691 rc 0/0 00000100:00100000:1.0:1785774837.775683:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5137 00000020:00080000:1.0:1785774837.775688:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.781082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.781194:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648545408 00000100:00100000:0.0:1785774837.781206:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648545408 00000100:00100000:0.0:1785774837.781275:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23912 00000100:00100000:0.0:1785774837.781286:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+107:19337:x1872519648545408:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.781317:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.781344:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ff99 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2b1 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.781489:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.781507:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.781521:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.781546:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.781553:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.781561:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.783962:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d6:0x0], index 0: 0 00010000:00010000:3.0:1785774837.784280:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09ffae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.784300:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09ffae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.784315:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09ffae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774837.786603:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983692 00010000:00010000:3.0:1785774837.786744:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786758:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786765:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786773:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786780:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774837.786786:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786795:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786815:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774837.786819:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774837.786824:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786840:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d09ffa0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774837.786869:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c76b2c84 reply state 00000000a4740899 transno 4294983693 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786884:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786892:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xead1417d (ffff9b7706383a00) 00010000:00010000:3.0:1785774837.786894:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774837.786898:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774837.786952:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d09ff99 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2b1 expref: 111 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786973:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09ffae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2b1 expref: 110 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.786982:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9b77199f5100) 00010000:00010000:3.0:1785774837.786985:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774837.786987:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:3.0:1785774837.787096:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+111:19337:x1872519648545408:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 5810us (6027us total) trans 4294983693 rc 0/0 00000100:00100000:3.0:1785774837.787107:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23912 00000020:00080000:3.0:1785774837.787115:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.803073:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.803242:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648545664 00000100:00100000:1.0:1785774837.803257:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648545664 00000100:00100000:1.0:1785774837.803332:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5138 00000100:00100000:1.0:1785774837.803345:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+111:19337:x1872519648545664:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.803717:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983694 00000100:00100000:1.0:1785774837.803979:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+113:19337:x1872519648545664:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 634us (918us total) trans 4294983695 rc 0/0 00000100:00100000:1.0:1785774837.803989:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5138 00000020:00080000:1.0:1785774837.803995:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.812051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.814841:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648545920 00000100:00100000:0.0:1785774837.814863:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648545920 00000100:00100000:0.0:1785774837.814966:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23913 00000100:00100000:0.0:1785774837.814980:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+113:19337:x1872519648545920:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.815022:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.815056:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ffbc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2b8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815254:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815271:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815284:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815298:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815305:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815311:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774837.815757:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d6:0x0], index 1: 0 00010000:00010000:0.0:1785774837.815978:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ffd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815988:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.815997:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ffd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774837.816056:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983696 00010000:00010000:0.0:1785774837.816091:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816099:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816106:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816113:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816120:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774837.816125:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816134:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816149:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774837.816152:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774837.816157:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816206:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d09ffc3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774837.816229:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000265e0170 reply state 00000000d273dba0 transno 4294983697 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816241:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816247:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d30507d (ffff9b7706383900) 00010000:00010000:0.0:1785774837.816250:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774837.816253:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774837.816287:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ffbc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2b8 expref: 117 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816304:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ffd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2b8 expref: 116 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.816312:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9b7706383800) 00010000:00010000:0.0:1785774837.816315:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774837.816317:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3800, rc 0) 00000100:00100000:0.0:1785774837.816404:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+117:19337:x1872519648545920:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1427us (4368us total) trans 4294983697 rc 0/0 00000100:00100000:0.0:1785774837.816411:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23913 00000020:00080000:0.0:1785774837.816418:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774837.827055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.827208:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648546176 00000100:00100000:2.0:1785774837.827222:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648546176 00000100:00100000:2.0:1785774837.827291:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5139 00000100:00100000:2.0:1785774837.827302:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+117:19337:x1872519648546176:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774837.827671:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983698 00000100:00100000:2.0:1785774837.827794:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+119:19337:x1872519648546176:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 493us (753us total) trans 4294983699 rc 0/0 00000100:00100000:2.0:1785774837.827802:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5139 00000020:00080000:2.0:1785774837.827809:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.831474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.835600:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648546432 00000100:00100000:0.0:1785774837.835620:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648546432 00000100:00100000:0.0:1785774837.835865:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23914 00000100:00100000:0.0:1785774837.835879:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+119:19337:x1872519648546432:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.835922:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.836115:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ffdf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.838913:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.838940:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.839003:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.839026:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.839033:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.839039:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.839562:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d7:0x0], index 0: 0 00010000:00010000:2.0:1785774837.843292:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09fff4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843320:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09fff4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843333:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09fff4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.843461:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983700 00010000:00010000:2.0:1785774837.843521:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843531:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843538:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843545:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843556:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.843562:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843571:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843587:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.843590:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.843596:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843602:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d09ffe6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.843623:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001445c8c1 reply state 000000008166da20 transno 4294983701 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843633:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843639:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa468b7d (ffff9b7605dfee00) 00010000:00010000:2.0:1785774837.843641:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.843645:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.843704:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d09ffdf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2bf expref: 123 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843731:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09fff4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2bf expref: 122 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.843743:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9b7605dfe700) 00010000:00010000:2.0:1785774837.843745:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.843747:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044000, rc 0) 00000100:00100000:2.0:1785774837.843842:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+123:19337:x1872519648546432:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7956us (12370us total) trans 4294983701 rc 0/0 00000100:00100000:2.0:1785774837.843851:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23914 00000020:00080000:2.0:1785774837.843858:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.860064:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.860227:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648546688 00000100:00100000:3.0:1785774837.860240:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648546688 00000100:00100000:3.0:1785774837.860332:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5140 00000100:00100000:3.0:1785774837.860345:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ededc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+123:19337:x1872519648546688:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774837.861825:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983702 00000100:00100000:3.0:1785774837.862094:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ededc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+125:19337:x1872519648546688:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1750us (2042us total) trans 4294983703 rc 0/0 00000100:00100000:3.0:1785774837.862105:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5140 00000020:00080000:3.0:1785774837.862111:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.874214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.874370:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648546944 00000100:00100000:2.0:1785774837.874383:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648546944 00000100:00100000:2.0:1785774837.874457:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23915 00000100:00100000:2.0:1785774837.874467:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+125:19337:x1872519648546944:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.874500:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.874526:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a0002 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2c6 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.874665:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.874683:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.874708:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.874723:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.874729:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.874736:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.875247:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d7:0x0], index 1: 0 00010000:00010000:2.0:1785774837.875431:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a0017 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875441:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a0017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875449:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a0017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.875511:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983704 00010000:00010000:2.0:1785774837.875548:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875556:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875563:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875570:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875576:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.875581:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875589:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875604:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.875608:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.875613:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875621:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0009 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.875635:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039229c08 reply state 00000000f59a39bb transno 4294983705 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875647:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875654:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdf501a7d (ffff9b7605dfed00) 00010000:00010000:2.0:1785774837.875657:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.875659:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.875689:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a0002 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2c6 expref: 129 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875707:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a0017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2c6 expref: 128 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.875716:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9b7604f39000) 00010000:00010000:2.0:1785774837.875718:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.875720:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044800, rc 0) 00000100:00100000:2.0:1785774837.875791:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+129:19337:x1872519648546944:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1324us (1629us total) trans 4294983705 rc 0/0 00000100:00100000:2.0:1785774837.875798:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23915 00000020:00080000:2.0:1785774837.875805:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774837.894304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.894452:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648547200 00000100:00100000:3.0:1785774837.894465:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648547200 00000100:00100000:3.0:1785774837.894532:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5141 00000100:00100000:3.0:1785774837.894545:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+129:19337:x1872519648547200:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774837.894923:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983706 00000100:00100000:3.0:1785774837.895707:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+131:19337:x1872519648547200:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1162us (1413us total) trans 4294983707 rc 0/0 00000100:00100000:3.0:1785774837.895716:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5141 00000020:00080000:3.0:1785774837.895723:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.906310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774837.906423:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648547456 00000100:00100000:0.0:1785774837.906438:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648547456 00000100:00100000:0.0:1785774837.906513:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23916 00000100:00100000:0.0:1785774837.906526:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+131:19337:x1872519648547456:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774837.906560:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774837.906589:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a0025 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2cd expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.906743:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.906761:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.906775:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.906792:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.906801:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.906809:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774837.907320:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d8:0x0], index 0: 0 00010000:00010000:0.0:1785774837.907523:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a003a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907533:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a003a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907541:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a003a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774837.907600:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983708 00010000:00010000:0.0:1785774837.907639:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907647:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907653:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907660:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907667:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774837.907672:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907681:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907695:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774837.907698:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774837.907704:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907710:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a002c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774837.907731:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016a8c15a reply state 00000000842671f2 transno 4294983709 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907743:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907750:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b6840d2 (ffff9b7706383300) 00010000:00010000:0.0:1785774837.907752:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774837.907755:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774837.907787:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a0025 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2cd expref: 135 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907804:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a003a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2cd expref: 134 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774837.907812:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9b7706383c00) 00010000:00010000:0.0:1785774837.907815:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774837.907817:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3600, rc 0) 00000100:00100000:0.0:1785774837.907908:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+135:19337:x1872519648547456:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1384us (1612us total) trans 4294983709 rc 0/0 00000100:00100000:0.0:1785774837.907917:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23916 00000020:00080000:0.0:1785774837.907923:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774837.919843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774837.919979:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648547712 00000100:00100000:1.0:1785774837.919993:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648547712 00000100:00100000:1.0:1785774837.920073:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5142 00000100:00100000:1.0:1785774837.920085:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+135:19337:x1872519648547712:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774837.920953:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983710 00000100:00100000:1.0:1785774837.921128:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+137:19337:x1872519648547712:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1042us (1304us total) trans 4294983711 rc 0/0 00000100:00100000:1.0:1785774837.921138:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5142 00000020:00080000:1.0:1785774837.921144:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774837.941918:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774837.942300:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648547968 00000100:00100000:2.0:1785774837.942315:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648547968 00000100:00100000:2.0:1785774837.942399:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23917 00000100:00100000:2.0:1785774837.942413:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+137:19337:x1872519648547968:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774837.942450:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774837.942487:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0048 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2d4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.942632:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.942650:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.942664:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.942680:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.942687:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.942822:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774837.943865:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d8:0x0], index 1: 0 00010000:00010000:2.0:1785774837.946418:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a005d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.946443:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a005d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.946460:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a005d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.947689:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983712 00010000:00010000:2.0:1785774837.948859:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.948872:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.948877:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.948883:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.948889:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.948893:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.949238:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.949255:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.949258:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.949264:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.949271:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a004f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.949291:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064348329 reply state 000000002d418518 transno 4294983713 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.949304:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.949312:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0674fd2 (ffff9b7604f39800) 00010000:00010000:2.0:1785774837.949315:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.949318:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.949379:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0048 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2d4 expref: 141 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.949397:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a005d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2d4 expref: 140 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.949407:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9b7604f39d00) 00010000:00010000:2.0:1785774837.949409:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.949412:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c35b800, rc 0) 00000100:00100000:2.0:1785774837.949605:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+141:19337:x1872519648547968:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7193us (7711us total) trans 4294983713 rc 0/0 00000100:00100000:2.0:1785774837.949616:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23917 00000020:00080000:2.0:1785774837.949623:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.963461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.963569:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648548224 00000100:00100000:3.0:1785774837.963585:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648548224 00000100:00100000:3.0:1785774837.963662:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5143 00000100:00100000:3.0:1785774837.963675:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+141:19337:x1872519648548224:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774837.964060:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983714 00000100:00100000:3.0:1785774837.964421:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+143:19337:x1872519648548224:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 746us (972us total) trans 4294983715 rc 0/0 00000100:00100000:3.0:1785774837.964431:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5143 00000020:00080000:3.0:1785774837.964436:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774837.975939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774837.976135:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648548480 00000100:00100000:3.0:1785774837.976149:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648548480 00000100:00100000:3.0:1785774837.976257:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23918 00000100:00100000:3.0:1785774837.976269:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+143:19337:x1872519648548480:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774837.976304:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774837.976334:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a006b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2db expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.976491:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.976509:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.976522:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.976536:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.976543:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774837.976549:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774837.978151:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d9:0x0], index 0: 0 00010000:00010000:2.0:1785774837.978728:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fca600/0x7b7109e1d0a0080 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978743:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fca600/0x7b7109e1d0a0080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978753:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fca600/0x7b7109e1d0a0080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774837.978814:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983716 00010000:00010000:2.0:1785774837.978863:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978871:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978876:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978882:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978889:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774837.978893:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978899:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978912:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774837.978915:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774837.978919:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978924:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a0072 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774837.978938:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f16d652d reply state 0000000064265cc0 transno 4294983717 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978954:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.978960:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x65f522d2 (ffff9b77199f5500) 00010000:00010000:2.0:1785774837.978963:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774837.978965:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774837.979003:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a006b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2db expref: 147 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.979019:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fca600/0x7b7109e1d0a0080 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2db expref: 146 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774837.979028:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:2.0:1785774837.979030:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774837.979033:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7731fca600, rc 0) 00000100:00100000:2.0:1785774837.979119:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+147:19337:x1872519648548480:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2852us (3193us total) trans 4294983717 rc 0/0 00000100:00100000:2.0:1785774837.979128:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23918 00000020:00080000:2.0:1785774837.979134:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.004665:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774838.004856:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648548736 00000100:00100000:1.0:1785774838.004869:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648548736 00000100:00100000:1.0:1785774838.004971:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5144 00000100:00100000:1.0:1785774838.004983:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+147:19337:x1872519648548736:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774838.005378:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983718 00000100:00100000:1.0:1785774838.005499:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+149:19337:x1872519648548736:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 517us (848us total) trans 4294983719 rc 0/0 00000100:00100000:1.0:1785774838.005507:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5144 00000020:00080000:1.0:1785774838.005513:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1785774838.005627:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774838.029549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.029806:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648548992 00000100:00100000:3.0:1785774838.029820:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648548992 00000100:00100000:0.0:1785774838.029946:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23919 00000100:00100000:0.0:1785774838.029962:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+149:19337:x1872519648548992:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774838.029995:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774838.030021:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a008e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2e2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.030155:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.030205:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.030219:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.030236:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.030242:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.030248:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774838.030678:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d9:0x0], index 1: 0 00010000:00010000:0.0:1785774838.031142:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a00a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031152:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a00a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031174:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a00a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774838.031233:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983720 00010000:00010000:0.0:1785774838.031267:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031274:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031280:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031286:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031291:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774838.031296:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031303:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031315:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774838.031318:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774838.031322:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031328:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0095 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774838.031351:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c92388d6 reply state 0000000078bed413 transno 4294983721 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031364:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031370:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x38feb1d2 (ffff9b7706383000) 00010000:00010000:0.0:1785774838.031373:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774838.031376:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774838.031411:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a008e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2e2 expref: 153 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031429:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a00a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2e2 expref: 152 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.031438:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:0.0:1785774838.031441:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774838.031444:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1600, rc 0) 00000100:00100000:0.0:1785774838.031524:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+153:19337:x1872519648548992:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1566us (1990us total) trans 4294983721 rc 0/0 00000100:00100000:0.0:1785774838.031532:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23919 00000020:00080000:0.0:1785774838.031539:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.051401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.051516:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648549248 00000100:00100000:3.0:1785774838.051529:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648549248 00000100:00100000:3.0:1785774838.051608:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5145 00000100:00100000:3.0:1785774838.051619:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+153:19337:x1872519648549248:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774838.051992:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983722 00000100:00100000:3.0:1785774838.052400:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+155:19337:x1872519648549248:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 780us (1010us total) trans 4294983723 rc 0/0 00000100:00100000:3.0:1785774838.052409:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5145 00000020:00080000:3.0:1785774838.052415:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.075104:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.079322:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648549504 00000100:00100000:2.0:1785774838.079342:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648549504 00000100:00100000:2.0:1785774838.079428:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23920 00000100:00100000:2.0:1785774838.079441:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+155:19337:x1872519648549504:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.079477:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.079507:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.079662:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.079681:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.080121:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.080143:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.080151:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.080265:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.082131:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9da:0x0], index 0: 0 00010000:00010000:2.0:1785774838.085129:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcaa00/0x7b7109e1d0a00c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.085156:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcaa00/0x7b7109e1d0a00c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.086248:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcaa00/0x7b7109e1d0a00c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.086426:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983724 00010000:00010000:2.0:1785774838.086503:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087646:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087655:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087664:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087670:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731fcb800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.087676:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087684:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087712:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.087715:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.087722:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087729:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.087749:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000653cdb66 reply state 000000007774400d transno 4294983725 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087763:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087770:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7c0bdcd2 (ffff9b7604f39c00) 00010000:00010000:2.0:1785774838.087773:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.087777:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.087857:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2e9 expref: 159 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087874:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcaa00/0x7b7109e1d0a00c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2e9 expref: 158 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.087881:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9b7604f39200) 00010000:00010000:2.0:1785774838.087883:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.087885:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7731fcaa00, rc 0) 00000100:00100000:2.0:1785774838.088216:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+159:19337:x1872519648549504:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 8776us (13125us total) trans 4294983725 rc 0/0 00000100:00100000:2.0:1785774838.088227:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23920 00000020:00080000:2.0:1785774838.088235:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774838.108900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.110666:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648549760 00000100:00100000:2.0:1785774838.110683:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648549760 00000100:00100000:2.0:1785774838.110785:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5146 00000100:00100000:2.0:1785774838.110797:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+159:19337:x1872519648549760:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.111345:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983726 00000100:00100000:2.0:1785774838.112576:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+161:19337:x1872519648549760:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1775us (3687us total) trans 4294983727 rc 0/0 00000100:00100000:2.0:1785774838.112589:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5146 00000020:00080000:2.0:1785774838.112598:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774838.126907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.127055:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648550016 00000100:00100000:2.0:1785774838.127073:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648550016 00000100:00100000:2.0:1785774838.127214:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23921 00000100:00100000:2.0:1785774838.127228:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+161:19337:x1872519648550016:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.127262:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.127292:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2f0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.127453:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.127477:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.127494:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.127512:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.127534:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.127542:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.128268:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9da:0x0], index 1: 0 00010000:00010000:2.0:1785774838.128498:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcac00/0x7b7109e1d0a00e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.128510:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcac00/0x7b7109e1d0a00e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.128519:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcac00/0x7b7109e1d0a00e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.128593:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983728 00010000:00010000:2.0:1785774838.128633:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.128643:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.128651:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.128660:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.128667:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731fcb800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.128672:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.128681:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.130451:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.130465:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.130475:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.130488:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.130513:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc77c72b reply state 0000000095583f29 transno 4294983729 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.130534:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.130541:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x27156bd2 (ffff9b7604f39e00) 00010000:00010000:2.0:1785774838.130544:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.130549:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.130612:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2f0 expref: 165 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.130632:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcac00/0x7b7109e1d0a00e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2f0 expref: 164 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.130641:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9b7604f39b00) 00010000:00010000:2.0:1785774838.130643:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.130647:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7731fcac00, rc 0) 00000100:00100000:2.0:1785774838.130759:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+165:19337:x1872519648550016:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3532us (3871us total) trans 4294983729 rc 0/0 00000100:00100000:2.0:1785774838.130768:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23921 00000020:00080000:2.0:1785774838.130776:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.142939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.143123:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648550272 00000100:00100000:3.0:1785774838.143135:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648550272 00000100:00100000:3.0:1785774838.143233:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5147 00000100:00100000:3.0:1785774838.143244:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+165:19337:x1872519648550272:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774838.143627:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983730 00000100:00100000:3.0:1785774838.145054:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+167:19337:x1872519648550272:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 703us (1021us total) trans 4294983731 rc 0/0 00000100:00100000:3.0:1785774838.145070:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5147 00000020:00080000:3.0:1785774838.145077:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774838.156890:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.157206:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648550528 00000100:00100000:2.0:1785774838.157220:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648550528 00000100:00100000:2.0:1785774838.157292:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23922 00000100:00100000:2.0:1785774838.157304:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+167:19337:x1872519648550528:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.157335:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.157363:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00f7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2f7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.157534:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.157552:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.157568:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.157586:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.157594:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.157600:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.158044:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9db:0x0], index 0: 0 00010000:00010000:2.0:1785774838.158287:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a010c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158297:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a010c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158304:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a010c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.158362:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983732 00010000:00010000:2.0:1785774838.158403:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158416:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158422:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158430:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158436:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731fcb200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.158442:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158451:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158465:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.158469:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.158475:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158482:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a00fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.158497:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa30e8f4 reply state 000000003df0666b transno 4294983733 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158510:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158517:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfd213ed2 (ffff9b7604f39600) 00010000:00010000:2.0:1785774838.158520:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.158523:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.158557:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a00f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2f7 expref: 171 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158571:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a010c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2f7 expref: 170 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.158577:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9b7604f39500) 00010000:00010000:2.0:1785774838.158580:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.158581:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045000, rc 0) 00000100:00100000:2.0:1785774838.158654:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+171:19337:x1872519648550528:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1352us (1779us total) trans 4294983733 rc 0/0 00000100:00100000:2.0:1785774838.158660:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23922 00000020:00080000:2.0:1785774838.158666:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.173073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.173216:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648550784 00000100:00100000:0.0:1785774838.173230:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648550784 00000100:00100000:0.0:1785774838.173304:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5148 00000100:00100000:0.0:1785774838.173315:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+171:19337:x1872519648550784:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.173877:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983734 00000100:00100000:0.0:1785774838.174075:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+173:19337:x1872519648550784:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 760us (1013us total) trans 4294983735 rc 0/0 00000100:00100000:0.0:1785774838.174084:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5148 00000020:00080000:0.0:1785774838.174090:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.191888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.191997:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648551040 00000100:00100000:2.0:1785774838.192011:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648551040 00000100:00100000:2.0:1785774838.192088:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23923 00000100:00100000:2.0:1785774838.192100:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+173:19337:x1872519648551040:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.192130:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.192155:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a011a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c2fe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.192320:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.192340:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.192354:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.192371:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.192379:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.192387:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.192920:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9db:0x0], index 1: 0 00010000:00010000:2.0:1785774838.193135:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155600/0x7b7109e1d0a012f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193147:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155600/0x7b7109e1d0a012f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193156:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155600/0x7b7109e1d0a012f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.193266:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983736 00010000:00010000:2.0:1785774838.193304:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193312:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193319:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193331:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193338:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731fcb200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.193343:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193352:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193366:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.193369:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.193375:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193383:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a0121 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.193397:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085ce2d87 reply state 0000000026e0a82c transno 4294983737 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193412:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193418:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x81a24dd2 (ffff9b7604f39100) 00010000:00010000:2.0:1785774838.193421:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.193424:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.193460:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a011a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2fe expref: 177 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193484:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155600/0x7b7109e1d0a012f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2fe expref: 176 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.193492:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9b7604f39a00) 00010000:00010000:2.0:1785774838.193494:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.193497:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155600, rc 0) 00000100:00100000:2.0:1785774838.193582:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+177:19337:x1872519648551040:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1484us (1706us total) trans 4294983737 rc 0/0 00000100:00100000:2.0:1785774838.193591:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23923 00000020:00080000:2.0:1785774838.193600:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.242432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.242608:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648551296 00000100:00100000:3.0:1785774838.242621:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648551296 00000100:00100000:3.0:1785774838.242691:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5149 00000100:00100000:3.0:1785774838.242701:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+177:19337:x1872519648551296:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774838.243088:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983738 00000100:00100000:3.0:1785774838.243250:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+179:19337:x1872519648551296:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 549us (830us total) trans 4294983739 rc 0/0 00000100:00100000:3.0:1785774838.243258:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5149 00000020:00080000:3.0:1785774838.243264:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774838.264705:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.264887:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648551552 00000100:00100000:2.0:1785774838.264902:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648551552 00000100:00100000:2.0:1785774838.264993:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23924 00000100:00100000:2.0:1785774838.265005:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+179:19337:x1872519648551552:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.265047:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.265081:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a013d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c305 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.265311:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.265554:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.265572:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.265596:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.265604:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.265611:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.267137:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dc:0x0], index 0: 0 00010000:00010000:2.0:1785774838.268322:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155200/0x7b7109e1d0a0152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.268769:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155200/0x7b7109e1d0a0152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.268786:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155200/0x7b7109e1d0a0152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.268933:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983740 00010000:00010000:2.0:1785774838.269060:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269069:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269076:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269083:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269095:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.269101:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269109:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269126:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.269129:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.269135:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269142:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0144 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.269580:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fff81d95 reply state 00000000b3d24c22 transno 4294983741 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269615:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269623:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6cc088d2 (ffff9b7604f39300) 00010000:00010000:2.0:1785774838.269626:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.269629:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.269678:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a013d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c305 expref: 183 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269709:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155200/0x7b7109e1d0a0152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c305 expref: 182 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.269723:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9b7604f39900) 00010000:00010000:2.0:1785774838.269725:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.269728:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155200, rc 0) 00000100:00100000:2.0:1785774838.269822:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+183:19337:x1872519648551552:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4818us (5136us total) trans 4294983741 rc 0/0 00000100:00100000:2.0:1785774838.269840:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23924 00000020:00080000:2.0:1785774838.269847:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.276727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.276822:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648551808 00000100:00100000:3.0:1785774838.276843:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648551808 00000100:00100000:3.0:1785774838.276920:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5150 00000100:00100000:3.0:1785774838.276933:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+183:19337:x1872519648551808:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.277686:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983742 00000100:00100000:0.0:1785774838.277851:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+185:19337:x1872519648551808:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 916us (1134us total) trans 4294983743 rc 0/0 00000100:00100000:0.0:1785774838.277865:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5150 00000020:00080000:0.0:1785774838.277872:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.292706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.292838:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648552064 00000100:00100000:0.0:1785774838.292853:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648552064 00000100:00100000:0.0:1785774838.292933:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23925 00000100:00100000:0.0:1785774838.292955:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+185:19337:x1872519648552064:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774838.292989:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774838.293016:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0160 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c30c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.293218:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.293237:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.293252:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.293270:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.293278:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.293286:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774838.293883:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dc:0x0], index 1: 0 00010000:00010000:0.0:1785774838.294870:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0175 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.294889:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.294901:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774838.295606:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983744 00010000:00010000:0.0:1785774838.295673:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.295683:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.296305:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.296318:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.296325:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774838.296626:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.296639:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.296678:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774838.296681:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774838.296686:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.296995:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0167 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774838.297023:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021d14f07 reply state 000000000d546cb5 transno 4294983745 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.297038:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.297047:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe9ca17d2 (ffff9b7702bc0600) 00010000:00010000:0.0:1785774838.297049:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774838.297053:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774838.297104:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0160 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c30c expref: 189 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.297120:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0175 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c30c expref: 188 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.297130:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:0.0:1785774838.297132:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774838.297134:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1200, rc 0) 00000100:00100000:0.0:1785774838.298206:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+189:19337:x1872519648552064:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 5219us (5481us total) trans 4294983745 rc 0/0 00000100:00100000:0.0:1785774838.298218:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23925 00000020:00080000:0.0:1785774838.298226:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.317770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.317955:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648552320 00000100:00100000:0.0:1785774838.317971:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648552320 00000100:00100000:0.0:1785774838.318044:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5151 00000100:00100000:0.0:1785774838.318056:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+189:19337:x1872519648552320:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.318438:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983746 00000100:00100000:0.0:1785774838.318570:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+191:19337:x1872519648552320:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 516us (818us total) trans 4294983747 rc 0/0 00000100:00100000:0.0:1785774838.318578:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5151 00000020:00080000:0.0:1785774838.318584:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.334226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.334353:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648552576 00000100:00100000:3.0:1785774838.334372:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648552576 00000100:00100000:3.0:1785774838.334472:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23926 00000100:00100000:3.0:1785774838.334499:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+191:19337:x1872519648552576:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774838.334536:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774838.334568:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0183 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c313 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.335052:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.335074:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.335089:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.335106:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.335113:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.335120:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774838.336066:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dd:0x0], index 0: 0 00010000:00010000:3.0:1785774838.336672:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a0198 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.336686:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a0198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.337568:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a0198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774838.337672:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983748 00010000:00010000:3.0:1785774838.337880:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.337888:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.337895:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.337903:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.337910:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774838.337915:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.337924:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.337940:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774838.337997:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774838.338004:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.338015:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a018a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774838.338034:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000418041b reply state 000000003870f763 transno 4294983749 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.338046:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.338053:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa846083f (ffff9b77199f5700) 00010000:00010000:3.0:1785774838.338055:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774838.338059:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774838.338108:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0183 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c313 expref: 195 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.338124:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a0198 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c313 expref: 194 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.338132:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9b77199f5000) 00010000:00010000:3.0:1785774838.338134:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774838.338137:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744600, rc 0) 00000100:00100000:3.0:1785774838.338308:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+195:19337:x1872519648552576:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3812us (4100us total) trans 4294983749 rc 0/0 00000100:00100000:3.0:1785774838.338318:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23926 00000020:00080000:3.0:1785774838.338325:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.364552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.364684:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648552832 00000100:00100000:3.0:1785774838.364705:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648552832 00000100:00100000:3.0:1785774838.364785:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5152 00000100:00100000:3.0:1785774838.364797:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770eded850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+195:19337:x1872519648552832:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774838.366084:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983750 00000100:00100000:3.0:1785774838.366292:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770eded850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+197:19337:x1872519648552832:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1492us (1748us total) trans 4294983751 rc 0/0 00000100:00100000:3.0:1785774838.366303:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5152 00000020:00080000:3.0:1785774838.366310:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.388379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774838.388582:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648553088 00000100:00100000:1.0:1785774838.388596:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648553088 00000100:00100000:1.0:1785774838.388673:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23927 00000100:00100000:1.0:1785774838.388685:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+197:19337:x1872519648553088:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774838.388729:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774838.388757:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a01a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c31a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.388916:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.388935:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.389052:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.389073:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.389081:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.389086:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774838.390807:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dd:0x0], index 1: 0 00010000:00010000:1.0:1785774838.392272:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a01bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.392300:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a01bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.392313:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a01bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774838.393773:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983752 00010000:00010000:1.0:1785774838.393849:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.393859:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.393865:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.393871:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.393876:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774838.393881:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.393887:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.393904:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774838.393907:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774838.393912:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.393918:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a01ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774838.394676:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b02bb35 reply state 00000000b3364101 transno 4294983753 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.394754:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.394763:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb56f173f (ffff9b7605fcc300) 00010000:00010000:1.0:1785774838.394766:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774838.394769:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774838.397047:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a01a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c31a expref: 201 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.397088:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a01bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c31a expref: 200 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.397098:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9b7605fccf00) 00010000:00010000:1.0:1785774838.397102:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774838.397105:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00000100:00100000:1.0:1785774838.398290:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+201:19337:x1872519648553088:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 9599us (9919us total) trans 4294983753 rc 0/0 00000100:00100000:1.0:1785774838.398303:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23927 00000020:00080000:1.0:1785774838.398313:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.423287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.423441:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648553344 00000100:00100000:2.0:1785774838.423454:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648553344 00000100:00100000:2.0:1785774838.423520:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5153 00000100:00100000:2.0:1785774838.423531:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+201:19337:x1872519648553344:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.423909:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983754 00000100:00100000:2.0:1785774838.424040:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+203:19337:x1872519648553344:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 510us (765us total) trans 4294983755 rc 0/0 00000100:00100000:2.0:1785774838.424049:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5153 00000020:00080000:2.0:1785774838.424054:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774838.434559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.435113:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648553600 00000100:00100000:2.0:1785774838.435130:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648553600 00000100:00100000:2.0:1785774838.435284:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23928 00000100:00100000:2.0:1785774838.435300:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+203:19337:x1872519648553600:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.435354:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.435385:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a01c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c321 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.436765:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.436783:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.436797:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.436815:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.436821:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.436838:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.437311:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9de:0x0], index 0: 0 00010000:00010000:2.0:1785774838.440801:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154c00/0x7b7109e1d0a01de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.440836:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154c00/0x7b7109e1d0a01de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.440851:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154c00/0x7b7109e1d0a01de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.440960:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983756 00010000:00010000:2.0:1785774838.441009:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441022:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441029:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441038:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441045:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.441050:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441059:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441075:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.441079:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.441084:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441091:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a01d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.441111:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8a368fc reply state 000000001ddbbb43 transno 4294983757 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441124:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.441130:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5432ea3f (ffff9b7604f39400) 00010000:00010000:2.0:1785774838.441133:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.441136:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.442703:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a01c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c321 expref: 207 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.442738:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154c00/0x7b7109e1d0a01de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c321 expref: 206 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.442747:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9b7604f39700) 00010000:00010000:2.0:1785774838.442750:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.442753:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154c00, rc 0) 00000100:00100000:2.0:1785774838.442866:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+207:19337:x1872519648553600:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7569us (8324us total) trans 4294983757 rc 0/0 00000100:00100000:2.0:1785774838.442876:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23928 00000020:00080000:2.0:1785774838.442883:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774838.465933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.471978:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648553856 00000100:00100000:0.0:1785774838.472002:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648553856 00000100:00100000:0.0:1785774838.478870:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5154 00000100:00100000:0.0:1785774838.478896:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+207:19337:x1872519648553856:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.479591:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983758 00000100:00100000:0.0:1785774838.481525:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+209:19337:x1872519648553856:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 2626us (15593us total) trans 4294983759 rc 0/0 00000100:00100000:0.0:1785774838.481541:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5154 00000020:00080000:0.0:1785774838.481550:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.494215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.494302:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648554112 00000100:00100000:3.0:1785774838.494317:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648554112 00000100:00100000:3.0:1785774838.494872:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23929 00000100:00100000:3.0:1785774838.494886:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+209:19337:x1872519648554112:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774838.494922:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774838.494948:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a01ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c328 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495093:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495114:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495130:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495146:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495153:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495201:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774838.495702:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9de:0x0], index 1: 0 00010000:00010000:3.0:1785774838.495944:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a0201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495955:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a0201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.495963:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a0201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774838.496029:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983760 00010000:00010000:3.0:1785774838.496073:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.496081:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.496089:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.496096:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.496103:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774838.496108:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.496118:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.496133:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774838.496137:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774838.496142:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.496148:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a01f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774838.499315:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008581ebe reply state 000000005e00a43d transno 4294983761 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.499360:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.499372:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7f3c793f (ffff9b77199f5c00) 00010000:00010000:3.0:1785774838.499375:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774838.499381:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774838.501800:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a01ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c328 expref: 213 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.501848:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a0201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c328 expref: 212 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.501859:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9b77199f5b00) 00010000:00010000:3.0:1785774838.501862:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774838.501865:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745c00, rc 0) 00000100:00100000:3.0:1785774838.501989:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+213:19337:x1872519648554112:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7104us (7785us total) trans 4294983761 rc 0/0 00000100:00100000:3.0:1785774838.502000:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23929 00000020:00080000:3.0:1785774838.502009:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.518325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.518437:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648554368 00000100:00100000:0.0:1785774838.518449:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648554368 00000100:00100000:0.0:1785774838.518526:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5155 00000100:00100000:0.0:1785774838.518537:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+213:19337:x1872519648554368:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.518949:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983762 00000100:00100000:0.0:1785774838.519077:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+215:19337:x1872519648554368:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 541us (763us total) trans 4294983763 rc 0/0 00000100:00100000:0.0:1785774838.519085:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5155 00000020:00080000:0.0:1785774838.519090:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774838.527125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774838.527777:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648554624 00000100:00100000:1.0:1785774838.527791:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648554624 00000100:00100000:1.0:1785774838.527875:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23930 00000100:00100000:1.0:1785774838.527886:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+215:19337:x1872519648554624:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774838.527915:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774838.527947:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a020f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c32f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.528074:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.528091:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.528103:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.528117:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.528122:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.528128:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774838.530715:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9df:0x0], index 0: 0 00010000:00010000:1.0:1785774838.530957:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a0224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.530975:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a0224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.530987:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a0224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774838.531050:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983764 00010000:00010000:1.0:1785774838.531086:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531095:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531103:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531110:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531117:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774838.531121:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531129:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531145:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774838.531148:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774838.531153:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531178:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0216 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774838.531204:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d41870c4 reply state 00000000545141f8 transno 4294983765 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531244:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531251:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x98e9a43f (ffff9b7605fccd00) 00010000:00010000:1.0:1785774838.531253:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774838.531256:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774838.531292:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a020f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c32f expref: 219 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531308:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a0224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c32f expref: 218 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.531317:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9b7605fcc000) 00010000:00010000:1.0:1785774838.531319:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774838.531322:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce800, rc 0) 00000100:00100000:1.0:1785774838.531430:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+219:19337:x1872519648554624:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3545us (4317us total) trans 4294983765 rc 0/0 00000100:00100000:1.0:1785774838.531438:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23930 00000020:00080000:1.0:1785774838.531445:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.551741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.551870:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648554880 00000100:00100000:0.0:1785774838.551882:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648554880 00000100:00100000:0.0:1785774838.551975:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5156 00000100:00100000:0.0:1785774838.551987:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+219:19337:x1872519648554880:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.552393:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983766 00000100:00100000:0.0:1785774838.552516:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+221:19337:x1872519648554880:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 530us (790us total) trans 4294983767 rc 0/0 00000100:00100000:0.0:1785774838.552524:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5156 00000020:00080000:0.0:1785774838.552530:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785774838.571761:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774838.574934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.575221:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648555136 00000100:00100000:2.0:1785774838.575239:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648555136 00000100:00100000:2.0:1785774838.575347:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23931 00000100:00100000:2.0:1785774838.575363:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+221:19337:x1872519648555136:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.575410:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.575464:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0232 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c336 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.575650:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.575674:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.575698:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.575722:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.575730:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.575738:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.577090:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9df:0x0], index 1: 0 00010000:00010000:2.0:1785774838.577313:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154a00/0x7b7109e1d0a0247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577324:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154a00/0x7b7109e1d0a0247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577333:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154a00/0x7b7109e1d0a0247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.577400:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983768 00010000:00010000:2.0:1785774838.577440:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577448:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577455:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577465:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577471:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.577475:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577482:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577498:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.577501:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.577504:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577510:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0239 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.577533:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077719432 reply state 000000000769b27d transno 4294983769 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577546:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577552:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x43f3333f (ffff9b760572bc00) 00010000:00010000:2.0:1785774838.577555:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.577558:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.577595:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a0232 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c336 expref: 225 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577615:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154a00/0x7b7109e1d0a0247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c336 expref: 224 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.577622:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9b760572bd00) 00010000:00010000:2.0:1785774838.577624:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.577626:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154a00, rc 0) 00000100:00100000:2.0:1785774838.582958:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+225:19337:x1872519648555136:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7580us (8018us total) trans 4294983769 rc 0/0 00000100:00100000:2.0:1785774838.582975:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23931 00000020:00080000:2.0:1785774838.582986:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774838.599094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.599247:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648555392 00000100:00100000:2.0:1785774838.599260:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648555392 00000100:00100000:2.0:1785774838.599353:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5157 00000100:00100000:2.0:1785774838.599367:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+225:19337:x1872519648555392:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.599990:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983770 00000100:00100000:2.0:1785774838.600212:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+227:19337:x1872519648555392:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 847us (1131us total) trans 4294983771 rc 0/0 00000100:00100000:2.0:1785774838.600221:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5157 00000020:00080000:2.0:1785774838.600226:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.624957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.625035:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648555648 00000100:00100000:2.0:1785774838.625048:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648555648 00000100:00100000:2.0:1785774838.625127:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23932 00000100:00100000:2.0:1785774838.625139:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+227:19337:x1872519648555648:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.625197:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.625226:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0255 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c33d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.625368:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.625386:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.625400:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.625416:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.625423:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.625431:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.626106:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e0:0x0], index 0: 0 00010000:00010000:2.0:1785774838.626983:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155800/0x7b7109e1d0a026a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.626995:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155800/0x7b7109e1d0a026a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627005:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155800/0x7b7109e1d0a026a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.627084:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983772 00010000:00010000:2.0:1785774838.627126:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627140:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627147:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627155:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627194:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.627199:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627209:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627223:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.627227:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.627233:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627240:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a025c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.627257:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2dfaa6a reply state 000000007256ce64 transno 4294983773 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627270:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627277:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5ae1063f (ffff9b760572b800) 00010000:00010000:2.0:1785774838.627281:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.627283:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.627318:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a0255 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c33d expref: 231 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627653:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155800/0x7b7109e1d0a026a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c33d expref: 230 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.627663:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9b760572ba00) 00010000:00010000:2.0:1785774838.627666:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.627668:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155800, rc 0) 00000100:00100000:2.0:1785774838.627887:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+231:19337:x1872519648555648:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2750us (2943us total) trans 4294983773 rc 0/0 00000100:00100000:2.0:1785774838.627898:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23932 00000020:00080000:2.0:1785774838.627905:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.649381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.656099:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648555904 00000100:00100000:0.0:1785774838.656118:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648555904 00000100:00100000:0.0:1785774838.656216:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5158 00000100:00100000:0.0:1785774838.656228:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+231:19337:x1872519648555904:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.656617:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983774 00000100:00100000:0.0:1785774838.656756:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+233:19337:x1872519648555904:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 530us (7388us total) trans 4294983775 rc 0/0 00000100:00100000:0.0:1785774838.656766:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5158 00000020:00080000:0.0:1785774838.656772:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774838.664374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774838.664566:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648556160 00000100:00100000:1.0:1785774838.664579:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648556160 00000100:00100000:1.0:1785774838.664904:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23933 00000100:00100000:1.0:1785774838.664917:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+233:19337:x1872519648556160:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774838.664954:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774838.664983:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a0278 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c344 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.665123:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.665142:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.665156:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.665217:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.665224:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.665231:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774838.666265:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e0:0x0], index 1: 0 00010000:00010000:1.0:1785774838.669059:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a028d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669087:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a028d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669103:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a028d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774838.669251:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983776 00010000:00010000:1.0:1785774838.669294:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669307:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669313:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669321:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669327:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774838.669332:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669341:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669357:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774838.669361:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774838.669367:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.669374:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a027f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774838.670620:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dfd59961 reply state 00000000428218c6 transno 4294983777 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.670643:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.670651:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6fe0153f (ffff9b7605fcc400) 00010000:00010000:1.0:1785774838.670655:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774838.670660:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774838.670784:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a0278 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c344 expref: 237 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.670811:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a028d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c344 expref: 236 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774838.670819:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9b7605fcc700) 00010000:00010000:1.0:1785774838.670831:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774838.670834:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cec00, rc 0) 00000100:00100000:1.0:1785774838.671057:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+237:19337:x1872519648556160:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 6141us (6698us total) trans 4294983777 rc 0/0 00000100:00100000:1.0:1785774838.671068:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23933 00000020:00080000:1.0:1785774838.671076:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.694022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.695405:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648556416 00000100:00100000:2.0:1785774838.695419:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648556416 00000100:00100000:2.0:1785774838.695506:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5159 00000100:00100000:2.0:1785774838.695527:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+237:19337:x1872519648556416:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.695883:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983778 00000100:00100000:2.0:1785774838.697245:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+239:19337:x1872519648556416:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1724us (3233us total) trans 4294983779 rc 0/0 00000100:00100000:2.0:1785774838.697257:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5159 00000020:00080000:2.0:1785774838.697263:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.715954:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.717834:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648556672 00000100:00100000:0.0:1785774838.717847:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648556672 00000100:00100000:0.0:1785774838.717928:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23934 00000100:00100000:0.0:1785774838.717940:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+239:19337:x1872519648556672:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774838.717971:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774838.717995:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a029b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c34b expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.718121:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.718138:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.718152:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.718207:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.718216:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.718224:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774838.718639:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e1:0x0], index 0: 0 00010000:00010000:0.0:1785774838.719860:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a02b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.719872:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a02b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.719885:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a02b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774838.720376:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983780 00010000:00010000:0.0:1785774838.720414:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.720422:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.720429:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.720436:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.720443:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774838.720447:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.720456:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.720473:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774838.720477:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774838.720482:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.720490:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a02a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774838.720511:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000051614ad reply state 00000000e39b27c4 transno 4294983781 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.721044:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.721052:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa91e503f (ffff9b7702bc0300) 00010000:00010000:0.0:1785774838.721055:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774838.721058:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774838.721105:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a029b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c34b expref: 243 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.721125:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a02b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c34b expref: 242 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.721133:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:0.0:1785774838.721136:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774838.721138:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca0000, rc 0) 00000100:00100000:0.0:1785774838.725905:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+243:19337:x1872519648556672:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7950us (9946us total) trans 4294983781 rc 0/0 00000100:00100000:0.0:1785774838.725921:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23934 00000020:00080000:0.0:1785774838.725932:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.738109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.738995:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648556928 00000100:00100000:0.0:1785774838.739009:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648556928 00000100:00100000:0.0:1785774838.739084:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5160 00000100:00100000:0.0:1785774838.739095:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+243:19337:x1872519648556928:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.739474:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983782 00000100:00100000:0.0:1785774838.739620:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+245:19337:x1872519648556928:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 525us (1524us total) trans 4294983783 rc 0/0 00000100:00100000:0.0:1785774838.739634:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5160 00000020:00080000:0.0:1785774838.739640:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.752710:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.752955:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648557184 00000100:00100000:2.0:1785774838.752968:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648557184 00000100:00100000:2.0:1785774838.753049:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23935 00000100:00100000:2.0:1785774838.753060:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+245:19337:x1872519648557184:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.753093:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.753136:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154000/0x7b7109e1d0a02be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c352 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.753297:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.753317:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.753331:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.753349:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.753357:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.753364:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.753855:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e1:0x0], index 1: 0 00010000:00010000:2.0:1785774838.754040:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a02d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754049:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a02d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754059:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a02d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.754112:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983784 00010000:00010000:2.0:1785774838.754148:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754156:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754184:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754193:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754201:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.754207:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754216:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754229:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.754233:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.754238:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754245:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.754261:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b588c078 reply state 00000000e676e449 transno 4294983785 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754275:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754281:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfc27df3f (ffff9b760572b100) 00010000:00010000:2.0:1785774838.754284:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.754287:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.754317:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154000/0x7b7109e1d0a02be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c352 expref: 249 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754330:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a02d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c352 expref: 248 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.754338:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9b760572b700) 00010000:00010000:2.0:1785774838.754340:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.754342:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155400, rc 0) 00000100:00100000:2.0:1785774838.754422:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+249:19337:x1872519648557184:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1363us (1733us total) trans 4294983785 rc 0/0 00000100:00100000:2.0:1785774838.754430:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23935 00000020:00080000:2.0:1785774838.754436:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.777104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774838.777354:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648557440 00000100:00100000:1.0:1785774838.777368:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648557440 00000100:00100000:1.0:1785774838.777519:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5161 00000100:00100000:1.0:1785774838.777532:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+249:19337:x1872519648557440:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774838.777954:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983786 00000100:00100000:1.0:1785774838.778078:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+251:19337:x1872519648557440:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 549us (986us total) trans 4294983787 rc 0/0 00000100:00100000:1.0:1785774838.778087:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5161 00000020:00080000:1.0:1785774838.778093:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774838.784286:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.784391:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648557696 00000100:00100000:2.0:1785774838.784404:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648557696 00000100:00100000:2.0:1785774838.784490:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23936 00000100:00100000:2.0:1785774838.784502:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+251:19337:x1872519648557696:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.784546:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.784574:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c359 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.784727:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.784745:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.784757:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.784775:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.784781:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.784788:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.785283:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e2:0x0], index 0: 0 00010000:00010000:2.0:1785774838.785485:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154000/0x7b7109e1d0a02f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785495:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154000/0x7b7109e1d0a02f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785502:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154000/0x7b7109e1d0a02f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.785566:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983788 00010000:00010000:2.0:1785774838.785607:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785619:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785627:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785634:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785640:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.785645:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785654:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785668:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.785672:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.785678:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785684:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a02e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.785700:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b39241a6 reply state 000000003734f298 transno 4294983789 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785712:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785719:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a358594 (ffff9b760572bb00) 00010000:00010000:2.0:1785774838.785722:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.785725:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.785758:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a02e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c359 expref: 255 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785775:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154000/0x7b7109e1d0a02f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c359 expref: 254 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.785783:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9b760572be00) 00010000:00010000:2.0:1785774838.785786:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.785789:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154000, rc 0) 00000100:00100000:2.0:1785774838.785867:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+255:19337:x1872519648557696:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1368us (1596us total) trans 4294983789 rc 0/0 00000100:00100000:2.0:1785774838.785876:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23936 00000020:00080000:2.0:1785774838.785881:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.815418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.815545:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648557952 00000100:00100000:0.0:1785774838.815558:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648557952 00000100:00100000:0.0:1785774838.815626:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5162 00000100:00100000:0.0:1785774838.815638:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+255:19337:x1872519648557952:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774838.815987:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983790 00000100:00100000:0.0:1785774838.816112:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+257:19337:x1872519648557952:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 475us (708us total) trans 4294983791 rc 0/0 00000100:00100000:0.0:1785774838.816119:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5162 00000020:00080000:0.0:1785774838.816125:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774838.823583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.823982:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648558208 00000100:00100000:0.0:1785774838.823995:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648558208 00000100:00100000:0.0:1785774838.824073:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23937 00000100:00100000:0.0:1785774838.824085:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+257:19337:x1872519648558208:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774838.824115:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774838.824141:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a0304 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c360 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.824309:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.824328:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.824342:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.824360:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.824368:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.824376:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774838.824783:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e2:0x0], index 1: 0 00010000:00010000:0.0:1785774838.825013:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d0a0319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825022:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d0a0319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825029:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d0a0319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774838.825079:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983792 00010000:00010000:0.0:1785774838.825113:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825120:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825126:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825131:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825143:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774838.825147:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825154:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825188:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774838.825191:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774838.825196:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825202:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a030b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774838.825224:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec0e9e34 reply state 0000000060f6b2d8 transno 4294983793 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825238:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825243:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3f3f1494 (ffff9b7702bc0000) 00010000:00010000:0.0:1785774838.825245:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774838.825248:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774838.825277:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a0304 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c360 expref: 261 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825291:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d0a0319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c360 expref: 260 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.825302:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9b7702bc0700) 00010000:00010000:0.0:1785774838.825304:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774838.825306:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca1800, rc 0) 00000100:00100000:0.0:1785774838.825373:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+261:19337:x1872519648558208:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1291us (1805us total) trans 4294983793 rc 0/0 00000100:00100000:0.0:1785774838.825379:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23937 00000020:00080000:0.0:1785774838.825384:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.858278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.861023:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648558464 00000100:00100000:2.0:1785774838.861038:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648558464 00000100:00100000:2.0:1785774838.861108:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5163 00000100:00100000:2.0:1785774838.861119:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+261:19337:x1872519648558464:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.861483:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983794 00000100:00100000:2.0:1785774838.861612:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+263:19337:x1872519648558464:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 493us (3348us total) trans 4294983795 rc 0/0 00000100:00100000:2.0:1785774838.861621:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5163 00000020:00080000:2.0:1785774838.861627:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.880512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.880673:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648558720 00000100:00100000:2.0:1785774838.880696:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648558720 00000100:00100000:2.0:1785774838.880775:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23938 00000100:00100000:2.0:1785774838.880788:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+263:19337:x1872519648558720:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774838.880849:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774838.880878:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a0327 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c367 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.881110:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.881129:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.881143:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.881580:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.881590:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.881599:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774838.882284:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e3:0x0], index 0: 0 00010000:00010000:2.0:1785774838.884078:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a033c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884094:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a033c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884105:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a033c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774838.884227:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983796 00010000:00010000:2.0:1785774838.884278:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884287:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884293:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884300:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884306:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774838.884311:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884319:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884333:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774838.884337:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774838.884342:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884348:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a032e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774838.884366:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d76af417 reply state 00000000ee67a7af transno 4294983797 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884383:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884389:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x584c3f94 (ffff9b760572b300) 00010000:00010000:2.0:1785774838.884392:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774838.884395:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774838.884438:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a0327 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c367 expref: 267 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884456:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a033c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c367 expref: 266 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774838.884464:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9b760572bf00) 00010000:00010000:2.0:1785774838.884466:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774838.884469:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7731fcb200, rc 0) 00000100:00100000:3.0:1785774838.889142:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+267:19337:x1872519648558720:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 8347us (8635us total) trans 4294983797 rc 0/0 00000100:00100000:3.0:1785774838.889155:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23938 00000020:00080000:3.0:1785774838.889182:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774838.894706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.894894:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648558976 00000100:00100000:2.0:1785774838.894907:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648558976 00000100:00100000:2.0:1785774838.894982:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5164 00000100:00100000:2.0:1785774838.894994:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+267:19337:x1872519648558976:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.895367:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983798 00000100:00100000:2.0:1785774838.895502:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+269:19337:x1872519648558976:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 509us (818us total) trans 4294983799 rc 0/0 00000100:00100000:2.0:1785774838.895510:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5164 00000020:00080000:2.0:1785774838.895515:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.908299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.908398:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648559232 00000100:00100000:0.0:1785774838.908413:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648559232 00000100:00100000:0.0:1785774838.908498:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23939 00000100:00100000:0.0:1785774838.908510:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+269:19337:x1872519648559232:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774838.908542:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774838.908587:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a034a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c36e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.908720:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.908740:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.908753:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.908770:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.908778:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.908786:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774838.909636:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e3:0x0], index 1: 0 00010000:00010000:0.0:1785774838.909846:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d0a035f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.909856:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d0a035f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.909864:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d0a035f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774838.911202:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983800 00010000:00010000:0.0:1785774838.911262:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911272:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911278:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911285:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911291:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774838.911296:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911302:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911327:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774838.911331:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774838.911336:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911342:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0351 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774838.911365:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e97e237 reply state 0000000061f701bb transno 4294983801 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911376:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911382:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x55367694 (ffff9b7702bc0b00) 00010000:00010000:0.0:1785774838.911384:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774838.911386:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774838.911429:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a034a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c36e expref: 273 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911447:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d0a035f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c36e expref: 272 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.911455:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9b7702bc0c00) 00010000:00010000:0.0:1785774838.911457:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774838.911460:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca0e00, rc 0) 00000100:00100000:0.0:1785774838.913150:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+273:19337:x1872519648559232:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4637us (4861us total) trans 4294983801 rc 0/0 00000100:00100000:0.0:1785774838.913954:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23939 00000020:00080000:0.0:1785774838.913963:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.924716:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.924838:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648559488 00000100:00100000:2.0:1785774838.924850:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648559488 00000100:00100000:2.0:1785774838.924927:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5165 00000100:00100000:2.0:1785774838.924938:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+273:19337:x1872519648559488:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.925289:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983802 00000100:00100000:2.0:1785774838.925389:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+275:19337:x1872519648559488:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 453us (684us total) trans 4294983803 rc 0/0 00000100:00100000:2.0:1785774838.925399:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5165 00000020:00080000:2.0:1785774838.925404:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774838.932800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774838.933998:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648559744 00000100:00100000:0.0:1785774838.934011:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648559744 00000100:00100000:0.0:1785774838.934089:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23940 00000100:00100000:0.0:1785774838.934099:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+275:19337:x1872519648559744:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774838.934129:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774838.934209:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a036d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c375 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.934340:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.934357:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.934368:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.934383:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.934389:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.934394:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774838.934813:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e4:0x0], index 0: 0 00010000:00010000:0.0:1785774838.935377:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a0382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.935386:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a0382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.935395:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a0382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774838.935449:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983804 00010000:00010000:0.0:1785774838.936573:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936583:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936588:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936596:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936602:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774838.936607:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936616:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936630:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774838.936633:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774838.936638:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936645:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a0374 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774838.936668:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000971a003e reply state 00000000cc9a3b6d transno 4294983805 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936680:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936687:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf0e3a194 (ffff9b7702bc0200) 00010000:00010000:0.0:1785774838.936690:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774838.936692:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774838.936730:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a036d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c375 expref: 279 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936748:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a0382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c375 expref: 278 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774838.936755:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9b7702bc0f00) 00010000:00010000:0.0:1785774838.936757:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774838.936759:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec3200, rc 0) 00000100:00100000:0.0:1785774838.936858:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+279:19337:x1872519648559744:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2759us (4069us total) trans 4294983805 rc 0/0 00000100:00100000:0.0:1785774838.936867:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23940 00000020:00080000:0.0:1785774838.936874:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.945324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774838.945425:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648560000 00000100:00100000:2.0:1785774838.945438:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648560000 00000100:00100000:2.0:1785774838.945521:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5166 00000100:00100000:2.0:1785774838.945533:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+279:19337:x1872519648560000:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.946337:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983806 00000100:00100000:2.0:1785774838.946460:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+281:19337:x1872519648560000:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 928us (1147us total) trans 4294983807 rc 0/0 00000100:00100000:2.0:1785774838.946518:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5166 00000020:00080000:2.0:1785774838.946524:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774838.950692:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671303424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774838.950782:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774838.950988:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303424 00000100:00100000:2.0:1785774838.950997:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303424 00000100:00100000:2.0:1785774838.951061:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:2.0:1785774838.951071:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671303424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774838.951117:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443962880 avail 1297723392 00000100:00100000:2.0:1785774838.951191:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671303424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774838.951199:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:3.0:1785774838.951289:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671303424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774838.957677:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.958060:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648560256 00000100:00100000:3.0:1785774838.958073:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648560256 00000100:00100000:3.0:1785774838.958144:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23941 00000100:00100000:3.0:1785774838.958155:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+281:19337:x1872519648560256:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774838.958207:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774838.958233:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0390 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c37c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.958373:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.958392:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.958407:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.958424:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.958431:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.958438:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774838.959015:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e4:0x0], index 1: 0 00010000:00010000:3.0:1785774838.959457:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a03a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959469:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a03a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959478:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a03a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774838.959541:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983808 00010000:00010000:3.0:1785774838.959578:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959587:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959594:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959602:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959614:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774838.959619:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959627:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959642:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774838.959645:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774838.959650:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959658:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0397 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774838.959673:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb58048a reply state 000000000dcc867f transno 4294983809 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959684:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959691:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2fe2b094 (ffff9b77199f5900) 00010000:00010000:3.0:1785774838.959694:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774838.959697:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774838.959730:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0390 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c37c expref: 285 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959747:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a03a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c37c expref: 284 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774838.959760:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9b77199f5e00) 00010000:00010000:3.0:1785774838.959762:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774838.959765:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745400, rc 0) 00000100:00100000:3.0:1785774838.959947:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+285:19337:x1872519648560256:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1792us (2282us total) trans 4294983809 rc 0/0 00000100:00100000:3.0:1785774838.959957:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23941 00000020:00080000:3.0:1785774838.959963:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774838.979994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774838.983682:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648560512 00000100:00100000:3.0:1785774838.983698:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648560512 00000100:00100000:2.0:1785774838.992245:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5167 00000100:00100000:2.0:1785774838.992265:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+285:19337:x1872519648560512:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774838.992813:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983810 00000100:00100000:2.0:1785774838.993061:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+287:19337:x1872519648560512:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 799us (13080us total) trans 4294983811 rc 0/0 00000100:00100000:2.0:1785774838.993071:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5167 00000020:00080000:2.0:1785774838.993077:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.002111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.002195:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648560768 00000100:00100000:0.0:1785774839.002208:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648560768 00000100:00100000:0.0:1785774839.002275:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23942 00000100:00100000:0.0:1785774839.002286:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+287:19337:x1872519648560768:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.002317:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.002345:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a03b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c383 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.002511:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.002528:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.002540:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.002556:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.002563:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.002570:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.003092:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e5:0x0], index 0: 0 00010000:00010000:0.0:1785774839.003424:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d0a03c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003434:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d0a03c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003442:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d0a03c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.003507:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983812 00010000:00010000:0.0:1785774839.003545:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003559:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003566:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003572:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003579:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.003583:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003591:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003627:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.003630:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.003635:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003641:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a03ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.003662:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1dea74f reply state 0000000036b6acd4 transno 4294983813 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.003678:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.004792:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xc8efdb94 (ffff9b7702bc0900) 00010000:00010000:0.0:1785774839.004796:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.004800:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.004857:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a03b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c383 expref: 291 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.004878:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d0a03c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c383 expref: 290 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.006466:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9b7602507600) 00010000:00010000:0.0:1785774839.006470:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.006474:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0800, rc 0) 00000100:00100000:0.0:1785774839.006616:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+291:19337:x1872519648560768:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4327us (4512us total) trans 4294983813 rc 0/0 00000100:00100000:0.0:1785774839.006627:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23942 00000020:00080000:0.0:1785774839.006635:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.026426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.031637:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648561024 00000100:00100000:2.0:1785774839.031659:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648561024 00000100:00100000:2.0:1785774839.031918:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5168 00000100:00100000:2.0:1785774839.031932:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+291:19337:x1872519648561024:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.032324:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983814 00000100:00100000:2.0:1785774839.032466:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+293:19337:x1872519648561024:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 536us (6052us total) trans 4294983815 rc 0/0 00000100:00100000:2.0:1785774839.032944:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5168 00000020:00080000:2.0:1785774839.032950:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.038265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.038982:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648561280 00000100:00100000:0.0:1785774839.038996:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648561280 00000100:00100000:0.0:1785774839.039140:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23943 00000100:00100000:0.0:1785774839.039155:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+293:19337:x1872519648561280:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.039220:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.039268:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d0a03d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c38a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.039409:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.039428:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.039447:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.039465:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.039483:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.039490:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.041259:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e5:0x0], index 1: 0 00010000:00010000:0.0:1785774839.045196:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d0a03eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045224:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d0a03eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045239:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d0a03eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.045414:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983816 00010000:00010000:0.0:1785774839.045616:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045626:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045632:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045646:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045654:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.045660:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045669:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045848:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.045853:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.045858:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045867:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a03dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.045943:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e3843b60 reply state 0000000023556d88 transno 4294983817 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045957:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.045963:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x45da1294 (ffff9b7602507400) 00010000:00010000:0.0:1785774839.045966:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.045970:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.046024:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d0a03d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c38a expref: 297 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.046047:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d0a03eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c38a expref: 296 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.046055:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:0.0:1785774839.046058:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.046060:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0000, rc 0) 00000100:00100000:0.0:1785774839.046245:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+297:19337:x1872519648561280:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7092us (7995us total) trans 4294983817 rc 0/0 00000100:00100000:0.0:1785774839.046256:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23943 00000020:00080000:0.0:1785774839.046263:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.064511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.064637:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648561536 00000100:00100000:2.0:1785774839.064652:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648561536 00000100:00100000:2.0:1785774839.064744:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5169 00000100:00100000:2.0:1785774839.064756:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+297:19337:x1872519648561536:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.065121:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983818 00000100:00100000:2.0:1785774839.065272:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+299:19337:x1872519648561536:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 518us (775us total) trans 4294983819 rc 0/0 00000100:00100000:2.0:1785774839.065280:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5169 00000020:00080000:2.0:1785774839.065286:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.073701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.073846:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648561792 00000100:00100000:3.0:1785774839.073858:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648561792 00000100:00100000:3.0:1785774839.073935:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23944 00000100:00100000:3.0:1785774839.073947:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+299:19337:x1872519648561792:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.073978:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.074005:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a03f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c391 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.074133:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.074151:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.074215:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.074238:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.074247:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.074254:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.079773:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e6:0x0], index 0: 0 00010000:00010000:0.0:1785774839.080149:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d0a040e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080198:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d0a040e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080213:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d0a040e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.080314:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983820 00010000:00010000:0.0:1785774839.080355:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080364:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080372:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080386:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080394:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.080398:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080407:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080423:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.080427:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.080432:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080439:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0400 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.080456:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4c0c74d reply state 00000000ae401a52 transno 4294983821 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080470:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080476:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd2f04d94 (ffff9b7709388f00) 00010000:00010000:0.0:1785774839.080479:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.080483:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.080530:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a03f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c391 expref: 303 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080554:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d0a040e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c391 expref: 302 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.080563:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9b7602507000) 00010000:00010000:0.0:1785774839.080566:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.080568:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0c00, rc 0) 00000100:00100000:0.0:1785774839.080655:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+303:19337:x1872519648561792:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 6710us (6975us total) trans 4294983821 rc 0/0 00000100:00100000:0.0:1785774839.080664:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23944 00000020:00080000:0.0:1785774839.080670:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.093904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.094025:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648562048 00000100:00100000:2.0:1785774839.094039:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648562048 00000100:00100000:2.0:1785774839.094107:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5170 00000100:00100000:2.0:1785774839.094118:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770eded450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+303:19337:x1872519648562048:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.094498:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983822 00000100:00100000:2.0:1785774839.094605:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770eded450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+305:19337:x1872519648562048:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 488us (723us total) trans 4294983823 rc 0/0 00000100:00100000:2.0:1785774839.094612:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5170 00000020:00080000:2.0:1785774839.094617:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.105118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.105236:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648562304 00000100:00100000:0.0:1785774839.105249:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648562304 00000100:00100000:0.0:1785774839.105322:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23945 00000100:00100000:0.0:1785774839.105333:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+305:19337:x1872519648562304:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.105363:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.105387:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a041c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c398 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.105796:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.105815:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.105838:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.105859:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.105867:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.105873:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.106329:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e6:0x0], index 1: 0 00010000:00010000:1.0:1785774839.119847:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a0431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.119877:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a0431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.120550:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a0431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774839.123937:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983824 00010000:00010000:1.0:1785774839.124072:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124087:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124095:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124103:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124111:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774839.124116:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124124:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124144:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774839.124148:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774839.124154:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124182:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a0423 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774839.124208:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000307716b1 reply state 00000000657ee67d transno 4294983825 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124222:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124230:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7df9dc94 (ffff9b7602507a00) 00010000:00010000:1.0:1785774839.124232:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774839.124236:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774839.124292:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a041c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c398 expref: 309 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124309:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a0431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c398 expref: 308 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.124323:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:1.0:1785774839.124325:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774839.124327:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cea00, rc 0) 00000100:00100000:1.0:1785774839.124435:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+309:19337:x1872519648562304:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 19103us (19329us total) trans 4294983825 rc 0/0 00000100:00100000:1.0:1785774839.124445:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23945 00000020:00080000:1.0:1785774839.124453:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.130258:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.130357:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648562560 00000100:00100000:0.0:1785774839.130369:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648562560 00000100:00100000:0.0:1785774839.130440:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5171 00000100:00100000:0.0:1785774839.130453:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+309:19337:x1872519648562560:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.130802:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983826 00000100:00100000:0.0:1785774839.130930:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+311:19337:x1872519648562560:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 479us (685us total) trans 4294983827 rc 0/0 00000100:00100000:0.0:1785774839.130938:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5171 00000020:00080000:0.0:1785774839.130944:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774839.142256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.142366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648562816 00000100:00100000:0.0:1785774839.142379:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648562816 00000100:00100000:0.0:1785774839.142456:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23946 00000100:00100000:0.0:1785774839.142468:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+311:19337:x1872519648562816:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.142503:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.142531:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a043f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c39f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.142676:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.142832:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.142847:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.142864:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.142870:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.142875:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.148416:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e7:0x0], index 0: 0 00010000:00010000:2.0:1785774839.149407:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a0454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149431:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a0454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149445:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a0454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.149535:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983828 00010000:00010000:2.0:1785774839.149581:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149589:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149597:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149604:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149611:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.149615:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149625:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149640:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.149644:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.149649:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.149657:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0446 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.149672:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017f99143 reply state 00000000b174d854 transno 4294983829 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.150844:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.150853:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xda336479 (ffff9b7602507300) 00010000:00010000:2.0:1785774839.150855:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.150859:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.150920:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a043f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c39f expref: 315 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.150937:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a0454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c39f expref: 314 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.150944:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9b760572b600) 00010000:00010000:2.0:1785774839.150946:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.150948:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155e00, rc 0) 00000100:00100000:2.0:1785774839.151038:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+315:19337:x1872519648562816:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 8572us (8795us total) trans 4294983829 rc 0/0 00000100:00100000:2.0:1785774839.151046:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23946 00000020:00080000:2.0:1785774839.151053:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.161132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.161214:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648563072 00000100:00100000:2.0:1785774839.161228:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648563072 00000100:00100000:2.0:1785774839.161295:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5172 00000100:00100000:2.0:1785774839.161306:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+315:19337:x1872519648563072:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.161671:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983830 00000100:00100000:2.0:1785774839.161797:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+317:19337:x1872519648563072:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 492us (678us total) trans 4294983831 rc 0/0 00000100:00100000:2.0:1785774839.161806:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5172 00000020:00080000:2.0:1785774839.161811:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.173323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.173647:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648563328 00000100:00100000:0.0:1785774839.173660:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648563328 00000100:00100000:0.0:1785774839.173749:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23947 00000100:00100000:0.0:1785774839.173760:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+317:19337:x1872519648563328:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.173793:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.173829:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a0462 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3a6 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.173986:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.174010:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.174024:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.174042:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.174050:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.174057:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.176716:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e7:0x0], index 1: 0 00010000:00010000:2.0:1785774839.176965:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a0477 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.176981:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a0477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.176994:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a0477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.177056:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983832 00010000:00010000:2.0:1785774839.177094:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177103:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177116:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177124:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177131:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.177137:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177145:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177208:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.177212:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.177217:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177223:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0469 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.177239:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008707821b reply state 00000000114ed31b transno 4294983833 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177251:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177257:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3abc7379 (ffff9b7602507d00) 00010000:00010000:2.0:1785774839.177259:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.177263:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.177304:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a0462 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3a6 expref: 321 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177319:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a0477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3a6 expref: 320 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.177336:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9b760572b900) 00010000:00010000:2.0:1785774839.177339:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.177342:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155a00, rc 0) 00000100:00100000:2.0:1785774839.177435:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+321:19337:x1872519648563328:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3676us (4126us total) trans 4294983833 rc 0/0 00000100:00100000:2.0:1785774839.177445:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23947 00000020:00080000:2.0:1785774839.177452:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.181146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.182085:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648563584 00000100:00100000:2.0:1785774839.182096:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648563584 00000100:00100000:2.0:1785774839.182156:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5173 00000100:00100000:2.0:1785774839.182194:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+321:19337:x1872519648563584:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.182862:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983834 00000100:00100000:2.0:1785774839.182978:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+323:19337:x1872519648563584:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 784us (1840us total) trans 4294983835 rc 0/0 00000100:00100000:2.0:1785774839.182987:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5173 00000020:00080000:2.0:1785774839.182993:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.189149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.189220:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648563840 00000100:00100000:2.0:1785774839.189233:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648563840 00000100:00100000:3.0:1785774839.189335:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23948 00000100:00100000:3.0:1785774839.189348:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+323:19337:x1872519648563840:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.189382:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.189412:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0485 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3ad expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.189571:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.189589:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.189602:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.189620:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.189626:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.189637:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.190047:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e8:0x0], index 0: 0 00010000:00010000:3.0:1785774839.190281:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a049a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190290:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a049a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190297:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a049a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.190353:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983836 00010000:00010000:3.0:1785774839.190392:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190400:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190407:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190414:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190422:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.190427:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190448:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190464:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.190467:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.190473:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190480:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a048c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.190494:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b8414a3 reply state 000000003ae91110 transno 4294983837 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190507:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190513:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x32204679 (ffff9b7709388a00) 00010000:00010000:3.0:1785774839.190516:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.190519:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.190549:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0485 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3ad expref: 327 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190565:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a049a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3ad expref: 326 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.190572:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9b7709388100) 00010000:00010000:3.0:1785774839.190575:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.190576:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:3.0:1785774839.190648:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+327:19337:x1872519648563840:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1302us (1510us total) trans 4294983837 rc 0/0 00000100:00100000:3.0:1785774839.190654:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23948 00000020:00080000:3.0:1785774839.190661:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.209397:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.209539:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648564096 00000100:00100000:0.0:1785774839.209550:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648564096 00000100:00100000:0.0:1785774839.209618:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5174 00000100:00100000:0.0:1785774839.209636:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+327:19337:x1872519648564096:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.210920:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983838 00000100:00100000:2.0:1785774839.211085:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+329:19337:x1872519648564096:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1455us (1700us total) trans 4294983839 rc 0/0 00000100:00100000:2.0:1785774839.211095:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5174 00000020:00080000:2.0:1785774839.211102:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.231423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.231645:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648564352 00000100:00100000:2.0:1785774839.231657:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648564352 00000100:00100000:2.0:1785774839.231741:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23949 00000100:00100000:2.0:1785774839.231754:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+329:19337:x1872519648564352:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.231790:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.231830:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a04a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3b4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.231971:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.231990:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.232004:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.232024:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.232032:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.232039:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.233030:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e8:0x0], index 1: 0 00010000:00010000:2.0:1785774839.233302:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a04bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.233315:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a04bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.233325:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a04bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.233385:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983840 00010000:00010000:2.0:1785774839.233423:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.233432:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.233439:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.233446:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.233453:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.233457:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.233465:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.234033:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.234036:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.234041:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.234048:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a04af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.234063:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000320c19b reply state 0000000024cf3bb7 transno 4294983841 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.234075:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.234081:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2f29d579 (ffff9b760572b200) 00010000:00010000:2.0:1785774839.234083:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.234086:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.234138:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a04a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3b4 expref: 333 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.234153:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a04bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3b4 expref: 332 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.234186:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9b760572b000) 00010000:00010000:2.0:1785774839.237588:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.237599:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dca00, rc 0) 00000100:00100000:2.0:1785774839.239961:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+333:19337:x1872519648564352:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 8192us (8534us total) trans 4294983841 rc 0/0 00000100:00100000:2.0:1785774839.239979:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23949 00000020:00080000:2.0:1785774839.239989:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.245670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.246617:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648564608 00000100:00100000:2.0:1785774839.246633:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648564608 00000100:00100000:2.0:1785774839.246720:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5175 00000100:00100000:2.0:1785774839.246733:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+333:19337:x1872519648564608:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.247140:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983842 00000100:00100000:2.0:1785774839.247313:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+335:19337:x1872519648564608:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 582us (1656us total) trans 4294983843 rc 0/0 00000100:00100000:2.0:1785774839.247327:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5175 00000020:00080000:2.0:1785774839.247333:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.261497:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.261599:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648564864 00000100:00100000:2.0:1785774839.261613:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648564864 00000100:00100000:2.0:1785774839.261700:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23950 00000100:00100000:2.0:1785774839.261712:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+335:19337:x1872519648564864:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.261746:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.261773:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a04cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3bb expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.261923:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.261943:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.261956:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.261976:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.261983:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.261990:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.262441:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e9:0x0], index 0: 0 00010000:00010000:2.0:1785774839.262632:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a04e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262642:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a04e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262648:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a04e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.262701:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983844 00010000:00010000:2.0:1785774839.262740:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262747:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262754:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262761:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262768:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.262773:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262782:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262795:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.262799:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.262804:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262811:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a04d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.262837:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030bc0dd3 reply state 0000000024c0ec53 transno 4294983845 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262849:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262856:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xcad70079 (ffff9b7605fcbc00) 00010000:00010000:2.0:1785774839.262859:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.262861:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.262893:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a04cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3bb expref: 339 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262909:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a04e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3bb expref: 338 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.262917:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9b7605fcb700) 00010000:00010000:2.0:1785774839.262919:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.262921:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ef0400, rc 0) 00000100:00100000:2.0:1785774839.263003:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+339:19337:x1872519648564864:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1293us (1521us total) trans 4294983845 rc 0/0 00000100:00100000:2.0:1785774839.263011:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23950 00000020:00080000:2.0:1785774839.263018:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.267503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.267675:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648565120 00000100:00100000:2.0:1785774839.267694:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648565120 00000100:00100000:2.0:1785774839.267796:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5176 00000100:00100000:2.0:1785774839.267808:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+339:19337:x1872519648565120:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.268198:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983846 00000100:00100000:2.0:1785774839.268309:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+341:19337:x1872519648565120:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 503us (817us total) trans 4294983847 rc 0/0 00000100:00100000:2.0:1785774839.268319:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5176 00000020:00080000:2.0:1785774839.268325:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774839.279414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.279603:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648565376 00000100:00100000:3.0:1785774839.279615:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648565376 00000100:00100000:3.0:1785774839.279703:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23951 00000100:00100000:3.0:1785774839.279716:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+341:19337:x1872519648565376:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.279748:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.279775:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a04ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3c2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.279926:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.279946:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.279960:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.279979:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.279987:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.279994:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.280663:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e9:0x0], index 1: 0 00010000:00010000:3.0:1785774839.280983:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a0503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.280994:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a0503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281003:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a0503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.281066:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983848 00010000:00010000:3.0:1785774839.281106:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281115:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281122:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281131:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281138:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.281143:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281153:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281562:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.281566:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.281572:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281585:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a04f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.281598:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c380d668 reply state 000000005de3eccc transno 4294983849 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281612:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281619:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x71408f79 (ffff9b7709388900) 00010000:00010000:3.0:1785774839.281622:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.281625:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.281662:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a04ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3c2 expref: 345 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281678:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a0503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3c2 expref: 344 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.281749:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9b7709388800) 00010000:00010000:3.0:1785774839.281752:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.281755:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:3.0:1785774839.281892:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+345:19337:x1872519648565376:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2178us (2491us total) trans 4294983849 rc 0/0 00000100:00100000:3.0:1785774839.281902:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23951 00000020:00080000:3.0:1785774839.281909:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.301369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.301522:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648565632 00000100:00100000:2.0:1785774839.301536:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648565632 00000100:00100000:2.0:1785774839.301610:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5177 00000100:00100000:2.0:1785774839.301622:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+345:19337:x1872519648565632:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.302005:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983850 00000100:00100000:2.0:1785774839.302134:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+347:19337:x1872519648565632:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 514us (781us total) trans 4294983851 rc 0/0 00000100:00100000:2.0:1785774839.302143:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5177 00000020:00080000:2.0:1785774839.302148:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.306759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.308666:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648565888 00000100:00100000:2.0:1785774839.308692:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648565888 00000100:00100000:2.0:1785774839.308784:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23952 00000100:00100000:2.0:1785774839.308796:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+347:19337:x1872519648565888:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.308839:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.308867:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0511 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3c9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.309012:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.309031:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.309044:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.309061:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.309069:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.309076:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.315140:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ea:0x0], index 0: 0 00010000:00010000:0.0:1785774839.317067:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a0526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.317093:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a0526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.317108:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a0526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.320944:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983852 00010000:00010000:0.0:1785774839.321055:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321070:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321078:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321086:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321093:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.321098:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321106:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321126:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.321129:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.321134:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321141:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0518 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.321209:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e18ded7a reply state 0000000011c0999b transno 4294983853 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321230:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321239:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa2c3e279 (ffff9b7605fcb900) 00010000:00010000:0.0:1785774839.321241:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.321245:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.321300:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0511 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3c9 expref: 351 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321317:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a0526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3c9 expref: 350 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.321325:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9b7602507f00) 00010000:00010000:0.0:1785774839.321327:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.321330:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ca0a00, rc 0) 00000100:00100000:0.0:1785774839.321407:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+351:19337:x1872519648565888:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 12613us (14660us total) trans 4294983853 rc 0/0 00000100:00100000:0.0:1785774839.321418:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23952 00000020:00080000:0.0:1785774839.321425:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774839.341783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.341946:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648566144 00000100:00100000:2.0:1785774839.341958:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648566144 00000100:00100000:2.0:1785774839.342028:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5178 00000100:00100000:2.0:1785774839.342039:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+351:19337:x1872519648566144:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.342419:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983854 00000100:00100000:2.0:1785774839.342548:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+353:19337:x1872519648566144:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 511us (777us total) trans 4294983855 rc 0/0 00000100:00100000:2.0:1785774839.342556:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5178 00000020:00080000:2.0:1785774839.342561:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.354743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.354927:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648566400 00000100:00100000:2.0:1785774839.354940:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648566400 00000100:00100000:2.0:1785774839.355029:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23953 00000100:00100000:2.0:1785774839.355060:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+353:19337:x1872519648566400:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.355092:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.355121:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0534 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3d0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.355345:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.355364:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.355377:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.355393:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.355401:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.355407:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.363916:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ea:0x0], index 1: 0 00010000:00010000:3.0:1785774839.364668:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365318:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365331:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.365428:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983856 00010000:00010000:3.0:1785774839.365748:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365757:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365764:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365772:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365778:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.365783:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365791:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365808:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.365811:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.365824:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365832:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a053b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.365848:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7d50bba reply state 000000007cc3ac8c transno 4294983857 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365860:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365867:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77cd7179 (ffff9b7605fcbf00) 00010000:00010000:3.0:1785774839.365870:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.365873:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.365918:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0534 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3d0 expref: 357 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365935:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3d0 expref: 356 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.365943:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9b7709388d00) 00010000:00010000:3.0:1785774839.365946:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.365949:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744800, rc 0) 00000100:00100000:3.0:1785774839.366090:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+357:19337:x1872519648566400:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 11051us (11361us total) trans 4294983857 rc 0/0 00000100:00100000:3.0:1785774839.366100:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23953 00000020:00080000:3.0:1785774839.366106:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.384913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.391979:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648566656 00000100:00100000:3.0:1785774839.391999:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648566656 00000100:00100000:0.0:1785774839.392301:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5179 00000100:00100000:0.0:1785774839.392316:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+357:19337:x1872519648566656:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.392679:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983858 00000100:00100000:0.0:1785774839.392840:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+359:19337:x1872519648566656:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 528us (7939us total) trans 4294983859 rc 0/0 00000100:00100000:0.0:1785774839.392848:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5179 00000020:00080000:0.0:1785774839.392854:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774839.402242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.402332:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648566912 00000100:00100000:3.0:1785774839.402345:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648566912 00000100:00100000:3.0:1785774839.402427:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23954 00000100:00100000:3.0:1785774839.402439:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+359:19337:x1872519648566912:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.402481:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.402506:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0557 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3d7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.402657:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.402675:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.402696:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.402714:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.402722:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.402729:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.403151:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9eb:0x0], index 0: 0 00010000:00010000:3.0:1785774839.403372:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a400/0x7b7109e1d0a056c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403382:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a400/0x7b7109e1d0a056c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403391:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a400/0x7b7109e1d0a056c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.403457:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983860 00010000:00010000:3.0:1785774839.403500:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403508:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403514:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403522:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403529:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.403534:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403542:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403556:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.403559:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.403563:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403570:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a055e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.403585:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b210583 reply state 00000000013ce7f2 transno 4294983861 ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403604:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403610:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe58bac79 (ffff9b7709388b00) 00010000:00010000:3.0:1785774839.403612:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.403615:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.403642:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0557 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3d7 expref: 363 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403656:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a400/0x7b7109e1d0a056c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3d7 expref: 362 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.403664:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9b7709388c00) 00010000:00010000:3.0:1785774839.403666:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.403668:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b760605a400, rc 0) 00000100:00100000:3.0:1785774839.403739:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+363:19337:x1872519648566912:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1303us (1509us total) trans 4294983861 rc 0/0 00000100:00100000:3.0:1785774839.403746:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23954 00000020:00080000:3.0:1785774839.403751:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.409969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.410107:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648567168 00000100:00100000:2.0:1785774839.410120:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648567168 00000100:00100000:2.0:1785774839.410234:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5180 00000100:00100000:2.0:1785774839.410246:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+363:19337:x1872519648567168:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.410616:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983862 00000100:00100000:2.0:1785774839.410916:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+365:19337:x1872519648567168:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 670us (961us total) trans 4294983863 rc 0/0 00000100:00100000:2.0:1785774839.410925:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5180 00000020:00080000:2.0:1785774839.410931:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.432443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.432495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.432531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.432608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.432636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.432700:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648567424 00000100:00100000:3.0:1785774839.432712:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648567424 00000100:00100000:3.0:1785774839.432788:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648567680 00000100:00100000:3.0:1785774839.432791:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648567680 00000100:00100000:3.0:1785774839.432836:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1054 00000100:00100000:3.0:1785774839.432847:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648567680:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774839.432942:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648567680:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 97us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774839.432953:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1054 00000100:00100000:3.0:1785774839.432970:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23955 00000100:00100000:3.0:1785774839.432976:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+365:19337:x1872519648567424:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.432991:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.433016:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a057a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3de expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433146:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433193:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433207:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433222:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433228:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433233:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.433722:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9eb:0x0], index 1: 0 00010000:00010000:3.0:1785774839.433940:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b400/0x7b7109e1d0a058f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433948:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b400/0x7b7109e1d0a058f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.433956:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b400/0x7b7109e1d0a058f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.434028:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983864 00010000:00010000:3.0:1785774839.434061:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434068:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434074:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434080:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434085:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.434088:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434094:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434106:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.434108:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.434112:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434117:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a0581 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.434131:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b5efe87 reply state 00000000928c1c86 transno 4294983865 ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434145:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434151:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8bf53b79 (ffff9b7605fda200) 00010000:00010000:3.0:1785774839.434153:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.434155:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.434224:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a057a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3de expref: 369 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434237:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b400/0x7b7109e1d0a058f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3de expref: 368 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.434243:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9b7605fda700) 00010000:00010000:3.0:1785774839.434245:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.434247:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b760605b400, rc 0) 00000100:00100000:3.0:1785774839.434288:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+369:19337:x1872519648567424:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1312us (1861us total) trans 4294983865 rc 0/0 00000100:00100000:3.0:1785774839.434293:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23955 00000020:00080000:3.0:1785774839.434297:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1785774839.434319:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774839.438619:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648567552 00000100:00100000:3.0:1785774839.438637:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648567552 00000100:00100000:3.0:1785774839.438735:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 564 00000100:00100000:3.0:1785774839.438747:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648567552:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774839.438843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648567552:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 98us (6234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774839.438851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 564 00000100:00100000:1.0:1785774839.447673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.447824:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648568192 00000100:00100000:3.0:1785774839.447838:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648568192 00000100:00100000:3.0:1785774839.447911:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5181 00000100:00100000:3.0:1785774839.447924:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+369:19337:x1872519648568192:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774839.448290:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983866 00000100:00100000:3.0:1785774839.448404:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+371:19337:x1872519648568192:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 483us (744us total) trans 4294983867 rc 0/0 00000100:00100000:3.0:1785774839.448413:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5181 00000020:00080000:3.0:1785774839.448419:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774839.453782:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648567936 00000100:00100000:2.0:1785774839.453804:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648567936 00000100:00100000:2.0:1785774839.453918:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648567808 00000100:00100000:2.0:1785774839.453923:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648567808 00000100:00100000:2.0:1785774839.453972:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 637 00000100:00100000:2.0:1785774839.453985:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648567936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774839.454075:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648567936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 93us (21543us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774839.454083:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 637 00000100:00100000:2.0:1785774839.454101:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 638 00000100:00100000:2.0:1785774839.454107:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648567808:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774839.454129:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648567808:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (21492us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774839.454135:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 638 00000100:00080000:3.0:1785774839.454238:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785774839.454245:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774839.472753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.472865:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648568448 00000100:00100000:2.0:1785774839.472879:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648568448 00000100:00100000:2.0:1785774839.472976:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23956 00000100:00100000:2.0:1785774839.472989:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+371:19337:x1872519648568448:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.473028:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.473059:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a059d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3e5 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.473269:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.473289:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.473305:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.473320:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.473328:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.473335:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.473790:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ec:0x0], index 0: 0 00010000:00010000:2.0:1785774839.474015:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a05b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474024:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a05b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474032:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a05b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.474100:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983868 00010000:00010000:2.0:1785774839.474138:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474150:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474157:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474187:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474194:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.474199:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474208:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474221:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.474224:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.474228:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474234:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a05a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.474246:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fb15af1 reply state 00000000c1af64fe transno 4294983869 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474256:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474262:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa6a2e1ce (ffff9b7605fcb000) 00010000:00010000:2.0:1785774839.474264:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.474267:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.474296:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a059d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3e5 expref: 375 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474308:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a05b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3e5 expref: 374 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.474314:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9b7605fcbe00) 00010000:00010000:2.0:1785774839.474317:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.474319:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c200, rc 0) 00000100:00100000:2.0:1785774839.474399:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+375:19337:x1872519648568448:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1413us (1660us total) trans 4294983869 rc 0/0 00000100:00100000:2.0:1785774839.474408:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23956 00000020:00080000:2.0:1785774839.474414:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.491026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.492601:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648568704 00000100:00100000:3.0:1785774839.492622:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648568704 00000100:00100000:3.0:1785774839.492718:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5182 00000100:00100000:3.0:1785774839.492731:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edeec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+375:19337:x1872519648568704:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774839.493216:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983870 00000100:00100000:3.0:1785774839.493350:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edeec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+377:19337:x1872519648568704:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 620us (2338us total) trans 4294983871 rc 0/0 00000100:00100000:3.0:1785774839.493359:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5182 00000020:00080000:3.0:1785774839.493365:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.513623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.514086:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648568960 00000100:00100000:3.0:1785774839.514100:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648568960 00000100:00100000:3.0:1785774839.514238:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23957 00000100:00100000:3.0:1785774839.514251:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+377:19337:x1872519648568960:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.514283:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.514310:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a05c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3ec expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.514630:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.514649:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.514663:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.514739:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.514748:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.514756:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.516598:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ec:0x0], index 1: 0 00010000:00010000:3.0:1785774839.518946:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a000/0x7b7109e1d0a05d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.518969:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a000/0x7b7109e1d0a05d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.518982:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a000/0x7b7109e1d0a05d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.526442:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983872 00010000:00010000:2.0:1785774839.526868:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526883:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526891:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526900:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526908:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.526913:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526921:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526943:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.526946:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.526951:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526958:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a05c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.526980:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048fc83e5 reply state 00000000a43b9150 transno 4294983873 ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.526995:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.527003:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4d0c70ce (ffff9b7605fdaf00) 00010000:00010000:2.0:1785774839.527006:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.527010:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.527067:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a05c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3ec expref: 381 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.527082:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a000/0x7b7109e1d0a05d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3ec expref: 380 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.527089:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9b7605fda800) 00010000:00010000:2.0:1785774839.527092:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.527093:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b760605a000, rc 0) 00000100:00100000:2.0:1785774839.527607:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+381:19337:x1872519648568960:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 13358us (13998us total) trans 4294983873 rc 0/0 00000100:00100000:2.0:1785774839.527616:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23957 00000020:00080000:2.0:1785774839.527622:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.540387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.546881:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648569216 00000100:00100000:2.0:1785774839.546905:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648569216 00000100:00100000:3.0:1785774839.547131:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5183 00000100:00100000:3.0:1785774839.547144:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+381:19337:x1872519648569216:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774839.547564:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983874 00000100:00100000:3.0:1785774839.547853:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+383:19337:x1872519648569216:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 711us (7486us total) trans 4294983875 rc 0/0 00000100:00100000:3.0:1785774839.547862:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5183 00000020:00080000:3.0:1785774839.547868:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.553752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.553916:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648569472 00000100:00100000:0.0:1785774839.553929:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648569472 00000100:00100000:0.0:1785774839.554008:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23958 00000100:00100000:0.0:1785774839.554020:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+383:19337:x1872519648569472:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.554053:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.554081:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a05e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3f3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.554270:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.554289:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.554302:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.554316:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.554323:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.554330:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.554888:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ed:0x0], index 0: 0 00010000:00010000:0.0:1785774839.555071:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d0a05f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555087:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d0a05f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555095:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d0a05f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.555147:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983876 00010000:00010000:0.0:1785774839.555320:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555327:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555333:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555339:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555344:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770149a000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.555348:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555355:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555367:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.555370:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.555375:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555380:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a05ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.555397:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016cef6fc reply state 000000002e4b5f7c transno 4294983877 ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555407:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555413:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe8b99bce (ffff9b7602507200) 00010000:00010000:0.0:1785774839.555415:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.555417:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.555940:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a05e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3f3 expref: 387 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555965:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d0a05f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3f3 expref: 386 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.555973:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9b7602507100) 00010000:00010000:0.0:1785774839.555976:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.555978:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770149ba00, rc 0) 00000100:00100000:0.0:1785774839.556062:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+387:19337:x1872519648569472:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2045us (2325us total) trans 4294983877 rc 0/0 00000100:00100000:0.0:1785774839.556071:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23958 00000020:00080000:0.0:1785774839.556077:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.574962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.575064:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648569728 00000100:00100000:0.0:1785774839.575079:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648569728 00000100:00100000:0.0:1785774839.575186:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5184 00000100:00100000:0.0:1785774839.575199:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+387:19337:x1872519648569728:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.575566:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983878 00000100:00100000:0.0:1785774839.575695:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+389:19337:x1872519648569728:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 498us (748us total) trans 4294983879 rc 0/0 00000100:00100000:0.0:1785774839.575704:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5184 00000020:00080000:0.0:1785774839.575711:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.586122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.586333:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648569984 00000100:00100000:3.0:1785774839.586348:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648569984 00000100:00100000:3.0:1785774839.586424:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23959 00000100:00100000:3.0:1785774839.586437:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+389:19337:x1872519648569984:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.586475:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.586502:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a0606 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c3fa expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.586636:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.586655:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.586667:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.586693:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.586699:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.586706:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.587201:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ed:0x0], index 1: 0 00010000:00010000:3.0:1785774839.587453:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605aa00/0x7b7109e1d0a061b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587463:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605aa00/0x7b7109e1d0a061b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587470:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605aa00/0x7b7109e1d0a061b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.587530:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983880 00010000:00010000:3.0:1785774839.587567:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587574:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587580:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587585:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587590:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.587594:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587600:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587612:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.587616:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.587620:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587626:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a060d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.587637:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001dcdc627 reply state 000000000655d1a0 transno 4294983881 ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587647:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587652:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x91a3d2ce (ffff9b7605fda500) 00010000:00010000:3.0:1785774839.587654:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.587657:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.587686:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a0606 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3fa expref: 393 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587701:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605aa00/0x7b7109e1d0a061b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3fa expref: 392 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.587708:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9b7605fdae00) 00010000:00010000:3.0:1785774839.587711:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.587713:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b760605aa00, rc 0) 00000100:00100000:3.0:1785774839.587777:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+393:19337:x1872519648569984:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1344us (1668us total) trans 4294983881 rc 0/0 00000100:00100000:3.0:1785774839.587785:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23959 00000020:00080000:3.0:1785774839.587791:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785774839.592593:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774839.600155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.600309:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648570240 00000100:00100000:3.0:1785774839.600322:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648570240 00000100:00100000:3.0:1785774839.600397:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5185 00000100:00100000:3.0:1785774839.600409:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+393:19337:x1872519648570240:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774839.600779:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983882 00000100:00100000:3.0:1785774839.600908:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+395:19337:x1872519648570240:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 500us (765us total) trans 4294983883 rc 0/0 00000100:00100000:3.0:1785774839.600917:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5185 00000020:00080000:3.0:1785774839.600922:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.605899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.606331:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648570496 00000100:00100000:2.0:1785774839.606344:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648570496 00000100:00100000:2.0:1785774839.606422:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23960 00000100:00100000:2.0:1785774839.606434:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+395:19337:x1872519648570496:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.606476:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.606502:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0629 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c401 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.606630:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.606649:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.606662:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.606685:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.606692:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.606699:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.607151:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ee:0x0], index 0: 0 00010000:00010000:2.0:1785774839.608836:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a063e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.608852:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a063e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.608863:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a063e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.608943:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983884 00010000:00010000:2.0:1785774839.608984:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.608992:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.608997:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609003:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609008:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.609012:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609019:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609033:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.609035:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.609040:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609046:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0630 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.609060:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000027d7da6 reply state 00000000282451e5 transno 4294983885 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609074:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609080:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0d0fdce (ffff9b7605fcb500) 00010000:00010000:2.0:1785774839.609081:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.609084:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.609121:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0629 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c401 expref: 399 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609135:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a063e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c401 expref: 398 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.609142:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:2.0:1785774839.609144:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.609146:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9dc00, rc 0) 00000100:00100000:2.0:1785774839.609329:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+399:19337:x1872519648570496:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2896us (3442us total) trans 4294983885 rc 0/0 00000100:00100000:2.0:1785774839.609337:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23960 00000020:00080000:2.0:1785774839.609342:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.621534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.621615:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648570752 00000100:00100000:2.0:1785774839.621627:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648570752 00000100:00100000:2.0:1785774839.621704:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5186 00000100:00100000:2.0:1785774839.621716:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+399:19337:x1872519648570752:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:2.0:1785774839.622123:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983886 00000100:00100000:2.0:1785774839.622315:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+401:19337:x1872519648570752:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 601us (794us total) trans 4294983887 rc 0/0 00000100:00100000:2.0:1785774839.622329:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5186 00000020:00080000:2.0:1785774839.622335:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.650433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.650578:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648571008 00000100:00100000:0.0:1785774839.650590:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648571008 00000100:00100000:0.0:1785774839.650660:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23961 00000100:00100000:0.0:1785774839.650672:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+401:19337:x1872519648571008:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.650711:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.650739:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a064c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c408 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.650898:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.650918:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.650933:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.650951:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.650958:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.650965:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.651476:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ee:0x0], index 1: 0 00010000:00010000:0.0:1785774839.651684:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb800/0x7b7109e1d0a0661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651694:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb800/0x7b7109e1d0a0661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651702:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb800/0x7b7109e1d0a0661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.651770:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983888 00010000:00010000:0.0:1785774839.651810:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651829:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651836:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651844:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651852:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.651858:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651867:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651883:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.651887:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.651893:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651905:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0653 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.651925:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb0c992b reply state 00000000f2fed874 transno 4294983889 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651940:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.651946:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95b00cce (ffff9b7602507c00) 00010000:00010000:0.0:1785774839.651949:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.651953:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.651991:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a064c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c408 expref: 405 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.652009:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb800/0x7b7109e1d0a0661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c408 expref: 404 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.652017:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9b7602507500) 00010000:00010000:0.0:1785774839.652019:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.652022:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c0fb800, rc 0) 00000100:00100000:0.0:1785774839.652094:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+405:19337:x1872519648571008:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1424us (1676us total) trans 4294983889 rc 0/0 00000100:00100000:0.0:1785774839.652103:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23961 00000020:00080000:0.0:1785774839.652108:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.672629:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.672748:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648571264 00000100:00100000:0.0:1785774839.672762:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648571264 00000100:00100000:0.0:1785774839.672846:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5187 00000100:00100000:0.0:1785774839.672859:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+405:19337:x1872519648571264:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.673239:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983890 00000100:00100000:0.0:1785774839.673352:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+407:19337:x1872519648571264:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 494us (740us total) trans 4294983891 rc 0/0 00000100:00100000:0.0:1785774839.673361:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5187 00000020:00080000:0.0:1785774839.673366:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.688075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.688449:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648571520 00000100:00100000:0.0:1785774839.688471:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648571520 00000100:00100000:0.0:1785774839.688594:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23962 00000100:00100000:0.0:1785774839.688606:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+407:19337:x1872519648571520:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.688644:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.688673:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a066f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c40f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.688842:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.688862:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.688877:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.688894:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.688902:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.688909:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.689734:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ef:0x0], index 0: 0 00010000:00010000:0.0:1785774839.689943:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa600/0x7b7109e1d0a0684 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.689953:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa600/0x7b7109e1d0a0684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.689963:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa600/0x7b7109e1d0a0684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.690016:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983892 00010000:00010000:0.0:1785774839.690049:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690056:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690062:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690067:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690074:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.690078:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690086:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690100:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.690104:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.690109:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690116:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0676 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.690130:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012f1a74a reply state 00000000efb9804f transno 4294983893 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690142:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.690148:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd0dd37ce (ffff9b7602507700) 00010000:00010000:0.0:1785774839.690151:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.690154:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.691983:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a066f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c40f expref: 411 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.692008:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa600/0x7b7109e1d0a0684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c40f expref: 410 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.692018:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9b7602507800) 00010000:00010000:0.0:1785774839.692021:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.692024:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c0fa600, rc 0) 00000100:00100000:0.0:1785774839.692113:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+411:19337:x1872519648571520:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3509us (4052us total) trans 4294983893 rc 0/0 00000100:00100000:0.0:1785774839.692122:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23962 00000020:00080000:0.0:1785774839.692128:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.701447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.701606:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648571776 00000100:00100000:0.0:1785774839.701621:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648571776 00000100:00100000:0.0:1785774839.701697:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5188 00000100:00100000:0.0:1785774839.701710:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+411:19337:x1872519648571776:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.702075:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983894 00000100:00100000:1.0:1785774839.707256:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+413:19337:x1872519648571776:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 5531us (5805us total) trans 4294983895 rc 0/0 00000100:00100000:1.0:1785774839.707275:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5188 00000020:00080000:1.0:1785774839.707285:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.717119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.717236:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648572032 00000100:00100000:2.0:1785774839.717249:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648572032 00000100:00100000:2.0:1785774839.717323:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23963 00000100:00100000:2.0:1785774839.717333:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+413:19337:x1872519648572032:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.717363:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.717389:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0692 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c416 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.717537:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.717556:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.717570:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.717585:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.717592:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.717599:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.718065:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ef:0x0], index 1: 0 00010000:00010000:2.0:1785774839.718339:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a06a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718350:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a06a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718359:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a06a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.718418:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983896 00010000:00010000:2.0:1785774839.718457:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718466:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718473:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718480:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718486:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.718491:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718500:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718514:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.718517:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.718521:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718529:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a0699 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.718544:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008251e9b7 reply state 00000000121e941d transno 4294983897 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718556:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718563:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77c76ece (ffff9b7605fcb300) 00010000:00010000:2.0:1785774839.718565:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.718568:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.718596:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0692 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c416 expref: 417 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718609:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a06a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c416 expref: 416 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.718618:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:2.0:1785774839.718620:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.718623:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c400, rc 0) 00000100:00100000:2.0:1785774839.718956:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+417:19337:x1872519648572032:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1623us (1848us total) trans 4294983897 rc 0/0 00000100:00100000:2.0:1785774839.718965:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23963 00000020:00080000:2.0:1785774839.718971:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774839.738300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.738807:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648572288 00000100:00100000:3.0:1785774839.738833:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648572288 00000100:00100000:3.0:1785774839.738910:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5189 00000100:00100000:3.0:1785774839.738923:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+417:19337:x1872519648572288:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774839.739314:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983898 00000100:00100000:3.0:1785774839.739450:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+419:19337:x1872519648572288:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 529us (1163us total) trans 4294983899 rc 0/0 00000100:00100000:3.0:1785774839.739460:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5189 00000020:00080000:3.0:1785774839.739590:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774839.742982:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.743205:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648572544 00000100:00100000:1.0:1785774839.743216:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648572544 00000100:00100000:1.0:1785774839.743290:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23964 00000100:00100000:1.0:1785774839.743301:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+419:19337:x1872519648572544:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774839.743331:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774839.743359:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a06b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c41d expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.743592:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.743610:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.743628:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.743643:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.743650:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.743657:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774839.744116:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f0:0x0], index 0: 0 00010000:00010000:1.0:1785774839.744615:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a06ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.744625:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a06ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.744633:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a06ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774839.745452:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983900 00010000:00010000:1.0:1785774839.745562:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.745572:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.745577:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.745587:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.745592:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774839.745596:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.745605:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.745627:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774839.745630:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774839.745635:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.745643:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a06bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774839.745671:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dcb40cdb reply state 00000000fff2c0e9 transno 4294983901 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.746521:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.746531:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe585a9ce (ffff9b7605fcc200) 00010000:00010000:1.0:1785774839.746534:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774839.746537:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774839.746587:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a06b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c41d expref: 423 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.746611:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a06ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c41d expref: 422 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.746620:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9b7605fcc900) 00010000:00010000:1.0:1785774839.746623:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774839.746625:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:1.0:1785774839.746774:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+423:19337:x1872519648572544:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3474us (3802us total) trans 4294983901 rc 0/0 00000100:00100000:1.0:1785774839.746784:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23964 00000020:00080000:1.0:1785774839.746791:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.762368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.769640:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648572800 00000100:00100000:3.0:1785774839.769659:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648572800 00000100:00100000:0.0:1785774839.774715:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5190 00000100:00100000:0.0:1785774839.774734:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+423:19337:x1872519648572800:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.775104:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983902 00000100:00100000:0.0:1785774839.775276:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+425:19337:x1872519648572800:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 546us (12923us total) trans 4294983903 rc 0/0 00000100:00100000:0.0:1785774839.775284:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5190 00000020:00080000:0.0:1785774839.775290:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774839.798704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.798796:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648573056 00000100:00100000:3.0:1785774839.798818:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648573056 00000100:00100000:3.0:1785774839.798898:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23965 00000100:00100000:3.0:1785774839.798910:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+425:19337:x1872519648573056:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.798946:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.798975:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a06d8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c424 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799114:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799132:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799146:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799193:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799207:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799215:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774839.799652:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f0:0x0], index 1: 0 00010000:00010000:3.0:1785774839.799865:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b600/0x7b7109e1d0a06ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799874:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b600/0x7b7109e1d0a06ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799881:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b600/0x7b7109e1d0a06ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.799943:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983904 00010000:00010000:3.0:1785774839.799982:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799993:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.799998:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800004:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800008:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.800013:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800019:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800031:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.800034:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.800038:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800044:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a06df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.800064:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067af9cee reply state 00000000aeebd89c transno 4294983905 ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800074:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800080:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4de4b8ce (ffff9b7605fda400) 00010000:00010000:3.0:1785774839.800082:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.800085:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.800117:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a06d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c424 expref: 429 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800130:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b600/0x7b7109e1d0a06ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c424 expref: 428 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.800137:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9b7605fda100) 00010000:00010000:3.0:1785774839.800139:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.800141:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b760605b600, rc 0) 00000100:00100000:3.0:1785774839.800243:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+429:19337:x1872519648573056:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1335us (1555us total) trans 4294983905 rc 0/0 00000100:00100000:3.0:1785774839.800249:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23965 00000020:00080000:3.0:1785774839.800254:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774839.813567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.813690:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648573312 00000100:00100000:0.0:1785774839.813703:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648573312 00000100:00100000:0.0:1785774839.813785:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5191 00000100:00100000:0.0:1785774839.813797:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+429:19337:x1872519648573312:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.814235:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983906 00000100:00100000:0.0:1785774839.814357:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+431:19337:x1872519648573312:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 562us (804us total) trans 4294983907 rc 0/0 00000100:00100000:0.0:1785774839.814366:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5191 00000020:00080000:0.0:1785774839.814372:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774839.823218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774839.823316:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648573568 00000100:00100000:2.0:1785774839.823330:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648573568 00000100:00100000:2.0:1785774839.823399:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23966 00000100:00100000:2.0:1785774839.823409:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+431:19337:x1872519648573568:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774839.823440:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774839.823472:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a06fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c42b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.823601:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.823619:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.823631:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.823645:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.823650:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.823656:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774839.824084:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f1:0x0], index 0: 0 00010000:00010000:2.0:1785774839.824311:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a0710 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824320:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a0710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824327:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a0710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774839.824387:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983908 00010000:00010000:2.0:1785774839.824426:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824435:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824442:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824450:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824457:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774839.824462:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824471:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824486:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774839.824489:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774839.824496:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824504:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a0702 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774839.824521:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a54e059 reply state 000000006c86f7ee transno 4294983909 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824538:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824545:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5501ae7b (ffff9b7605fcb100) 00010000:00010000:2.0:1785774839.824548:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774839.824551:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774839.824584:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a06fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c42b expref: 435 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824600:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a0710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c42b expref: 434 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774839.824609:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9b7605fcb400) 00010000:00010000:2.0:1785774839.824611:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774839.824613:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ce00, rc 0) 00000100:00100000:2.0:1785774839.824694:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+435:19337:x1872519648573568:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1285us (1540us total) trans 4294983909 rc 0/0 00000100:00100000:2.0:1785774839.824702:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23966 00000020:00080000:2.0:1785774839.824707:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774839.855422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.855589:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648573824 00000100:00100000:1.0:1785774839.855604:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648573824 00000100:00100000:0.0:1785774839.855776:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5192 00000100:00100000:0.0:1785774839.855790:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+435:19337:x1872519648573824:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774839.856157:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983910 00000100:00100000:0.0:1785774839.856324:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+437:19337:x1872519648573824:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 537us (930us total) trans 4294983911 rc 0/0 00000100:00100000:0.0:1785774839.856333:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5192 00000020:00080000:0.0:1785774839.856339:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774839.871253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.871374:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648574080 00000100:00100000:1.0:1785774839.871387:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648574080 00000100:00100000:1.0:1785774839.871478:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23967 00000100:00100000:1.0:1785774839.871490:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+437:19337:x1872519648574080:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774839.871526:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774839.871556:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a071e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c432 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.871705:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.871723:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.871738:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.871753:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.871760:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.871765:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774839.872773:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f1:0x0], index 1: 0 00010000:00010000:1.0:1785774839.873021:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a0733 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873032:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a0733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873041:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a0733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774839.873102:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983912 00010000:00010000:1.0:1785774839.873136:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873145:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873152:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873383:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873390:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774839.873395:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873404:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873419:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774839.873422:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774839.873428:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873435:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a0725 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774839.873515:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af3d0219 reply state 00000000da318425 transno 4294983913 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873530:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873537:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3d7b (ffff9b7605fccc00) 00010000:00010000:1.0:1785774839.873540:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774839.873543:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774839.873577:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a071e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c432 expref: 441 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873600:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a0733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c432 expref: 440 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774839.873608:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9b7605fcc500) 00010000:00010000:1.0:1785774839.873610:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774839.873613:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce200, rc 0) 00000100:00100000:1.0:1785774839.873985:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+441:19337:x1872519648574080:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2497us (2744us total) trans 4294983913 rc 0/0 00000100:00100000:1.0:1785774839.873994:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23967 00000020:00080000:1.0:1785774839.874000:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774839.891871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.897882:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648574336 00000100:00100000:1.0:1785774839.897902:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648574336 00000100:00100000:1.0:1785774839.897979:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5193 00000100:00100000:1.0:1785774839.897990:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+441:19337:x1872519648574336:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774839.899775:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983914 00000100:00100000:1.0:1785774839.899938:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+443:19337:x1872519648574336:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1946us (8076us total) trans 4294983915 rc 0/0 00000100:00100000:1.0:1785774839.899948:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5193 00000020:00080000:1.0:1785774839.899953:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774839.917818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774839.917987:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648574592 00000100:00100000:0.0:1785774839.918000:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648574592 00000100:00100000:0.0:1785774839.918086:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23968 00000100:00100000:0.0:1785774839.918098:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+443:19337:x1872519648574592:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774839.918133:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774839.918868:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0741 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c439 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.919232:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.919252:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.919266:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.919283:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.919290:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.919296:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774839.921047:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f2:0x0], index 0: 0 00010000:00010000:0.0:1785774839.921873:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa000/0x7b7109e1d0a0756 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.924128:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa000/0x7b7109e1d0a0756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.924143:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa000/0x7b7109e1d0a0756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774839.924290:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983916 00010000:00010000:0.0:1785774839.924347:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.924355:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.924363:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.924370:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.924376:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774839.924381:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.925824:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.925843:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774839.925848:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774839.925854:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.925862:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0748 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774839.925882:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001141f129 reply state 000000004f24e915 transno 4294983917 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.925895:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.925902:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x170e687b (ffff9b7602507e00) 00010000:00010000:0.0:1785774839.925905:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774839.925909:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774839.925970:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0741 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c439 expref: 447 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.925989:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa000/0x7b7109e1d0a0756 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c439 expref: 446 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774839.925997:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9b7602508600) 00010000:00010000:0.0:1785774839.925999:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774839.926002:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c0fa000, rc 0) 00000100:00100000:0.0:1785774839.926111:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+447:19337:x1872519648574592:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 8013us (9231us total) trans 4294983917 rc 0/0 00000100:00100000:0.0:1785774839.926122:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23968 00000020:00080000:0.0:1785774839.926130:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774839.926613:0:8660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8660:1872519671303680:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1785774839.926698:0:8660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774839.926758:0:8660:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605dff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774839.926775:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774839.926786:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671303552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774839.926824:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774839.926868:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303552 00000100:00100000:3.0:1785774839.926887:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303552 00000100:00100000:3.0:1785774839.926944:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1785774839.926953:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671303552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785774839.926988:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476032 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1785774839.927027:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671303552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774839.927039:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00080000:3.0:1785774839.927056:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774839.927099:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671303552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774839.927491:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303680 00000100:00100000:2.0:1785774839.927496:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303680 00000100:00100000:2.0:1785774839.927539:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239 00000100:00100000:2.0:1785774839.927547:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8660:x1872519671303680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1785774839.927581:0:8445:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2562 00000100:00100000:2.0:1785774839.934661:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8660:x1872519671303680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7105us (7953us total) trans 4294969899 rc 0/0 00000100:00100000:3.0:1785774839.934865:0:8660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8660:1872519671303680:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1785774839.934902:0:8660:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9f2:0x0]-[0x280000401:0xa21:0x0] 00000100:00100000:2.0:1785774839.935583:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239 00000100:00100000:0.0:1785774839.960118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774839.962518:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648574848 00000100:00100000:1.0:1785774839.962535:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648574848 00000100:00100000:1.0:1785774839.962620:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5194 00000100:00100000:1.0:1785774839.962631:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edefc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+447:19337:x1872519648574848:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774839.963247:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983918 00000100:00100000:1.0:1785774839.964540:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edefc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+449:19337:x1872519648574848:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1903us (4427us total) trans 4294983919 rc 0/0 00000100:00100000:1.0:1785774839.964554:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5194 00000020:00080000:1.0:1785774839.964561:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774839.972715:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774839.972745:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671303808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774839.972845:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774839.973135:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303808 00000100:00100000:1.0:1785774839.973146:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303808 00000100:00100000:1.0:1785774839.973263:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1785774839.973275:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671303808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774839.973305:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774839.973364:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671303808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774839.973374:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00080000:0.0:1785774839.973481:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774839.973531:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671303808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774839.978146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774839.978199:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648575104 00000100:00100000:3.0:1785774839.978210:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648575104 00000100:00100000:3.0:1785774839.978272:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23969 00000100:00100000:3.0:1785774839.978283:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+449:19337:x1872519648575104:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774839.978314:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774839.978339:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a0764 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c440 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.981626:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.981657:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.982279:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.982317:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.982327:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.982338:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774839.987096:0:9848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1872519671303936:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1785774839.987217:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774839.987278:0:9848:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605cf8840 going to sleep for 11 seconds 00000100:00100000:2.0:1785774839.988071:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671303936 00000100:00100000:2.0:1785774839.988083:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671303936 00000100:00100000:2.0:1785774839.988201:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5240 00000100:00100000:2.0:1785774839.988213:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9848:x1872519671303936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1785774839.988271:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2562 00000100:00080000:0.0:1785774839.988988:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1785774839.989072:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f2:0x0], index 1: 0 00000100:00100000:0.0:1785774839.992565:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:9848:x1872519671303936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4344us (5338us total) trans 4294969900 rc 0/0 00000100:00100000:0.0:1785774839.992579:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5240 00010000:00010000:3.0:1785774839.993194:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ae00/0x7b7109e1d0a0779 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.993216:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ae00/0x7b7109e1d0a0779 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.993230:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ae00/0x7b7109e1d0a0779 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774839.993362:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983920 00000100:00100000:1.0:1785774839.994560:0:9848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9848:1872519671303936:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1785774839.994582:0:9848:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9f2:0x0]-[0x2c0000401:0xa21:0x0] 00010000:00010000:3.0:1785774839.995004:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995014:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995022:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995030:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995036:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774839.995041:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995051:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995071:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774839.995074:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774839.995079:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995087:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a076b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774839.995104:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6f87f8b reply state 000000006ad1cfa3 transno 4294983921 ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995117:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995125:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95f89f7b (ffff9b7605fda600) 00010000:00010000:3.0:1785774839.995127:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774839.995130:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774839.995213:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a0764 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c440 expref: 453 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995229:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ae00/0x7b7109e1d0a0779 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c440 expref: 452 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774839.995238:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9b7605fdad00) 00010000:00010000:3.0:1785774839.995241:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774839.995243:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b760605ae00, rc 0) 00000100:00100000:3.0:1785774839.995319:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+453:19337:x1872519648575104:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 17038us (17186us total) trans 4294983921 rc 0/0 00000100:00100000:3.0:1785774839.995330:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23969 00000020:00080000:3.0:1785774839.995338:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.008488:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.008594:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648575360 00000100:00100000:1.0:1785774840.008607:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648575360 00000100:00100000:1.0:1785774840.008701:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5195 00000100:00100000:1.0:1785774840.008713:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+453:19337:x1872519648575360:12345-192.168.202.31@tcp:35:createmany.0 00000100:00080000:0.0:1785774840.009314:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1785774840.009456:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983922 00000100:00100000:1.0:1785774840.012938:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+455:19337:x1872519648575360:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 4209us (4446us total) trans 4294983923 rc 0/0 00000100:00100000:1.0:1785774840.012956:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5195 00000020:00080000:1.0:1785774840.012966:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.028664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.028784:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648575616 00000100:00100000:1.0:1785774840.028796:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648575616 00000100:00100000:1.0:1785774840.028873:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23970 00000100:00100000:1.0:1785774840.028890:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+455:19337:x1872519648575616:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774840.028925:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774840.028948:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a0787 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c447 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.029079:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.029096:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.029109:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.029125:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.029133:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.029140:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774840.029846:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f3:0x0], index 0: 0 00010000:00010000:1.0:1785774840.030066:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d0a079c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030078:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d0a079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030089:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d0a079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774840.030155:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983924 00010000:00010000:1.0:1785774840.030237:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030245:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030252:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030259:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030265:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774840.030269:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030277:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030291:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774840.030294:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774840.030300:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030307:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a078e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774840.030334:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9b698e6 reply state 0000000082cc804f transno 4294983925 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030353:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.030360:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd905ca7b (ffff9b7605fd8400) 00010000:00010000:1.0:1785774840.030363:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774840.030366:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774840.035509:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a0787 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c447 expref: 459 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.035566:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d0a079c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c447 expref: 458 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.035576:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:1.0:1785774840.035579:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774840.035582:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:1.0:1785774840.035905:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+459:19337:x1872519648575616:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7015us (7254us total) trans 4294983925 rc 0/0 00000100:00100000:1.0:1785774840.035915:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23970 00000020:00080000:1.0:1785774840.035923:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.059580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.059703:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648575872 00000100:00100000:0.0:1785774840.059716:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648575872 00000100:00100000:0.0:1785774840.059785:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5196 00000100:00100000:0.0:1785774840.059797:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+459:19337:x1872519648575872:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.060155:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983926 00000100:00100000:0.0:1785774840.060332:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+461:19337:x1872519648575872:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 535us (767us total) trans 4294983927 rc 0/0 00000100:00100000:0.0:1785774840.060341:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5196 00000020:00080000:0.0:1785774840.060347:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.068603:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.070511:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648576128 00000100:00100000:0.0:1785774840.070524:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648576128 00000100:00100000:0.0:1785774840.070603:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23971 00000100:00100000:0.0:1785774840.070612:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+461:19337:x1872519648576128:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774840.070646:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774840.070851:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a07aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c44e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.071028:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.071046:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.071060:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.071076:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.071083:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.071090:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774840.071819:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f3:0x0], index 1: 0 00010000:00010000:0.0:1785774840.072020:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0faa00/0x7b7109e1d0a07bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072030:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0faa00/0x7b7109e1d0a07bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072038:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0faa00/0x7b7109e1d0a07bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774840.072092:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983928 00010000:00010000:0.0:1785774840.072129:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072180:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072187:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072195:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072202:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774840.072207:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072216:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072231:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774840.072235:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774840.072240:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072248:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774840.072263:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f83c2b3c reply state 00000000f163cbd6 transno 4294983929 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072276:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072283:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xee04d97b (ffff9b7602508200) 00010000:00010000:0.0:1785774840.072286:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774840.072290:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774840.072324:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a07aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c44e expref: 465 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072340:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0faa00/0x7b7109e1d0a07bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c44e expref: 464 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.072349:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9b7602508300) 00010000:00010000:0.0:1785774840.072352:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774840.072354:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c0faa00, rc 0) 00000100:00100000:0.0:1785774840.074766:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+465:19337:x1872519648576128:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4144us (6165us total) trans 4294983929 rc 0/0 00000100:00100000:0.0:1785774840.074779:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23971 00000020:00080000:0.0:1785774840.074786:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.095391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.095543:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648576384 00000100:00100000:1.0:1785774840.095558:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648576384 00000100:00100000:1.0:1785774840.095634:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5197 00000100:00100000:1.0:1785774840.095645:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+465:19337:x1872519648576384:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774840.096025:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983930 00000100:00100000:1.0:1785774840.096220:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+467:19337:x1872519648576384:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 519us (790us total) trans 4294983931 rc 0/0 00000100:00100000:1.0:1785774840.096234:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5197 00000020:00080000:1.0:1785774840.096240:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.104298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.104430:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648576640 00000100:00100000:0.0:1785774840.104445:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648576640 00000100:00100000:0.0:1785774840.104518:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23972 00000100:00100000:0.0:1785774840.104528:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+467:19337:x1872519648576640:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774840.104553:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774840.104573:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a07cd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c455 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.104683:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.104698:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.104714:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.104728:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.104734:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.104741:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774840.105088:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f4:0x0], index 0: 0 00010000:00010000:0.0:1785774840.105373:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbe00/0x7b7109e1d0a07e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105382:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbe00/0x7b7109e1d0a07e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105391:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbe00/0x7b7109e1d0a07e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774840.105447:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983932 00010000:00010000:0.0:1785774840.105503:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105512:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105518:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105530:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105537:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774840.105542:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105550:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105564:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774840.105568:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774840.105572:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105578:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a07d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774840.105591:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e44f5105 reply state 00000000f691d256 transno 4294983933 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105601:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.105607:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdfb2047b (ffff9b7602508800) 00010000:00010000:0.0:1785774840.105609:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774840.105612:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774840.105843:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a07cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c455 expref: 471 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.105870:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbe00/0x7b7109e1d0a07e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c455 expref: 470 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.105880:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9b7602508d00) 00010000:00010000:1.0:1785774840.105883:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774840.105887:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c0fbe00, rc 0) 00000100:00100000:1.0:1785774840.105974:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+471:19337:x1872519648576640:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1446us (1689us total) trans 4294983933 rc 0/0 00000100:00100000:1.0:1785774840.105984:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23972 00000020:00080000:1.0:1785774840.105991:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.124321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.131564:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648576896 00000100:00100000:0.0:1785774840.131589:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648576896 00000100:00100000:0.0:1785774840.131694:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5198 00000100:00100000:0.0:1785774840.131706:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+471:19337:x1872519648576896:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.132056:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983934 00000100:00100000:0.0:1785774840.132202:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+473:19337:x1872519648576896:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 498us (7894us total) trans 4294983935 rc 0/0 00000100:00100000:0.0:1785774840.132211:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5198 00000020:00080000:0.0:1785774840.132216:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.137777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.137899:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648577152 00000100:00100000:1.0:1785774840.137911:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648577152 00000100:00100000:1.0:1785774840.137987:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23973 00000100:00100000:1.0:1785774840.137998:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+473:19337:x1872519648577152:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774840.138027:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774840.138053:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a07f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c45c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.138238:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.138255:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.138270:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.138300:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.138308:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.138314:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774840.138800:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f4:0x0], index 1: 0 00010000:00010000:1.0:1785774840.139020:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d0a0805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139029:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d0a0805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139038:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d0a0805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774840.139099:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983936 00010000:00010000:1.0:1785774840.139139:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139147:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139154:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139187:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139195:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774840.139200:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139210:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139224:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774840.139228:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774840.139233:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139241:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a07f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774840.139266:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2e7d371 reply state 000000008da03e8a transno 4294983937 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139277:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139283:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x869c3b7b (ffff9b7605fd8b00) 00010000:00010000:1.0:1785774840.139286:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774840.139288:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774840.139319:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a07f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c45c expref: 477 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139341:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d0a0805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c45c expref: 476 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.139350:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:1.0:1785774840.139353:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774840.139355:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700031000, rc 0) 00000100:00100000:1.0:1785774840.140695:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+477:19337:x1872519648577152:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2693us (2924us total) trans 4294983937 rc 0/0 00000100:00100000:1.0:1785774840.140706:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23973 00000020:00080000:1.0:1785774840.140713:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.164579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.164835:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648577408 00000100:00100000:1.0:1785774840.164848:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648577408 00000100:00100000:1.0:1785774840.164917:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5199 00000100:00100000:1.0:1785774840.164929:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+477:19337:x1872519648577408:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774840.165274:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983938 00000100:00100000:1.0:1785774840.165646:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+479:19337:x1872519648577408:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 718us (1075us total) trans 4294983939 rc 0/0 00000100:00100000:1.0:1785774840.165656:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5199 00000020:00080000:1.0:1785774840.165662:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.191972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.192125:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648577664 00000100:00100000:0.0:1785774840.192137:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648577664 00000100:00100000:0.0:1785774840.192236:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23974 00000100:00100000:0.0:1785774840.192248:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+479:19337:x1872519648577664:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774840.192284:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774840.192310:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0813 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c463 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.192470:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.192488:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.192504:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.192520:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.192527:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.192534:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774840.192936:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f5:0x0], index 0: 0 00010000:00010000:0.0:1785774840.193128:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa200/0x7b7109e1d0a0828 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193136:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa200/0x7b7109e1d0a0828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193143:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa200/0x7b7109e1d0a0828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774840.193218:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983940 00010000:00010000:0.0:1785774840.193253:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193260:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193267:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193272:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193277:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774840.193281:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193288:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193299:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774840.193302:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774840.193307:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193313:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a081a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774840.193328:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008310d6c4 reply state 00000000892dcbc3 transno 4294983941 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193341:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193347:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9bba767b (ffff9b7602508900) 00010000:00010000:0.0:1785774840.193350:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774840.193353:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774840.193389:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a0813 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c463 expref: 483 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193419:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa200/0x7b7109e1d0a0828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c463 expref: 482 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.193426:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9b7602508b00) 00010000:00010000:0.0:1785774840.193428:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774840.193430:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c0fa200, rc 0) 00000100:00100000:0.0:1785774840.193510:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+483:19337:x1872519648577664:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1265us (1552us total) trans 4294983941 rc 0/0 00000100:00100000:0.0:1785774840.193517:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23974 00000020:00080000:0.0:1785774840.193522:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.203656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.203829:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648577920 00000100:00100000:3.0:1785774840.203841:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648577920 00000100:00100000:3.0:1785774840.203920:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5200 00000100:00100000:3.0:1785774840.203933:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770eded050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+483:19337:x1872519648577920:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.204320:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983942 00000100:00100000:3.0:1785774840.207613:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770eded050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+485:19337:x1872519648577920:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 3673us (3960us total) trans 4294983943 rc 0/0 00000100:00100000:3.0:1785774840.207627:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5200 00000020:00080000:3.0:1785774840.207635:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.224928:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.225123:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648578176 00000100:00100000:1.0:1785774840.225136:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648578176 00000100:00100000:1.0:1785774840.225242:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23975 00000100:00100000:1.0:1785774840.225254:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+485:19337:x1872519648578176:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774840.225286:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774840.225312:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0836 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c46a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.225570:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.225589:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.225604:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.225621:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.225628:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.225635:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774840.242586:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f5:0x0], index 1: 0 00010000:00010000:0.0:1785774840.244733:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a084b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.244759:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a084b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.244775:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a084b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774840.245985:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983944 00010000:00010000:0.0:1785774840.246068:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.246078:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.246084:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.246090:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.246103:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774840.246108:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.246116:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.246134:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774840.246136:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774840.246141:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.246151:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a083d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774840.247290:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002012d5a3 reply state 00000000a09dd910 transno 4294983945 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.247309:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.247318:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b9857b (ffff9b7605fd8700) 00010000:00010000:0.0:1785774840.247322:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774840.247325:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774840.247397:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0836 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c46a expref: 489 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.247419:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a084b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c46a expref: 488 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.247427:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9b7602508f00) 00010000:00010000:0.0:1785774840.247429:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774840.247432:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773c0fb600, rc 0) 00000100:00100000:0.0:1785774840.248755:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+489:19337:x1872519648578176:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 23498us (23835us total) trans 4294983945 rc 0/0 00000100:00100000:0.0:1785774840.248767:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23975 00000020:00080000:0.0:1785774840.248775:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.253016:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.253143:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648578432 00000100:00100000:0.0:1785774840.253156:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648578432 00000100:00100000:0.0:1785774840.253246:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5201 00000100:00100000:0.0:1785774840.253258:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+489:19337:x1872519648578432:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.253626:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983946 00000100:00100000:0.0:1785774840.253756:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+491:19337:x1872519648578432:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 498us (751us total) trans 4294983947 rc 0/0 00000100:00100000:0.0:1785774840.253764:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5201 00000020:00080000:0.0:1785774840.253769:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.265120:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.265277:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648578688 00000100:00100000:1.0:1785774840.265290:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648578688 00000100:00100000:1.0:1785774840.265392:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23976 00000100:00100000:1.0:1785774840.265406:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+491:19337:x1872519648578688:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774840.265436:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774840.265461:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0859 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c471 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.265621:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.265645:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.265658:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.265685:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.265692:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.265698:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774840.266118:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f6:0x0], index 0: 0 00010000:00010000:1.0:1785774840.266366:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d0a086e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266376:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d0a086e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266384:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d0a086e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774840.266437:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983948 00010000:00010000:1.0:1785774840.266473:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266480:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266490:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266498:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266504:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774840.266509:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266517:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266531:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774840.266534:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774840.266540:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266546:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0860 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774840.266574:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001171b9a9 reply state 000000000e8c8140 transno 4294983949 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266585:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266592:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb4d1abd0 (ffff9b7605fd8800) 00010000:00010000:1.0:1785774840.266594:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774840.266597:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774840.266631:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0859 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c471 expref: 495 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266647:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d0a086e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c471 expref: 494 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.266656:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:1.0:1785774840.266658:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774840.266660:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7700030400, rc 0) 00000100:00100000:1.0:1785774840.266744:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+495:19337:x1872519648578688:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1342us (1637us total) trans 4294983949 rc 0/0 00000100:00100000:1.0:1785774840.266752:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23976 00000020:00080000:1.0:1785774840.266757:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.278498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.278571:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648578944 00000100:00100000:3.0:1785774840.278586:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648578944 00000100:00100000:3.0:1785774840.278653:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5202 00000100:00100000:3.0:1785774840.278664:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+495:19337:x1872519648578944:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.279047:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983950 00000100:00100000:2.0:1785774840.279251:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+497:19337:x1872519648578944:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 585us (764us total) trans 4294983951 rc 0/0 00000100:00100000:2.0:1785774840.279260:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5202 00000020:00080000:2.0:1785774840.279266:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.293256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.293412:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648579200 00000100:00100000:2.0:1785774840.293427:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648579200 00000100:00100000:2.0:1785774840.293517:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23977 00000100:00100000:2.0:1785774840.293529:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+497:19337:x1872519648579200:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774840.293563:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774840.293592:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a087c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c478 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.293760:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.293781:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.293795:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.293824:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.293832:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.293839:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.294288:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f6:0x0], index 1: 0 00010000:00010000:2.0:1785774840.294484:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a0891 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294494:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a0891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294502:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a0891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.294556:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983952 00010000:00010000:2.0:1785774840.294591:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294605:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294612:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294619:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294625:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9de00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.294629:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294638:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294651:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.294654:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.294659:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294667:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a0883 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.294681:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b54fd752 reply state 000000008eeba83f transno 4294983953 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294692:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294699:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7db3ad0 (ffff9b760562fb00) 00010000:00010000:2.0:1785774840.294702:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.294705:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.294733:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a087c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c478 expref: 501 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294748:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a0891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c478 expref: 500 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.294757:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9b760562f100) 00010000:00010000:2.0:1785774840.294759:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.294762:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c600, rc 0) 00000100:00100000:2.0:1785774840.295950:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+501:19337:x1872519648579200:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2417us (2703us total) trans 4294983953 rc 0/0 00000100:00100000:2.0:1785774840.295961:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23977 00000020:00080000:2.0:1785774840.295969:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.323051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.325988:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648579456 00000100:00100000:3.0:1785774840.326006:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648579456 00000100:00100000:3.0:1785774840.326093:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5203 00000100:00100000:3.0:1785774840.326105:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+501:19337:x1872519648579456:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.326568:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983954 00000100:00100000:3.0:1785774840.326712:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+503:19337:x1872519648579456:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 607us (3672us total) trans 4294983955 rc 0/0 00000100:00100000:3.0:1785774840.326721:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5203 00000020:00080000:3.0:1785774840.326727:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.336870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.346053:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648579712 00000100:00100000:0.0:1785774840.346075:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648579712 00000100:00100000:0.0:1785774840.346194:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23978 00000100:00100000:0.0:1785774840.346208:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+503:19337:x1872519648579712:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774840.346242:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774840.346271:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a089f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c47f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.355188:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.355216:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.355231:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.355251:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.355258:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.355265:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.355915:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f7:0x0], index 0: 0 00010000:00010000:2.0:1785774840.356099:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a08b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.356109:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a08b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.356117:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a08b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.359957:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983956 00010000:00010000:2.0:1785774840.360108:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360123:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360131:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360140:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360148:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.360154:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360602:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360625:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.360630:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.360636:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360644:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a08a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.360664:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e75c1fc reply state 000000003318e592 transno 4294983957 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360678:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360685:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x798865d0 (ffff9b760562fe00) 00010000:00010000:2.0:1785774840.360687:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.360691:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.360757:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a089f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c47f expref: 507 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360776:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a08b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c47f expref: 506 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.360783:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9b760562f700) 00010000:00010000:2.0:1785774840.360785:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.360788:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c800, rc 0) 00000100:00100000:2.0:1785774840.363792:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+507:19337:x1872519648579712:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 17573us (26924us total) trans 4294983957 rc 0/0 00000100:00100000:2.0:1785774840.363816:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23978 00000020:00080000:2.0:1785774840.363824:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.371561:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.377602:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648579968 00000100:00100000:2.0:1785774840.377621:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648579968 00000100:00100000:3.0:1785774840.377891:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5204 00000100:00100000:3.0:1785774840.377903:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+507:19337:x1872519648579968:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.378246:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983958 00000100:00100000:3.0:1785774840.378376:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+509:19337:x1872519648579968:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 475us (6828us total) trans 4294983959 rc 0/0 00000100:00100000:3.0:1785774840.378390:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5204 00000020:00080000:3.0:1785774840.378396:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.390121:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.397584:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648580224 00000100:00100000:2.0:1785774840.397604:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648580224 00000100:00100000:3.0:1785774840.397871:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23979 00000100:00100000:3.0:1785774840.397883:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+509:19337:x1872519648580224:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.397916:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.397942:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a08c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c486 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.398077:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.398094:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.398107:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.398128:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.398135:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.398140:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774840.399069:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f7:0x0], index 1: 0 00010000:00010000:3.0:1785774840.400582:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a08d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.400599:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a08d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.400610:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a08d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774840.401897:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983960 00010000:00010000:3.0:1785774840.401965:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.401974:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.401979:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.401985:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.401990:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774840.401994:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.402004:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.402021:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774840.402023:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774840.402028:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.402034:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a08c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774840.402049:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc543389 reply state 000000004e278043 transno 4294983961 ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.402059:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.402066:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0729cd0 (ffff9b7605fdaa00) 00010000:00010000:3.0:1785774840.402068:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774840.402071:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774840.402116:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a08c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c486 expref: 513 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.402130:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a08d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c486 expref: 512 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.402137:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9b7605fdac00) 00010000:00010000:3.0:1785774840.402139:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774840.402141:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b760605a600, rc 0) 00000100:00100000:3.0:1785774840.402257:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+513:19337:x1872519648580224:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4375us (12149us total) trans 4294983961 rc 0/0 00000100:00100000:3.0:1785774840.402266:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23979 00000020:00080000:3.0:1785774840.402272:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.426207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.426359:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648580480 00000100:00100000:3.0:1785774840.426371:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648580480 00000100:00100000:3.0:1785774840.426510:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5205 00000100:00100000:3.0:1785774840.426521:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+513:19337:x1872519648580480:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.426925:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983962 00000100:00100000:3.0:1785774840.427039:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+515:19337:x1872519648580480:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 520us (846us total) trans 4294983963 rc 0/0 00000100:00100000:3.0:1785774840.427047:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5205 00000020:00080000:3.0:1785774840.427053:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.449136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.449299:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648580736 00000100:00100000:2.0:1785774840.449320:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648580736 00000100:00100000:1.0:1785774840.449485:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23980 00000100:00100000:1.0:1785774840.449501:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+515:19337:x1872519648580736:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774840.449536:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774840.449563:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a08e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c48d expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.449717:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.449735:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.449748:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.449765:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.449773:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.449779:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774840.450254:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f8:0x0], index 0: 0 00010000:00010000:1.0:1785774840.452766:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a08fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452787:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a08fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452799:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a08fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774840.452895:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983964 00010000:00010000:1.0:1785774840.452942:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452950:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452957:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452963:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452970:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774840.452976:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452985:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.452999:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774840.453003:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774840.453009:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.453015:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a08ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774840.453043:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c587b36 reply state 000000008308550d transno 4294983965 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.453056:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.453063:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe37fc7d0 (ffff9b7605fd8900) 00010000:00010000:1.0:1785774840.453065:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774840.453068:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774840.453107:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a08e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c48d expref: 519 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.453124:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a08fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c48d expref: 518 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.453132:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:1.0:1785774840.453134:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774840.453136:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce000, rc 0) 00000100:00100000:1.0:1785774840.453245:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+519:19337:x1872519648580736:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3749us (4122us total) trans 4294983965 rc 0/0 00000100:00100000:1.0:1785774840.453254:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23980 00000020:00080000:1.0:1785774840.453260:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.470573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.470689:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648580992 00000100:00100000:3.0:1785774840.470702:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648580992 00000100:00100000:3.0:1785774840.470779:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5206 00000100:00100000:3.0:1785774840.470789:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+519:19337:x1872519648580992:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.471144:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983966 00000100:00100000:3.0:1785774840.471298:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+521:19337:x1872519648580992:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 510us (738us total) trans 4294983967 rc 0/0 00000100:00100000:3.0:1785774840.471307:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5206 00000020:00080000:3.0:1785774840.471485:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.481934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.482126:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648581248 00000100:00100000:2.0:1785774840.482140:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648581248 00000100:00100000:2.0:1785774840.482259:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23981 00000100:00100000:2.0:1785774840.482271:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+521:19337:x1872519648581248:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774840.482304:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774840.482343:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0908 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c494 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.482542:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.482562:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.482577:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.482595:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.482603:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.482609:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.485653:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f8:0x0], index 1: 0 00010000:00010000:2.0:1785774840.485934:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9600/0x7b7109e1d0a091d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.485952:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9600/0x7b7109e1d0a091d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.485966:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9600/0x7b7109e1d0a091d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.486032:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983968 00010000:00010000:2.0:1785774840.486075:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486084:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486091:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486099:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486106:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.486110:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486120:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486134:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.486138:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.486144:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486152:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a090f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.486197:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d320e556 reply state 00000000b0e226cd transno 4294983969 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486211:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486218:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x507ed6d0 (ffff9b760562f900) 00010000:00010000:2.0:1785774840.486221:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.486225:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.486266:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0908 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c494 expref: 525 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486285:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9600/0x7b7109e1d0a091d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c494 expref: 524 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.486292:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9b760562f400) 00010000:00010000:2.0:1785774840.486295:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.486297:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9600, rc 0) 00000100:00100000:2.0:1785774840.486397:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+525:19337:x1872519648581248:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4127us (4476us total) trans 4294983969 rc 0/0 00000100:00100000:2.0:1785774840.486407:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23981 00000020:00080000:2.0:1785774840.486413:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.508082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.508190:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648581504 00000100:00100000:0.0:1785774840.508203:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648581504 00000100:00100000:0.0:1785774840.508271:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5207 00000100:00100000:0.0:1785774840.508282:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+525:19337:x1872519648581504:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.508799:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983970 00000100:00100000:0.0:1785774840.509017:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+527:19337:x1872519648581504:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 736us (947us total) trans 4294983971 rc 0/0 00000100:00100000:0.0:1785774840.509026:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5207 00000020:00080000:0.0:1785774840.509032:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.531124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.531335:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648581760 00000100:00100000:3.0:1785774840.531348:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648581760 00000100:00100000:3.0:1785774840.531429:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23982 00000100:00100000:3.0:1785774840.531439:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+527:19337:x1872519648581760:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.531474:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.531500:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a092b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c49b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.531649:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.531678:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.531692:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.531710:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.531717:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.531725:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774840.532136:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f9:0x0], index 0: 0 00010000:00010000:3.0:1785774840.532355:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532365:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532372:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774840.532428:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983972 00010000:00010000:3.0:1785774840.532461:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532469:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532476:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532483:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532490:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774840.532495:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532504:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532523:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774840.532526:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774840.532532:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532539:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0932 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774840.532552:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000548ce316 reply state 000000007cf18810 transno 4294983973 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532571:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532578:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea2c01d0 (ffff9b7605fda900) 00010000:00010000:3.0:1785774840.532581:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774840.532584:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774840.532613:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a092b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c49b expref: 531 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532628:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c49b expref: 530 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.532637:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9b7605fdab00) 00010000:00010000:3.0:1785774840.532639:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774840.532642:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc600, rc 0) 00000100:00100000:3.0:1785774840.532718:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+531:19337:x1872519648581760:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1280us (1606us total) trans 4294983973 rc 0/0 00000100:00100000:3.0:1785774840.532726:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23982 00000020:00080000:3.0:1785774840.532732:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774840.537287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.539459:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648582016 00000100:00100000:0.0:1785774840.539475:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648582016 00000100:00100000:0.0:1785774840.539546:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5208 00000100:00100000:0.0:1785774840.539557:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+531:19337:x1872519648582016:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.540034:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983974 00000100:00100000:0.0:1785774840.540147:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+533:19337:x1872519648582016:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 591us (2870us total) trans 4294983975 rc 0/0 00000100:00100000:0.0:1785774840.540156:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5208 00000020:00080000:0.0:1785774840.540228:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.547779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.547981:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648582272 00000100:00100000:3.0:1785774840.547994:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648582272 00000100:00100000:3.0:1785774840.548070:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23983 00000100:00100000:3.0:1785774840.548081:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+533:19337:x1872519648582272:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.548111:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.548141:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a094e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4a2 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.548498:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.548517:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.548531:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.548546:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.548554:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.548560:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774840.549233:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f9:0x0], index 1: 0 00010000:00010000:3.0:1785774840.550025:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0c00/0x7b7109e1d0a0963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550038:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0c00/0x7b7109e1d0a0963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550050:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0c00/0x7b7109e1d0a0963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774840.550111:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983976 00010000:00010000:3.0:1785774840.550146:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550183:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550191:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550199:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550206:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774840.550211:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550220:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550234:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774840.550238:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774840.550243:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550250:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b800/0x7b7109e1d0a0955 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774840.550266:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000022b3222 reply state 000000002f1f5f68 transno 4294983977 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550279:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550285:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe91638d0 (ffff9b7605fda000) 00010000:00010000:3.0:1785774840.550288:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774840.550291:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774840.550335:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605bc00/0x7b7109e1d0a094e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4a2 expref: 537 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550350:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0c00/0x7b7109e1d0a0963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4a2 expref: 536 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.550359:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9b7731f8a500) 00010000:00010000:3.0:1785774840.550361:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774840.550363:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057b0c00, rc 0) 00000100:00100000:3.0:1785774840.551784:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+537:19337:x1872519648582272:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3698us (4010us total) trans 4294983977 rc 0/0 00000100:00100000:3.0:1785774840.551797:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23983 00000020:00080000:3.0:1785774840.551812:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.565647:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.565778:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648582528 00000100:00100000:0.0:1785774840.565790:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648582528 00000100:00100000:0.0:1785774840.565924:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5209 00000100:00100000:0.0:1785774840.565938:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+537:19337:x1872519648582528:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.566290:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983978 00000100:00100000:0.0:1785774840.568050:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+539:19337:x1872519648582528:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 2108us (2410us total) trans 4294983979 rc 0/0 00000100:00100000:0.0:1785774840.568064:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5209 00000020:00080000:0.0:1785774840.568071:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.585100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.585424:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648582784 00000100:00100000:2.0:1785774840.585438:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648582784 00000100:00100000:2.0:1785774840.585687:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23984 00000100:00100000:2.0:1785774840.585701:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+539:19337:x1872519648582784:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774840.585732:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774840.585759:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a0971 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4a9 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.585912:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.585932:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.585946:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.585962:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.585969:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.585977:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.586829:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fa:0x0], index 0: 0 00010000:00010000:2.0:1785774840.587031:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a0986 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587042:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a0986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587056:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a0986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.587113:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983980 00010000:00010000:2.0:1785774840.587148:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587157:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587186:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587193:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587200:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.587205:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587214:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587248:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.587251:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.587256:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587264:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0978 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.587281:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047a62fac reply state 00000000111c71de transno 4294983981 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587295:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.587301:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfe3473d0 (ffff9b760562f600) 00010000:00010000:2.0:1785774840.587304:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.590696:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.590788:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a0971 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4a9 expref: 543 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.590828:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a0986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4a9 expref: 542 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.590837:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9b760562f200) 00010000:00010000:2.0:1785774840.590840:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.590843:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8000, rc 0) 00000100:00100000:2.0:1785774840.590955:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+543:19337:x1872519648582784:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 5256us (5868us total) trans 4294983981 rc 0/0 00000100:00100000:2.0:1785774840.590963:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23984 00000020:00080000:2.0:1785774840.590970:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.597073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.597766:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648583040 00000100:00100000:3.0:1785774840.597780:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648583040 00000100:00100000:3.0:1785774840.597863:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5210 00000100:00100000:3.0:1785774840.597875:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+543:19337:x1872519648583040:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.598247:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983982 00000100:00100000:3.0:1785774840.598358:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+545:19337:x1872519648583040:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 485us (1300us total) trans 4294983983 rc 0/0 00000100:00100000:3.0:1785774840.598367:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5210 00000020:00080000:3.0:1785774840.598372:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.610477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.610623:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648583296 00000100:00100000:3.0:1785774840.610636:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648583296 00000100:00100000:3.0:1785774840.610722:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23985 00000100:00100000:3.0:1785774840.610734:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+545:19337:x1872519648583296:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.610766:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.610794:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0994 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4b0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.610944:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.610963:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.610976:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.610993:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.611000:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.611008:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.611701:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fa:0x0], index 1: 0 00010000:00010000:2.0:1785774840.611926:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a09a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.611935:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a09a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.611946:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a09a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.612011:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983984 00010000:00010000:2.0:1785774840.612063:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612072:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612078:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612084:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612090:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.612094:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612102:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612114:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.612116:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.612121:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612126:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a099b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.612138:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d7761af reply state 000000000dc39d9b transno 4294983985 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612154:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612217:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x133382d0 (ffff9b7731f8af00) 00010000:00010000:2.0:1785774840.612220:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.612223:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.612259:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0994 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4b0 expref: 549 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612274:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a09a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4b0 expref: 548 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.612283:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9b760562fd00) 00010000:00010000:2.0:1785774840.612285:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.612288:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8c00, rc 0) 00000100:00100000:2.0:1785774840.612474:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+549:19337:x1872519648583296:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1645us (1924us total) trans 4294983985 rc 0/0 00000100:00100000:2.0:1785774840.612485:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23985 00000020:00080000:2.0:1785774840.612491:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785774840.612830:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774840.636324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.636414:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648583552 00000100:00100000:0.0:1785774840.636426:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648583552 00000100:00100000:0.0:1785774840.636500:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5211 00000100:00100000:0.0:1785774840.636513:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+549:19337:x1872519648583552:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.637024:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983986 00000100:00100000:0.0:1785774840.637345:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+551:19337:x1872519648583552:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 834us (1033us total) trans 4294983987 rc 0/0 00000100:00100000:0.0:1785774840.637355:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5211 00000020:00080000:0.0:1785774840.637361:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.655441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.655594:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648583808 00000100:00100000:3.0:1785774840.655608:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648583808 00000100:00100000:3.0:1785774840.655697:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23986 00000100:00100000:3.0:1785774840.655710:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+551:19337:x1872519648583808:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.655743:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.655770:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a09b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4b7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.655928:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.655947:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.655960:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.655976:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.655984:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.655991:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774840.656685:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fb:0x0], index 0: 0 00010000:00010000:3.0:1785774840.656919:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0000/0x7b7109e1d0a09cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.656930:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0000/0x7b7109e1d0a09cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.656940:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0000/0x7b7109e1d0a09cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774840.657009:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983988 00010000:00010000:3.0:1785774840.657046:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.657060:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.657067:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.657075:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.657082:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774840.657087:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.657096:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.657112:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774840.659255:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774840.659266:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.659277:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a09be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774840.659295:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003e3f464 reply state 000000006ca18906 transno 4294983989 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.659310:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.659319:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xeedd9295 (ffff9b7731f8a000) 00010000:00010000:3.0:1785774840.659323:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774840.659327:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774840.659385:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a09b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4b7 expref: 555 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.659403:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0000/0x7b7109e1d0a09cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4b7 expref: 554 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.659411:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9b7731f8aa00) 00010000:00010000:3.0:1785774840.659413:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774840.659415:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057b0000, rc 0) 00000100:00100000:2.0:1785774840.660694:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+555:19337:x1872519648583808:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4979us (5258us total) trans 4294983989 rc 0/0 00000100:00100000:2.0:1785774840.660707:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23986 00000020:00080000:2.0:1785774840.660714:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.667949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.668110:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648584064 00000100:00100000:0.0:1785774840.668123:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648584064 00000100:00100000:0.0:1785774840.668220:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5212 00000100:00100000:0.0:1785774840.668232:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+555:19337:x1872519648584064:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.670073:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983990 00000100:00100000:0.0:1785774840.670215:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+557:19337:x1872519648584064:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 1983us (2275us total) trans 4294983991 rc 0/0 00000100:00100000:0.0:1785774840.670225:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5212 00000020:00080000:0.0:1785774840.670232:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.686392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.686558:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648584320 00000100:00100000:2.0:1785774840.686571:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648584320 00000100:00100000:2.0:1785774840.686645:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23987 00000100:00100000:2.0:1785774840.686656:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+557:19337:x1872519648584320:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774840.686696:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774840.686724:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a09da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4be expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.686862:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.686887:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.686899:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.686915:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.686921:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.686927:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.687607:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fb:0x0], index 1: 0 00010000:00010000:2.0:1785774840.687963:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9c00/0x7b7109e1d0a09ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.687974:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9c00/0x7b7109e1d0a09ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.687983:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9c00/0x7b7109e1d0a09ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.688042:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983992 00010000:00010000:2.0:1785774840.688078:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688086:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688093:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688100:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688107:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.688112:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688119:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688133:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.688136:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.688142:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688149:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a09e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.688187:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044394bdf reply state 000000003b1a2b86 transno 4294983993 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688205:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688212:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6be72195 (ffff9b760562ff00) 00010000:00010000:2.0:1785774840.688215:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.688218:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.688252:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a09da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4be expref: 561 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688271:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9c00/0x7b7109e1d0a09ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4be expref: 560 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.688279:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9b760562f000) 00010000:00010000:2.0:1785774840.688281:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.688284:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9c00, rc 0) 00000100:00100000:2.0:1785774840.688364:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+561:19337:x1872519648584320:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1710us (1992us total) trans 4294983993 rc 0/0 00000100:00100000:2.0:1785774840.688373:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23987 00000020:00080000:2.0:1785774840.688959:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.693044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.693125:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648584576 00000100:00100000:0.0:1785774840.693137:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648584576 00000100:00100000:0.0:1785774840.693223:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5213 00000100:00100000:0.0:1785774840.693234:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+561:19337:x1872519648584576:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.693575:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983994 00000100:00100000:0.0:1785774840.693681:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+563:19337:x1872519648584576:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 448us (648us total) trans 4294983995 rc 0/0 00000100:00100000:0.0:1785774840.693689:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5213 00000020:00080000:0.0:1785774840.693693:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.717639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.718202:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648584832 00000100:00100000:0.0:1785774840.718215:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648584832 00000100:00100000:0.0:1785774840.718302:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23988 00000100:00100000:0.0:1785774840.718312:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+563:19337:x1872519648584832:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774840.718342:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774840.718366:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a09fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.718515:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.718532:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.718546:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.718562:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.718569:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.718576:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774840.719000:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fc:0x0], index 0: 0 00010000:00010000:0.0:1785774840.719371:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a0a12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719381:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a0a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719388:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a0a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774840.719439:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983996 00010000:00010000:0.0:1785774840.719473:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719485:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719492:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719500:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719506:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774840.719511:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719521:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719534:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774840.719537:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774840.719543:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719550:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0a04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774840.719566:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cb2f190 reply state 000000004f834e11 transno 4294983997 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719578:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719585:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6d724c95 (ffff9b7602508e00) 00010000:00010000:0.0:1785774840.719588:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774840.719591:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774840.719620:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a09fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4c5 expref: 567 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719633:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a0a12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4c5 expref: 566 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774840.719641:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9b7602508500) 00010000:00010000:0.0:1785774840.719643:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774840.719645:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770149a000, rc 0) 00000100:00100000:0.0:1785774840.719713:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+567:19337:x1872519648584832:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1402us (2087us total) trans 4294983997 rc 0/0 00000100:00100000:0.0:1785774840.719720:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23988 00000020:00080000:0.0:1785774840.719726:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.731496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.731752:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648585088 00000100:00100000:0.0:1785774840.731764:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648585088 00000100:00100000:0.0:1785774840.731849:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5214 00000100:00100000:0.0:1785774840.731861:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+567:19337:x1872519648585088:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774840.742414:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983998 00000100:00100000:1.0:1785774840.742760:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+569:19337:x1872519648585088:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 10893us (11269us total) trans 4294983999 rc 0/0 00000100:00100000:1.0:1785774840.742772:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5214 00000020:00080000:1.0:1785774840.742778:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.746610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.746717:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648585344 00000100:00100000:2.0:1785774840.746729:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648585344 00000100:00100000:2.0:1785774840.746798:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23989 00000100:00100000:2.0:1785774840.746818:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+569:19337:x1872519648585344:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774840.746846:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774840.753090:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0a20 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4cc expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.753331:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.753349:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.753365:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.753395:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.753402:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.753410:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.754057:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fc:0x0], index 1: 0 00010000:00010000:2.0:1785774840.754314:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a0a35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.754326:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a0a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.754336:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a0a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.756103:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984000 00010000:00010000:2.0:1785774840.756197:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756218:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756224:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756230:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756235:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.756240:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756247:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756263:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.756266:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.756271:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756277:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a27 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.756294:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000236b1022 reply state 000000006ef15bff transno 4294984001 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756304:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.756311:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a5c8395 (ffff9b760562f800) 00010000:00010000:2.0:1785774840.756314:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.756317:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.756364:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0a20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4cc expref: 573 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.757561:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a0a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4cc expref: 572 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.757572:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9b760562fa00) 00010000:00010000:2.0:1785774840.757575:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.757577:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8a00, rc 0) 00000100:00100000:2.0:1785774840.757855:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+573:19337:x1872519648585344:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 11038us (11253us total) trans 4294984001 rc 0/0 00000100:00100000:2.0:1785774840.757866:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23989 00000020:00080000:2.0:1785774840.757922:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.777569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.777715:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648585600 00000100:00100000:3.0:1785774840.777729:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648585600 00000100:00100000:3.0:1785774840.777866:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5215 00000100:00100000:3.0:1785774840.777880:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+573:19337:x1872519648585600:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:3.0:1785774840.778321:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984002 00000100:00100000:3.0:1785774840.778438:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+575:19337:x1872519648585600:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 562us (885us total) trans 4294984003 rc 0/0 00000100:00100000:3.0:1785774840.778447:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5215 00000020:00080000:3.0:1785774840.778463:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.801354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774840.801469:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648585856 00000100:00100000:2.0:1785774840.801482:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648585856 00000100:00100000:2.0:1785774840.801553:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23990 00000100:00100000:2.0:1785774840.801564:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+575:19337:x1872519648585856:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774840.801594:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774840.801620:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0a43 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4d3 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.801762:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.801779:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.801794:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.801820:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.801827:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.801834:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774840.802428:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fd:0x0], index 0: 0 00010000:00010000:2.0:1785774840.802900:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a0a58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.802911:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a0a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.802920:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a0a58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.802987:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984004 00010000:00010000:2.0:1785774840.803027:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803036:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803043:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803055:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803061:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.803065:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803073:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803087:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.803090:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.803095:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803102:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0a4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.803534:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091df88c0 reply state 000000005f20081e transno 4294984005 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803550:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803558:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x609ae95 (ffff9b760562f300) 00010000:00010000:2.0:1785774840.803561:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.803564:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.803601:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0a43 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4d3 expref: 579 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803623:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a0a58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4d3 expref: 578 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.803632:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9b760562fc00) 00010000:00010000:2.0:1785774840.803635:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.803637:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8800, rc 0) 00000100:00100000:2.0:1785774840.805324:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+579:19337:x1872519648585856:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3754us (3976us total) trans 4294984005 rc 0/0 00000100:00100000:2.0:1785774840.805336:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23990 00000020:00080000:2.0:1785774840.805343:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.821214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.821410:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648586112 00000100:00100000:1.0:1785774840.821423:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648586112 00000100:00100000:1.0:1785774840.821494:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5216 00000100:00100000:1.0:1785774840.821505:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+579:19337:x1872519648586112:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774840.821853:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984006 00000100:00100000:1.0:1785774840.821972:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+581:19337:x1872519648586112:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 469us (814us total) trans 4294984007 rc 0/0 00000100:00100000:1.0:1785774840.821981:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5216 00000020:00080000:1.0:1785774840.821986:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.828323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.828410:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648586368 00000100:00100000:3.0:1785774840.828423:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648586368 00000100:00100000:3.0:1785774840.828509:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23991 00000100:00100000:3.0:1785774840.828521:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+581:19337:x1872519648586368:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.828552:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.828579:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0a66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4da expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.828722:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.828742:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.828756:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.828773:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.828780:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.828788:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774840.836035:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fd:0x0], index 1: 0 00010000:00010000:3.0:1785774840.836417:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0200/0x7b7109e1d0a0a7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836442:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0200/0x7b7109e1d0a0a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836469:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0200/0x7b7109e1d0a0a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774840.836583:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984008 00010000:00010000:3.0:1785774840.836627:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836640:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836647:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836654:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836660:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774840.836666:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836675:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836691:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774840.836694:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774840.836700:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836707:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0a6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774840.836725:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010a2898b reply state 000000008d7bd181 transno 4294984009 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836739:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836744:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9d08bd95 (ffff9b7731f8ad00) 00010000:00010000:3.0:1785774840.836747:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774840.836751:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774840.836810:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0a66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4da expref: 585 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836828:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0200/0x7b7109e1d0a0a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4da expref: 584 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.836837:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9b7731f8a800) 00010000:00010000:3.0:1785774840.836840:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774840.836842:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057b0200, rc 0) 00000100:00100000:3.0:1785774840.838499:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+585:19337:x1872519648586368:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 9971us (10179us total) trans 4294984009 rc 0/0 00000100:00100000:3.0:1785774840.838513:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23991 00000020:00080000:3.0:1785774840.838521:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774840.858952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.859211:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648586624 00000100:00100000:3.0:1785774840.859225:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648586624 00000100:00100000:3.0:1785774840.859307:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5217 00000100:00100000:3.0:1785774840.859318:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+585:19337:x1872519648586624:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.870201:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984010 00000100:00100000:0.0:1785774840.870391:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+587:19337:x1872519648586624:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 11064us (11445us total) trans 4294984011 rc 0/0 00000100:00100000:0.0:1785774840.870405:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5217 00000020:00080000:0.0:1785774840.870412:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.887473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.889587:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648586880 00000100:00100000:1.0:1785774840.889605:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648586880 00000100:00100000:1.0:1785774840.889691:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23992 00000100:00100000:1.0:1785774840.889703:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+587:19337:x1872519648586880:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774840.889739:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774840.889770:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0a89 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4e1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.889944:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.889963:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.889977:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.889994:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890002:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890008:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774840.890534:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fe:0x0], index 0: 0 00010000:00010000:1.0:1785774840.890729:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80e00/0x7b7109e1d0a0a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890739:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80e00/0x7b7109e1d0a0a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890748:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80e00/0x7b7109e1d0a0a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774840.890823:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984012 00010000:00010000:1.0:1785774840.890866:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890876:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890882:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890889:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890895:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774840.890900:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890909:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890924:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774840.890928:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774840.890934:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890941:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0a90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774840.890966:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003481fd06 reply state 0000000075db4f6b transno 4294984013 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890979:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.890986:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3615e895 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774840.890989:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774840.890992:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774840.891025:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0a89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4e1 expref: 591 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.891043:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80e00/0x7b7109e1d0a0a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4e1 expref: 590 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774840.891050:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774840.891052:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774840.891055:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7731f80e00, rc 0) 00000100:00100000:1.0:1785774840.891144:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+591:19337:x1872519648586880:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1443us (3695us total) trans 4294984013 rc 0/0 00000100:00100000:1.0:1785774840.891153:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23992 00000020:00080000:1.0:1785774840.891186:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.903599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.903681:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648587136 00000100:00100000:0.0:1785774840.903694:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648587136 00000100:00100000:0.0:1785774840.903758:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5218 00000100:00100000:0.0:1785774840.903770:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+591:19337:x1872519648587136:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.904119:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984014 00000100:00100000:0.0:1785774840.904281:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+593:19337:x1872519648587136:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 512us (695us total) trans 4294984015 rc 0/0 00000100:00100000:0.0:1785774840.904289:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5218 00000020:00080000:0.0:1785774840.904294:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.910547:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.911197:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648587392 00000100:00100000:3.0:1785774840.911210:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648587392 00000100:00100000:3.0:1785774840.911288:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23993 00000100:00100000:3.0:1785774840.911298:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+593:19337:x1872519648587392:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.911329:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.911356:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0aac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4e8 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.911510:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.911535:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.911548:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.911562:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.911568:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.911573:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774840.912013:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fe:0x0], index 1: 0 00010000:00010000:3.0:1785774840.912974:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1800/0x7b7109e1d0a0ac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.912988:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1800/0x7b7109e1d0a0ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.912997:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1800/0x7b7109e1d0a0ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774840.913063:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984016 00010000:00010000:3.0:1785774840.913100:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.913109:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.914820:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.914830:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.914837:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774840.914842:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.914851:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.914933:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774840.914937:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774840.914942:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.914949:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0ab3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774840.914968:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096f97931 reply state 000000002c51aa00 transno 4294984017 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.914994:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.915001:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3001f95 (ffff9b7731f8a100) 00010000:00010000:3.0:1785774840.915003:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774840.915006:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.915272:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0aac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4e8 expref: 597 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.915293:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1800/0x7b7109e1d0a0ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4e8 expref: 596 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.915302:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9b7731f8a200) 00010000:00010000:2.0:1785774840.915304:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.915307:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057b1800, rc 0) 00000100:00100000:2.0:1785774840.915407:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+597:19337:x1872519648587392:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4109us (4872us total) trans 4294984017 rc 0/0 00000100:00100000:2.0:1785774840.915417:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23993 00000020:00080000:2.0:1785774840.915424:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.939345:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.939561:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648587648 00000100:00100000:0.0:1785774840.939576:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648587648 00000100:00100000:0.0:1785774840.939674:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5219 00000100:00100000:0.0:1785774840.939688:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+597:19337:x1872519648587648:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:0.0:1785774840.940047:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984018 00000100:00100000:0.0:1785774840.940211:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+599:19337:x1872519648587648:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 525us (878us total) trans 4294984019 rc 0/0 00000100:00100000:0.0:1785774840.940220:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5219 00000020:00080000:0.0:1785774840.940226:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.947766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774840.951414:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648587904 00000100:00100000:3.0:1785774840.951432:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648587904 00000100:00100000:3.0:1785774840.951536:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23994 00000100:00100000:3.0:1785774840.951549:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+599:19337:x1872519648587904:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:3.0:1785774840.951582:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774840.951609:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0acf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4ef expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.951760:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.951776:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.951788:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.951816:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.951829:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.951834:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774840.952489:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ff:0x0], index 0: 0 00010000:00010000:3.0:1785774840.952744:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1000/0x7b7109e1d0a0ae4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.952755:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1000/0x7b7109e1d0a0ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.952765:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1000/0x7b7109e1d0a0ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774840.952833:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984020 00010000:00010000:3.0:1785774840.952980:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.952988:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.952993:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.952998:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.953004:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774840.953008:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.953014:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.953032:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774840.953035:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774840.953039:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.953046:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0ad6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774840.953062:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031be8795 reply state 000000004544fe13 transno 4294984021 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.953076:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.953083:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x35965a95 (ffff9b7731f8ac00) 00010000:00010000:3.0:1785774840.953086:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774840.953089:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774840.953973:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0acf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4ef expref: 603 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.953993:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1000/0x7b7109e1d0a0ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4ef expref: 602 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774840.954001:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9b7731f8a700) 00010000:00010000:3.0:1785774840.954003:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774840.954006:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057b1000, rc 0) 00000100:00100000:3.0:1785774840.954092:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+603:19337:x1872519648587904:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2546us (6340us total) trans 4294984021 rc 0/0 00000100:00100000:3.0:1785774840.954100:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23994 00000020:00080000:3.0:1785774840.954105:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774840.978039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774840.978326:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648588160 00000100:00100000:1.0:1785774840.978339:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648588160 00000100:00100000:1.0:1785774840.978417:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5220 00000100:00100000:1.0:1785774840.978430:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+603:19337:x1872519648588160:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774840.978835:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984022 00000100:00100000:1.0:1785774840.978961:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+605:19337:x1872519648588160:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 532us (934us total) trans 4294984023 rc 0/0 00000100:00100000:1.0:1785774840.978970:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5220 00000020:00080000:1.0:1785774840.978976:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774840.986727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774840.993857:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648588416 00000100:00100000:0.0:1785774840.993877:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648588416 00000100:00100000:0.0:1785774840.993966:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23995 00000100:00100000:0.0:1785774840.993977:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+605:19337:x1872519648588416:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774840.994010:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774840.994038:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0af2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4f6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.995660:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.995692:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.995706:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.995727:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.995735:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.995742:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774840.996548:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774840.996572:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671304064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774840.996589:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671304192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774840.997292:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671304576:0@lo:400:kworker.0 00000004:00080000:2.0:1785774840.997432:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ff:0x0], index 1: 0 00010000:00010000:2.0:1785774840.997670:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a0b07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997685:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a0b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997697:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a0b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774840.997775:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984024 00010000:00010000:2.0:1785774840.997824:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997832:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997840:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997847:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997852:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774840.997857:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997865:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997878:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774840.997881:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774840.997887:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997893:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0af9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774840.997910:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070e38be0 reply state 0000000027b35c5e transno 4294984025 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997921:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997928:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x74956995 (ffff9b760562f500) 00010000:00010000:2.0:1785774840.997930:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774840.997933:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774840.997970:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0af2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4f6 expref: 609 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997987:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a0b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4f6 expref: 608 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774840.997995:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9b7605fcb600) 00010000:00010000:2.0:1785774840.997997:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774840.998000:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9400, rc 0) 00000100:00100000:1.0:1785774841.008349:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009258:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671304704:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.009310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009340:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671305216:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.009367:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009386:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671305728:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.009408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009438:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1785774841.009445:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671304320:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.009486:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009512:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671304832:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.009532:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009550:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671305344:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.009569:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009584:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671305856:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.009603:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.009648:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304192 00000100:00100000:1.0:1785774841.010272:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304192 00000100:00100000:1.0:1785774841.010332:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304832 00000100:00100000:1.0:1785774841.010335:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304832 00000100:00100000:1.0:1785774841.010357:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1785774841.010366:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671304192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774841.010414:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774841.010527:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671304192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.010535:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1785774841.010554:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1785774841.010560:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671304832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.010591:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671304832:12345-0@lo:400:kworker.0 Request processed in 31us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.010598:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1785774841.010618:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305216 00000100:00100000:1.0:1785774841.010621:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305216 00000100:00100000:1.0:1785774841.011852:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305728 00000100:00100000:1.0:1785774841.011859:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305728 00000100:00100000:1.0:1785774841.011894:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305344 00000100:00100000:1.0:1785774841.011896:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305344 00000100:00100000:1.0:1785774841.011913:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305856 00000100:00100000:1.0:1785774841.011915:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305856 00000100:00100000:1.0:1785774841.011938:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1785774841.011946:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671305216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.011998:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671305216:12345-0@lo:400:kworker.0 Request processed in 53us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.012004:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1785774841.012016:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1785774841.012021:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671305728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.012043:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671305728:12345-0@lo:400:kworker.0 Request processed in 23us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.012048:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1785774841.012057:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1785774841.012062:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3655:x1872519671305344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.012085:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3655:x1872519671305344:12345-0@lo:400:kworker.0 Request processed in 24us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.012091:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1785774841.012098:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1785774841.012103:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3655:x1872519671305856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.012124:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3655:x1872519671305856:12345-0@lo:400:kworker.0 Request processed in 21us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.012130:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1785774841.012151:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304320 00000100:00100000:1.0:1785774841.012155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304320 00000100:00100000:1.0:1785774841.014294:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1785774841.014317:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671304320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.014396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671304320:12345-0@lo:400:kworker.0 Request processed in 91us (4909us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.014404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00080000:1.0:1785774841.016924:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774841.016936:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774841.017017:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671304320:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.017039:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671304832:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.017058:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671305344:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.017072:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671305856:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.017089:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671305216:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.017101:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671305728:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.017127:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671304192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774841.021356:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774841.026111:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304064 00000100:00100000:3.0:1785774841.026137:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304064 00000100:00100000:3.0:1785774841.026230:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1785774841.026241:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671304064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1785774841.026274:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774841.026343:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671304064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (4996us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774841.026350:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1785774841.026496:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671304064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774841.026528:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671304448:0@lo:400:kworker.0 00000100:00100000:3.0:1785774841.026565:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774841.026583:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671304960:0@lo:400:kworker.0 00000100:00100000:3.0:1785774841.026604:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774841.026623:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671305472:0@lo:400:kworker.0 00000100:00100000:3.0:1785774841.026640:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.029192:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304704 00000100:00100000:1.0:1785774841.029208:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304704 00000100:00100000:1.0:1785774841.029253:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304448 00000100:00100000:1.0:1785774841.029256:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304448 00000100:00100000:1.0:1785774841.029268:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304960 00000100:00100000:1.0:1785774841.029271:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304960 00000100:00080000:1.0:1785774841.029298:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774841.029314:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305472 00000100:00100000:1.0:1785774841.029317:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305472 00000100:00080000:1.0:1785774841.029330:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774841.029347:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1785774841.029356:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671304704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.029460:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671304704:12345-0@lo:400:kworker.0 Request processed in 92us (20136us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.029468:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1785774841.029512:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671304704:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.029544:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:1.0:1785774841.029550:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671304448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774841.029984:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774841.030016:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671304576 00000100:00100000:0.0:1785774841.030020:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671304576 00000100:00100000:0.0:1785774841.030049:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:0.0:1785774841.030055:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671304576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774841.030085:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671304576:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774841.030090:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:0.0:1785774841.030128:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671304576:0@lo:400:kworker.0 00000100:00100000:0.0:1785774841.030138:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671305088:0@lo:400:kworker.0 00000100:00100000:0.0:1785774841.030175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774841.030187:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671305600:0@lo:400:kworker.0 00000100:00100000:0.0:1785774841.030211:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774841.030301:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305088 00000100:00100000:0.0:1785774841.030305:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305088 00000100:00100000:0.0:1785774841.030333:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305600 00000100:00100000:0.0:1785774841.030337:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305600 00000100:00100000:0.0:1785774841.030349:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1785774841.030355:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671304960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774841.033582:0:6531:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1785774841.033605:0:6531:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:2.0:1785774841.033833:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1785774841.033850:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671305472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.034023:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671304448:12345-0@lo:400:kworker.0 Request processed in 4469us (7454us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.034034:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:1.0:1785774841.034067:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774841.034079:0:8627:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1785774841.034086:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1785774841.034093:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671305088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.034136:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671305088:12345-0@lo:400:kworker.0 Request processed in 44us (3959us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.034142:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1785774841.034156:0:8627:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1785774841.034180:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1785774841.034187:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671305600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.034218:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671305600:12345-0@lo:400:kworker.0 Request processed in 31us (4006us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.034224:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1785774841.035613:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671305088:0@lo:400:kworker.0 00000100:00100000:1.0:1785774841.035629:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671305600:0@lo:400:kworker.0 00000100:00100000:0.0:1785774841.047747:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671304960:12345-0@lo:400:kworker.0 Request processed in 17378us (21128us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774841.047765:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1785774841.052618:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671305472:12345-0@lo:400:kworker.0 Request processed in 18761us (25963us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774841.052636:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1785774841.054906:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+609:19337:x1872519648588416:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 60921us (68183us total) trans 4294984025 rc 0/0 00000100:00100000:2.0:1785774841.054918:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23995 00000020:00080000:2.0:1785774841.054924:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774841.056175:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671304448:0@lo:400:kworker.0 00000100:00100000:3.0:1785774841.056204:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671304960:0@lo:400:kworker.0 00000100:00100000:3.0:1785774841.056217:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671305472:0@lo:400:kworker.0 00000100:00100000:2.0:1785774841.072108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.072308:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648588672 00000100:00100000:1.0:1785774841.072319:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648588672 00000100:00100000:1.0:1785774841.072393:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5221 00000100:00100000:1.0:1785774841.072405:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+609:19337:x1872519648588672:12345-192.168.202.31@tcp:35:createmany.0 00000001:00080000:1.0:1785774841.072775:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984026 00000100:00100000:1.0:1785774841.072913:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+611:19337:x1872519648588672:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 508us (819us total) trans 4294984027 rc 0/0 00000100:00100000:1.0:1785774841.072921:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5221 00000020:00080000:1.0:1785774841.072927:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774841.153341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.153534:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648588928 00000100:00100000:2.0:1785774841.153547:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648588928 00000100:00100000:2.0:1785774841.153624:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23996 00000100:00100000:2.0:1785774841.153635:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+611:19339:x1872519648588928:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.153708:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.153746:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d09fd62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c23a expref: 611 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153775:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9b7709388000) 00010000:00010000:2.0:1785774841.153789:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.153847:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153863:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153875:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153887:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153895:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153902:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153982:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153990:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.153997:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.154643:0:8627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785774841.154675:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1785774841.154856:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000004:00080000:2.0:1785774841.154867:0:8627:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1083005705997ns, next at 1084005702928ns, rc = 0 00010000:00010000:2.0:1785774841.154960:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.154970:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.154979:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.154987:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.154994:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155001:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.155517:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.155530:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.155539:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.155545:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.155556:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.155570:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9b7731f88600) 00010000:00010000:0.0:1785774841.155574:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.155578:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.155588:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.155590:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.155592:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.155616:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785774841.155636:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b2a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155696:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155704:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155711:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155718:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.155724:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155732:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155747:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9b7731f88600) 00010000:00010000:2.0:1785774841.155750:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.155754:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155761:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b23 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155790:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155796:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155811:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155817:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155822:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.155826:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.155832:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.156946:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.156949:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.156963:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.156970:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.156985:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d8af99b reply state 00000000fe28d80f transno 4294984028 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.156997:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.157005:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b93e778 (ffff9b7709388e00) 00010000:00010000:2.0:1785774841.157007:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.157010:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.157115:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+612:19339:x1872519648588928:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 3478us (3786us total) trans 4294984028 rc 0/0 00000100:00100000:2.0:1785774841.157124:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23996 00000100:00100000:3.0:1785774841.169389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.169556:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648589184 00000100:00100000:0.0:1785774841.169567:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648589184 00000100:00100000:0.0:1785774841.169629:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23997 00000100:00100000:0.0:1785774841.169640:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+612:19339:x1872519648589184:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.169700:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.169726:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d09fda1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c248 expref: 612 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169744:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9b7709388600) 00010000:00010000:0.0:1785774841.169753:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.169775:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169791:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169813:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169827:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169835:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169842:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169905:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169912:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.169918:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.170238:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2503, 64 off168384 00000004:00080000:0.0:1785774841.170248:0:8469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1083021087057ns, next at 1084021085018ns, rc = 0 00010000:00010000:0.0:1785774841.170321:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170330:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170338:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170345:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170357:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170363:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170379:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.170395:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170402:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170408:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170414:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.170419:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170425:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170434:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9b7602508000) 00010000:00010000:0.0:1785774841.170437:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.170449:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170456:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1000/0x7b7109e1d0a0b3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170477:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170483:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170490:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170495:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170500:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.170503:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170509:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170516:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.170517:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.170520:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170525:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb000/0x7b7109e1d0a0b31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.170534:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d63cc871 reply state 0000000041c1189f transno 4294984029 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170546:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.170552:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x53a9537d (ffff9b7709388400) 00010000:00010000:0.0:1785774841.170554:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.170557:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.170622:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+613:19339:x1872519648589184:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 983us (1241us total) trans 4294984029 rc 0/0 00000100:00100000:0.0:1785774841.170630:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23997 00010000:00010000:1.0:1785774841.171720:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.171734:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.171746:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.171750:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.171761:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.171777:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9b7602508000) 00010000:00010000:1.0:1785774841.171779:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.171783:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.171790:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0b46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.171821:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.171823:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.171825:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.181355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.181439:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648589440 00000100:00100000:2.0:1785774841.181459:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648589440 00000100:00100000:2.0:1785774841.181517:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23998 00000100:00100000:2.0:1785774841.181526:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+613:19339:x1872519648589440:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.181586:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.181612:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d09fdc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c24f expref: 613 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181637:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9b7709388300) 00010000:00010000:2.0:1785774841.181647:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.181667:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181680:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181689:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181700:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181707:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181713:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181773:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181780:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.181787:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.182008:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 64 off8320 00010000:00010000:2.0:1785774841.182069:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182078:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182085:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182093:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182099:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182106:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182129:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.182145:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182152:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182201:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182208:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.182213:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182220:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182229:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9b7731f88600) 00010000:00010000:2.0:1785774841.182232:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.182235:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182242:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0b5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182255:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182261:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182267:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182273:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.182275:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182280:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182287:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.182289:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.182292:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182298:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0b4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.182310:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046ebdd9d reply state 000000001e258fbd transno 4294984030 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182320:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.182326:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x756ed0d2 (ffff9b7709388500) 00010000:00010000:2.0:1785774841.182329:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.182331:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.182388:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+614:19339:x1872519648589440:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 863us (1041us total) trans 4294984030 rc 0/0 00000100:00100000:2.0:1785774841.182396:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23998 00010000:00010000:3.0:1785774841.182508:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.182515:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.182522:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.182525:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.182532:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.182541:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9b7731f88600) 00010000:00010000:3.0:1785774841.182544:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.182547:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.182553:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0b62 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.182564:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.182566:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.182567:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.206634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.206764:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648589696 00000100:00100000:1.0:1785774841.206775:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648589696 00000100:00100000:1.0:1785774841.206850:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23999 00000100:00100000:1.0:1785774841.206860:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+614:19339:x1872519648589696:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774841.206923:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774841.206949:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d09fde7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c256 expref: 614 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.206968:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:1.0:1785774841.206979:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774841.207000:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207013:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207023:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207034:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207040:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207047:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207103:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207110:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207117:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774841.207384:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2504, 64 off168448 00010000:00010000:1.0:1785774841.207455:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207464:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207472:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207480:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207487:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207493:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.207517:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.207537:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.207546:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207555:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731f81400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.207560:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207569:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207579:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:0.0:1785774841.207583:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.207586:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207592:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81400/0x7b7109e1d0a0b7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207610:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.207612:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.207614:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.207627:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207638:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207644:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207649:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731f80800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.207652:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207658:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207665:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:0.0:1785774841.207668:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.207671:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207677:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80800/0x7b7109e1d0a0b77 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207696:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207701:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207707:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207712:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207717:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731f80200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.207720:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207725:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207732:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.207734:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.207738:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207744:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80200/0x7b7109e1d0a0b69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.207754:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035a18cf7 reply state 00000000b4d7c960 transno 4294984031 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207766:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.207773:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd3ce983f (ffff9b7605dfe600) 00010000:00010000:0.0:1785774841.207776:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.207779:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.207864:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+615:19339:x1872519648589696:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1004us (1240us total) trans 4294984031 rc 0/0 00000100:00100000:0.0:1785774841.207872:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23999 00000100:00100000:3.0:1785774841.225591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.225698:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648589952 00000100:00100000:0.0:1785774841.225710:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648589952 00000100:00100000:0.0:1785774841.225779:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24000 00000100:00100000:0.0:1785774841.225789:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+615:19339:x1872519648589952:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.225858:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.225887:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d09fe0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c25d expref: 615 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.225911:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9b7605dfea00) 00010000:00010000:0.0:1785774841.225923:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.225950:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.225964:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.225975:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.225986:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.225994:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226000:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226063:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226071:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226082:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.226356:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 64 off8384 00010000:00010000:0.0:1785774841.226419:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226429:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226437:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226444:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226451:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226457:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226471:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.226487:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226493:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226500:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226510:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.226515:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226522:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226532:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.226535:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.226539:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226545:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0b93 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226561:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226567:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226574:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226580:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226584:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.226587:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226598:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226604:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.226607:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.226610:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226617:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0b85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.226625:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fab32ccd reply state 000000003b9991ca transno 4294984032 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226635:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.226641:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdb9e9594 (ffff9b7709388700) 00010000:00010000:0.0:1785774841.226643:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.226646:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.226713:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+616:19339:x1872519648589952:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 925us (1133us total) trans 4294984032 rc 0/0 00000100:00100000:0.0:1785774841.226721:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24000 00010000:00010000:1.0:1785774841.227017:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.227026:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.227033:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.227036:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.227043:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.227058:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9b7602508100) 00010000:00010000:1.0:1785774841.227060:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.227063:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.227069:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0b9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.227082:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.227084:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.227085:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.250761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.250861:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648590208 00000100:00100000:2.0:1785774841.250871:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648590208 00000100:00100000:2.0:1785774841.250933:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24001 00000100:00100000:2.0:1785774841.250942:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+616:19339:x1872519648590208:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.250999:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.251025:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d09fe2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c264 expref: 616 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251048:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9b7706383d00) 00010000:00010000:2.0:1785774841.251060:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.251081:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251094:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251108:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251118:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251125:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251131:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251235:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251243:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251249:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.251642:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2505, 64 off168512 00010000:00010000:2.0:1785774841.251709:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251719:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251727:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251734:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251741:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251748:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251769:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.251786:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251792:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251808:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251815:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.251819:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251827:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251835:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9b7731f88400) 00010000:00010000:2.0:1785774841.251837:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.251841:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251847:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0baf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251867:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251873:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251879:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251884:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.251887:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251892:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251898:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.251900:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.251903:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251909:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0ba1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.251917:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002cb6f3e0 reply state 0000000073dd7812 transno 4294984033 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251928:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.251934:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe663f479 (ffff9b7706383400) 00010000:00010000:2.0:1785774841.251936:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.251939:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.252051:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+617:19339:x1872519648590208:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1109us (1297us total) trans 4294984033 rc 0/0 00000100:00100000:2.0:1785774841.252059:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24001 00010000:00010000:1.0:1785774841.252112:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.252119:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.252126:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.252129:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.252136:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.252144:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9b7731f88400) 00010000:00010000:1.0:1785774841.252147:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.252150:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.252155:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bb6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.252197:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.252199:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.252201:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.266144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.266254:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648590464 00000100:00100000:2.0:1785774841.266264:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648590464 00000100:00100000:2.0:1785774841.266324:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24002 00000100:00100000:2.0:1785774841.266333:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+617:19339:x1872519648590464:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.266407:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.266432:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d09fe50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c26b expref: 617 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266460:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9b7605dfe800) 00010000:00010000:2.0:1785774841.266469:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.266490:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266503:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266513:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266524:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266532:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266543:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266597:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266603:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.266610:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.267135:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 64 off8448 00010000:00010000:2.0:1785774841.267427:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267438:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267457:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267465:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267472:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267478:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267496:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.267513:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267520:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267526:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267532:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.267536:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267544:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267553:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9b7731f88900) 00010000:00010000:2.0:1785774841.267556:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.267560:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267566:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bcb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267583:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267589:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267594:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267605:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267609:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.267612:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267618:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267625:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.267627:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.267630:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267635:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.267645:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008bca48af reply state 0000000079d3e61b transno 4294984034 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267655:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.267670:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf8b3f1ce (ffff9b7605dfe100) 00010000:00010000:2.0:1785774841.267673:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.267676:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.267978:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+618:19339:x1872519648590464:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1645us (1840us total) trans 4294984034 rc 0/0 00000100:00100000:2.0:1785774841.267988:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24002 00010000:00010000:3.0:1785774841.270521:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.270534:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.270545:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.270549:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.270559:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.270575:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9b7731f88900) 00010000:00010000:3.0:1785774841.270577:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.270581:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.270587:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0bd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.270615:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.270617:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.270619:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.285651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.285758:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648590720 00000100:00100000:2.0:1785774841.285767:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648590720 00000100:00100000:2.0:1785774841.285841:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24003 00000100:00100000:2.0:1785774841.285851:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+618:19339:x1872519648590720:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.285909:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.285937:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d09fe73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c272 expref: 618 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.285958:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9b77199f5600) 00010000:00010000:2.0:1785774841.285967:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.285990:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286003:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286012:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286023:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286030:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286037:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286096:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286107:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286114:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.286385:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2506, 64 off168576 00010000:00010000:2.0:1785774841.286467:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286476:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286484:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286491:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286506:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286513:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286532:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.286549:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286555:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286567:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286573:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.286577:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286584:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286592:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:2.0:1785774841.286595:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.286598:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286604:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0be7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286620:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286626:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286631:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286637:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286642:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.286645:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286651:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286658:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.286660:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.286662:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286668:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0bd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.286677:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041f586dd reply state 000000009c8275f1 transno 4294984035 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286687:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.286693:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d12be7b (ffff9b7605dfeb00) 00010000:00010000:2.0:1785774841.286695:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.286707:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.286794:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+619:19339:x1872519648590720:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 943us (1151us total) trans 4294984035 rc 0/0 00000100:00100000:2.0:1785774841.286816:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24003 00010000:00010000:3.0:1785774841.287520:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.287528:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.287535:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.287539:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.287547:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.287557:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:3.0:1785774841.287560:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.287563:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.287570:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.287585:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.287587:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.287589:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.298140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.298331:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648590976 00000100:00100000:2.0:1785774841.298341:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648590976 00000100:00100000:2.0:1785774841.298396:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24004 00000100:00100000:2.0:1785774841.298405:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+619:19339:x1872519648590976:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.298468:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.298495:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d09fe96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c279 expref: 619 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298518:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9b7706383200) 00010000:00010000:2.0:1785774841.298528:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.298554:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298568:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298579:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298590:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298597:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298604:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298656:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298809:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.298818:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.299020:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 64 off8512 00010000:00010000:2.0:1785774841.299077:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299086:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299094:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299101:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299108:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299115:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299212:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.299230:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299236:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299243:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299248:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.299252:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299259:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299268:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9b7731f88c00) 00010000:00010000:2.0:1785774841.299271:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.299274:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299280:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c03 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299294:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299300:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299306:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299321:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299326:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.299329:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299334:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299341:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.299344:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.299346:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299357:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0bf5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.299366:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ab0331d reply state 00000000b1c5c150 transno 4294984036 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299376:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.299383:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6e2bbd0 (ffff9b7706383600) 00010000:00010000:2.0:1785774841.299385:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.299388:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.299453:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+620:19339:x1872519648590976:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1048us (1321us total) trans 4294984036 rc 0/0 00000100:00100000:2.0:1785774841.299460:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24004 00010000:00010000:1.0:1785774841.301065:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.301079:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.301089:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.301094:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.301103:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.301119:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9b7731f88c00) 00010000:00010000:1.0:1785774841.301122:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.301126:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.301132:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c0a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.301151:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.301153:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.301155:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.310117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.310210:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648591232 00000100:00100000:0.0:1785774841.310225:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648591232 00000100:00100000:0.0:1785774841.310288:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24005 00000100:00100000:0.0:1785774841.310298:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+620:19339:x1872519648591232:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.310384:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.310408:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d09feb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c280 expref: 620 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310431:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9b7706383500) 00010000:00010000:0.0:1785774841.310440:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.310472:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310487:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310590:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310605:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310613:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310620:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310692:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310700:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310707:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.310925:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2507, 64 off168640 00010000:00010000:0.0:1785774841.310987:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.310996:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311004:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311011:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311017:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311024:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311047:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.311062:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311067:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311074:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311080:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.311084:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311092:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311100:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.311104:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.311107:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311112:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c1f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311127:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311134:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311139:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311145:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.311150:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.311153:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.311399:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.311406:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.311412:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.311416:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.311423:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.311432:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9b7602508100) 00010000:00010000:1.0:1785774841.311435:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.311438:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.311452:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0c26 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.311465:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.311467:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.311469:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.315380:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.316014:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.316018:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.316025:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.316033:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.316051:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a768f6e reply state 00000000ebfe0993 transno 4294984037 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.316064:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.316072:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x40eea295 (ffff9b7706383700) 00010000:00010000:0.0:1785774841.316074:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.316078:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.317125:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+621:19339:x1872519648591232:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 6818us (7008us total) trans 4294984037 rc 0/0 00000100:00100000:0.0:1785774841.317139:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24005 00000100:00100000:0.0:1785774841.331761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.331865:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648591488 00000100:00100000:2.0:1785774841.331874:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648591488 00000100:00100000:2.0:1785774841.331940:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24006 00000100:00100000:2.0:1785774841.331950:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+621:19339:x1872519648591488:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.332007:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.332031:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d09fedc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c287 expref: 621 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332054:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9b7605fccb00) 00010000:00010000:2.0:1785774841.332066:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.332097:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332115:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332123:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332134:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332142:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332149:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332242:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332251:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332257:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.332728:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 64 off8576 00010000:00010000:2.0:1785774841.332789:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332809:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332817:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332825:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332832:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332838:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332857:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.332876:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332883:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332890:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.332896:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.332996:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333006:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333015:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9b7731f88500) 00010000:00010000:2.0:1785774841.333018:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.333021:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333032:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333046:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333053:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333059:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333064:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333069:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.333071:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.333152:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.333175:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.333182:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.333186:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.333192:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.333201:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9b7731f88500) 00010000:00010000:3.0:1785774841.333204:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.333206:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.333212:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c42 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.333225:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.333227:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.333228:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.333302:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333310:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.333313:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.333315:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333322:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.333331:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000602759ed reply state 000000002b0cf4d7 transno 4294984038 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333343:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.333349:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea16437d (ffff9b7706383100) 00010000:00010000:2.0:1785774841.333351:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.333354:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.333462:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+622:19339:x1872519648591488:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1512us (1708us total) trans 4294984038 rc 0/0 00000100:00100000:2.0:1785774841.333470:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24006 00000100:00100000:1.0:1785774841.346291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.346382:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648591744 00000100:00100000:0.0:1785774841.346393:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648591744 00000100:00100000:0.0:1785774841.346456:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24007 00000100:00100000:0.0:1785774841.346465:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+622:19339:x1872519648591744:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.346519:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.346545:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d09feff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c28e expref: 622 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346564:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:0.0:1785774841.346574:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.346594:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346607:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346617:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346627:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346634:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346640:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346706:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346714:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.346720:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.347283:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2508, 64 off168704 00010000:00010000:0.0:1785774841.347347:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347356:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347365:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347372:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347379:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347386:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347406:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.347422:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347428:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347435:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347441:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.347452:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347461:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347469:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9b7602508000) 00010000:00010000:0.0:1785774841.347471:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.347475:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347481:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0c57 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347494:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347500:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347506:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347511:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.347514:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347520:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347527:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.347529:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.347531:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347537:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0c49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.347545:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009cb4abbd reply state 00000000225646f2 transno 4294984039 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347560:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.347566:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9897527d (ffff9b77199f5d00) 00010000:00010000:0.0:1785774841.347568:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.347571:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.347644:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+623:19339:x1872519648591744:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1179us (1361us total) trans 4294984039 rc 0/0 00000100:00100000:0.0:1785774841.347651:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24007 00010000:00010000:3.0:1785774841.347718:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.347724:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.347731:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.347735:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.347741:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.347750:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9b7602508000) 00010000:00010000:3.0:1785774841.347752:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.347755:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.347765:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0c5e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.347777:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.347779:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.347781:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.351971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.352057:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648592000 00000100:00100000:2.0:1785774841.352068:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648592000 00000100:00100000:2.0:1785774841.352295:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24008 00000100:00100000:2.0:1785774841.352305:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+623:19339:x1872519648592000:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.352357:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.352382:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d09ff22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c295 expref: 623 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352400:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9b7605dfe500) 00010000:00010000:2.0:1785774841.352409:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.352429:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352442:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352463:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352479:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352487:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352493:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352548:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352555:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352562:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.352765:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].7, 64 off8640 00010000:00010000:2.0:1785774841.352834:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352843:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352851:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352858:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352865:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352872:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352892:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.352914:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352920:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352926:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352931:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.352935:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352943:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352951:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9b7731f88300) 00010000:00010000:2.0:1785774841.352954:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.352958:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352963:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c73 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352979:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352989:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.352995:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.353001:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.353005:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.353008:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.353014:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.353020:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.353022:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.353025:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.353032:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.353039:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c2db8f9 reply state 000000004b13d2b6 transno 4294984040 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.353049:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.353055:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe423257d (ffff9b7605dfe000) 00010000:00010000:2.0:1785774841.353058:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.353060:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.353137:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+624:19339:x1872519648592000:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 833us (1174us total) trans 4294984040 rc 0/0 00000100:00100000:2.0:1785774841.353144:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24008 00010000:00010000:1.0:1785774841.353453:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.353460:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.353466:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.353470:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.353477:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.353485:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9b7731f88300) 00010000:00010000:1.0:1785774841.353488:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.353491:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.353497:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c7a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.353508:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.353510:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.353512:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.367274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774841.368642:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648592256 00000100:00100000:3.0:1785774841.368657:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648592256 00000100:00100000:2.0:1785774841.369117:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24009 00000100:00100000:2.0:1785774841.369127:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+624:19339:x1872519648592256:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.369209:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.369235:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d09ff45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c29c expref: 624 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369254:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:2.0:1785774841.369264:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.369287:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369300:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369309:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369319:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369327:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369333:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369387:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369396:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.369402:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.369852:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2509, 64 off168768 00010000:00010000:2.0:1785774841.370137:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370149:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370368:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370378:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370384:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370391:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370412:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.370432:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370444:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370459:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370465:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.370470:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370478:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370488:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:2.0:1785774841.370491:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.370495:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370502:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a0c8f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370518:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370524:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370530:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370535:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370541:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.370544:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370551:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370557:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.370559:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.370562:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370567:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a0c81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.370575:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ac52a5a reply state 00000000b62a39ab transno 4294984041 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370585:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.370592:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x970cb47d (ffff9b77199f5400) 00010000:00010000:2.0:1785774841.370594:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.370597:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.370690:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+625:19339:x1872519648592256:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1563us (3422us total) trans 4294984041 rc 0/0 00000100:00100000:2.0:1785774841.370698:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24009 00010000:00010000:3.0:1785774841.370769:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.370776:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.370782:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.370786:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.370793:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.370813:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:3.0:1785774841.370816:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.370819:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.370826:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a0c96 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.370840:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.370842:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.370844:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.377119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.377233:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648592512 00000100:00100000:2.0:1785774841.377243:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648592512 00000100:00100000:2.0:1785774841.377290:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24010 00000100:00100000:2.0:1785774841.377299:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+625:19339:x1872519648592512:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.377350:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.377375:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d09ff68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2a3 expref: 625 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377396:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9b7605dfe300) 00010000:00010000:2.0:1785774841.377406:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.377428:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377442:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377462:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377473:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377480:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377486:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377563:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377571:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377582:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.377787:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].8, 64 off8704 00010000:00010000:2.0:1785774841.377858:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377867:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377874:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377882:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377888:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377894:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377916:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.377933:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377939:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377945:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377956:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.377959:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377966:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377975:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9b7731f88b00) 00010000:00010000:2.0:1785774841.377977:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.377981:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.377987:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378004:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378009:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378015:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378021:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378025:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.378028:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378038:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378045:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.378047:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.378049:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378055:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a0c9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.378064:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000300aa61 reply state 000000004d7abf32 transno 4294984042 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378074:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.378080:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5239df7d (ffff9b7605dfec00) 00010000:00010000:2.0:1785774841.378082:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.378085:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.378149:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+626:19339:x1872519648592512:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 851us (1038us total) trans 4294984042 rc 0/0 00000100:00100000:2.0:1785774841.378156:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24010 00010000:00010000:3.0:1785774841.378431:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.378439:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.378445:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.378449:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.378456:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.378465:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9b7731f88b00) 00010000:00010000:3.0:1785774841.378467:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.378470:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.378476:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0cb2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.378489:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.378491:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.378493:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.391932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774841.392059:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648592768 00000100:00100000:3.0:1785774841.392069:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648592768 00000100:00100000:3.0:1785774841.392129:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24011 00000100:00100000:3.0:1785774841.392138:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+626:19339:x1872519648592768:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774841.392249:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774841.392275:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d09ff8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2aa expref: 626 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392297:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9b7706383f00) 00010000:00010000:3.0:1785774841.392309:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774841.392329:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392342:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392352:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392363:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392370:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392376:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392431:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392439:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.392445:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.393434:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2510, 64 off168832 00010000:00010000:2.0:1785774841.393511:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393521:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393535:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393543:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393549:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393556:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393576:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.393594:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393600:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393606:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393613:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.393616:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393624:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393632:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9b7731f8a400) 00010000:00010000:2.0:1785774841.393635:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.393639:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393645:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0cc7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393669:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393675:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393681:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393687:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393692:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.393695:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393701:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393709:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.393710:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.393850:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393859:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0cb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.393870:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ea56744 reply state 00000000dd858232 transno 4294984043 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393882:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.393888:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa5436e7d (ffff9b7605dfef00) 00010000:00010000:2.0:1785774841.393890:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.393893:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.394017:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+627:19339:x1872519648592768:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1879us (2094us total) trans 4294984043 rc 0/0 00000100:00100000:2.0:1785774841.394025:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24011 00010000:00010000:3.0:1785774841.394094:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.394100:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.394107:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.394110:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.394117:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.394126:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9b7731f8a400) 00010000:00010000:3.0:1785774841.394128:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.394131:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.394137:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0cce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.394152:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.394153:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.394155:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.402142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.402970:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648593024 00000100:00100000:0.0:1785774841.402980:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648593024 00000100:00100000:0.0:1785774841.403155:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24012 00000100:00100000:0.0:1785774841.403253:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+627:19339:x1872519648593024:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.403307:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.403331:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d09ffae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2b1 expref: 627 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403353:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9b77199f5100) 00010000:00010000:0.0:1785774841.403364:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.403385:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403399:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403408:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403419:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403427:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403433:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403548:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403557:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.403564:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.404842:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].9, 64 off8768 00010000:00010000:0.0:1785774841.405387:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405402:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405413:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405422:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405429:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405436:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405593:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.405618:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405625:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405631:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405638:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.405642:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405650:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405670:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9b7602508000) 00010000:00010000:0.0:1785774841.405673:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.405676:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405683:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0ce3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405703:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405720:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405727:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405733:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405738:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.405741:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405746:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405754:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.405757:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.405760:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405767:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0cd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.405776:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5e2b2b3 reply state 00000000be008d97 transno 4294984044 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405788:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.405794:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xead1417d (ffff9b7706383a00) 00010000:00010000:0.0:1785774841.405805:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.405809:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.405925:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+628:19339:x1872519648593024:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2731us (3892us total) trans 4294984044 rc 0/0 00000100:00100000:0.0:1785774841.405937:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24012 00010000:00010000:1.0:1785774841.415420:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.415436:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.415457:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.415461:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.415473:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.415490:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9b7602508000) 00010000:00010000:1.0:1785774841.415494:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.415498:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.415505:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0cea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.415528:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.415530:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.415532:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.416793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.416891:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648593280 00000100:00100000:2.0:1785774841.416949:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648593280 00000100:00100000:2.0:1785774841.417046:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24013 00000100:00100000:2.0:1785774841.417057:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+628:19339:x1872519648593280:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.417297:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.417319:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d09ffd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2b8 expref: 628 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417337:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9b7706383800) 00010000:00010000:2.0:1785774841.417346:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.417366:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417378:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417387:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417401:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417408:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417415:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417526:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417534:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.417541:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.417849:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2511, 64 off168896 00010000:00010000:2.0:1785774841.418307:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418317:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418326:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418333:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418341:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418348:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418401:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.418421:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418428:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418433:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418440:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.418444:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418460:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418469:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9b7731f88f00) 00010000:00010000:2.0:1785774841.418471:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.418475:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418481:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0cff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418500:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418511:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418517:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418523:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418527:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.418530:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418536:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418542:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.418544:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.418547:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418554:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0cf1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.418562:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e03f75fb reply state 000000005072f79a transno 4294984045 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418572:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.418578:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d30507d (ffff9b7706383900) 00010000:00010000:2.0:1785774841.418581:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.418584:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.418656:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+629:19339:x1872519648593280:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1601us (1870us total) trans 4294984045 rc 0/0 00000100:00100000:2.0:1785774841.418671:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24013 00010000:00010000:3.0:1785774841.423720:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.423736:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.423748:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.423753:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.423764:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.423782:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9b7731f88f00) 00010000:00010000:3.0:1785774841.423785:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.423789:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.423809:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0d06 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.423831:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.423833:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.423835:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.425365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.425615:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648593536 00000100:00100000:2.0:1785774841.425626:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648593536 00000100:00100000:2.0:1785774841.425674:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24014 00000100:00100000:2.0:1785774841.425683:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+629:19339:x1872519648593536:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.425775:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.425812:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d09fff4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2bf expref: 629 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.425832:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9b7605dfe700) 00010000:00010000:2.0:1785774841.425842:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.425869:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.425884:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426373:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426387:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426395:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426406:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426472:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426479:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426487:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.426678:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].10, 64 off8832 00010000:00010000:2.0:1785774841.426739:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426758:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426767:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426774:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426781:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426788:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426811:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.426830:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426836:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426842:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426849:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.426853:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426860:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426869:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9b7731f88200) 00010000:00010000:2.0:1785774841.426872:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.426875:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426882:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0d1b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426899:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426906:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426911:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426921:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426926:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.426929:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426934:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426941:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.426944:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.426947:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426953:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0d0d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.426962:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053da8e15 reply state 000000008253bd04 transno 4294984046 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426972:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.426978:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa468b7d (ffff9b7605dfee00) 00010000:00010000:2.0:1785774841.426981:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.426983:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774841.427114:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.427120:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.427127:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.427130:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.427137:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.427145:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9b7731f88200) 00010000:00010000:3.0:1785774841.427147:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.427150:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.427156:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0d22 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.427182:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.427184:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.427185:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.427755:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+630:19339:x1872519648593536:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2069us (2395us total) trans 4294984046 rc 0/0 00000100:00100000:2.0:1785774841.427764:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24014 00000100:00100000:1.0:1785774841.438999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.439091:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648593792 00000100:00100000:2.0:1785774841.439103:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648593792 00000100:00100000:2.0:1785774841.439213:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24015 00000100:00100000:2.0:1785774841.439223:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+630:19339:x1872519648593792:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.439278:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.439303:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a0017 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2c6 expref: 630 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439319:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9b7604f39000) 00010000:00010000:2.0:1785774841.439329:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.439351:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439365:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439374:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439385:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439392:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439398:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439453:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439466:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439472:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.439671:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2512, 64 off168960 00010000:00010000:2.0:1785774841.439743:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439752:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439760:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439767:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439773:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439779:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439805:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.439821:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439827:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439838:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439844:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.439848:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439856:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439864:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9b7731f88d00) 00010000:00010000:2.0:1785774841.439867:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.439870:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439877:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d37 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439892:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439898:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439904:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439910:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439914:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.439918:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439923:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439930:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.439933:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.439935:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439941:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0d29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.439950:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a16a99a2 reply state 000000008c2c61d4 transno 4294984047 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439960:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.439966:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdf501a7d (ffff9b7605dfed00) 00010000:00010000:2.0:1785774841.439968:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.439971:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.440032:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+631:19339:x1872519648593792:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 809us (1044us total) trans 4294984047 rc 0/0 00000100:00100000:2.0:1785774841.440039:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24015 00010000:00010000:3.0:1785774841.443695:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.443708:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.443848:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.443852:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.443862:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.443879:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9b7731f88d00) 00010000:00010000:3.0:1785774841.443882:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.443886:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.443892:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0d3e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.443921:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.443923:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.443925:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.449103:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.449468:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648594048 00000100:00100000:0.0:1785774841.449480:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648594048 00000100:00100000:0.0:1785774841.449537:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24016 00000100:00100000:0.0:1785774841.449546:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+631:19339:x1872519648594048:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.449607:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.449634:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a003a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2cd expref: 631 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449658:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9b7706383c00) 00010000:00010000:0.0:1785774841.449678:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.449701:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449721:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449731:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449742:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449749:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449760:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449828:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449835:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.449842:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.454535:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].11, 64 off8896 00010000:00010000:0.0:1785774841.454636:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454654:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454675:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454684:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454690:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454696:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454724:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.454744:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454751:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454757:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454763:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.454767:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454774:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454785:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.454788:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.454791:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454807:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454827:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454834:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454840:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454848:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.454852:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454857:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454864:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.454867:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.454870:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454876:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.454884:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e85e8400 reply state 00000000fc661471 transno 4294984048 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454895:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.454911:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b6840d2 (ffff9b7706383300) 00010000:00010000:0.0:1785774841.454913:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.454916:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.455006:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+632:19339:x1872519648594048:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 5457us (5908us total) trans 4294984048 rc 0/0 00000100:00100000:0.0:1785774841.455015:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24016 00010000:00010000:1.0:1785774841.462032:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.462047:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.462058:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.462062:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.462073:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.462099:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9b7602508100) 00010000:00010000:1.0:1785774841.462102:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.462107:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.462113:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0d5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.462141:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.462143:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.462145:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.463685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.463789:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648594304 00000100:00100000:0.0:1785774841.463810:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648594304 00000100:00100000:0.0:1785774841.463859:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24017 00000100:00100000:0.0:1785774841.463868:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+632:19339:x1872519648594304:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.463935:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.463957:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a005d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2d4 expref: 632 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.463973:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9b7604f39d00) 00010000:00010000:0.0:1785774841.463981:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.464003:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464016:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464025:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464045:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464052:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464059:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464114:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464121:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464133:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.464378:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2513, 64 off169024 00010000:00010000:0.0:1785774841.464459:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464468:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464476:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464483:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464490:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464496:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464512:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.464528:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464533:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464540:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464550:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.464554:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464561:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464569:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9b7602508000) 00010000:00010000:0.0:1785774841.464571:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.464575:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464581:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d6f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464597:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464603:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464609:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464615:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464619:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.464622:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464633:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464640:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.464642:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.464645:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464651:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.464659:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009182e4c1 reply state 00000000df83415a transno 4294984049 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464669:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.464675:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0674fd2 (ffff9b7604f39800) 00010000:00010000:0.0:1785774841.464677:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.464679:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774841.464983:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.464991:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.464997:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.465000:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.465007:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.465016:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9b7602508000) 00010000:00010000:3.0:1785774841.465019:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.465022:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.465027:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0d76 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.465040:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.465041:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.465043:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.465355:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+633:19339:x1872519648594304:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1486us (1676us total) trans 4294984049 rc 0/0 00000100:00100000:0.0:1785774841.465364:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24017 00000100:00100000:2.0:1785774841.476599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.476883:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648594560 00000100:00100000:0.0:1785774841.476996:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648594560 00000100:00100000:0.0:1785774841.477103:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24018 00000100:00100000:0.0:1785774841.477115:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+633:19339:x1872519648594560:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.477208:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.477236:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fca600/0x7b7109e1d0a0080 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2db expref: 633 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477257:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:0.0:1785774841.477267:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.477290:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477304:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477313:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477324:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477331:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477338:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477393:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477400:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477407:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.477634:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 64 off8960 00010000:00010000:0.0:1785774841.477703:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477721:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477729:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477737:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477744:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477750:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477770:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.477785:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477791:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477828:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477835:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.477839:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477847:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477859:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9b7602508000) 00010000:00010000:0.0:1785774841.477862:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.477865:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477872:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0d8b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477887:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477893:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477899:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477913:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477918:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.477921:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477926:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477934:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.477936:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.477939:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477949:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0d7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.477959:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066b381d5 reply state 00000000386c2aa0 transno 4294984050 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477968:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.477974:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x65f522d2 (ffff9b77199f5500) 00010000:00010000:0.0:1785774841.477977:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.477979:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.478038:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+634:19339:x1872519648594560:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 925us (1447us total) trans 4294984050 rc 0/0 00000100:00100000:0.0:1785774841.478045:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24018 00010000:00010000:3.0:1785774841.478110:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.478116:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.478123:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.478127:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.478133:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.478142:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9b7602508000) 00010000:00010000:3.0:1785774841.478144:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.478147:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.478153:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0d92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.478180:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.478182:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.478184:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.493291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.493437:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648594816 00000100:00100000:2.0:1785774841.493451:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648594816 00000100:00100000:2.0:1785774841.493533:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24019 00000100:00100000:2.0:1785774841.493545:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+634:19339:x1872519648594816:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.493611:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.493637:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a00a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2e2 expref: 634 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493673:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9b7702bc0500) 00010000:00010000:2.0:1785774841.493684:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.493707:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493729:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493740:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493753:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493759:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493766:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493837:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493845:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.493851:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.494079:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2514, 64 off169088 00010000:00010000:2.0:1785774841.494146:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494154:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494813:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494822:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494828:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494834:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494891:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.494920:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494927:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494933:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494939:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.494943:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494952:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494961:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9b7731f88700) 00010000:00010000:2.0:1785774841.494964:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.494968:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494974:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0da7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494993:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.494999:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495005:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495011:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495015:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.495018:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495033:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495041:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.495044:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.495047:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495053:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0d99 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.495063:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebc0824c reply state 00000000ecd6fd8d transno 4294984051 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495072:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.495085:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x38feb1d2 (ffff9b7706383000) 00010000:00010000:2.0:1785774841.495087:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.495090:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.495176:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+635:19339:x1872519648594816:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1616us (1878us total) trans 4294984051 rc 0/0 00000100:00100000:2.0:1785774841.495185:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24019 00010000:00010000:0.0:1785774841.496652:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.496673:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.496684:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.496689:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.496698:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.496719:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9b7731f88700) 00010000:00010000:0.0:1785774841.496722:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.496726:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.496733:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0dae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.496755:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.496757:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.496759:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.505969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.506060:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648595072 00000100:00100000:0.0:1785774841.506069:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648595072 00000100:00100000:0.0:1785774841.506132:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24020 00000100:00100000:0.0:1785774841.506141:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+635:19339:x1872519648595072:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.506235:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.506261:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcaa00/0x7b7109e1d0a00c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2e9 expref: 635 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506279:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9b7604f39200) 00010000:00010000:0.0:1785774841.506290:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.506310:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506324:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506333:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506343:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506350:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506358:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506411:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506419:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506425:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.506635:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 64 off9024 00010000:00010000:0.0:1785774841.506695:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506704:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506711:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506730:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506737:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506743:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506755:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.506772:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506778:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506784:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506790:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.506802:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506810:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506819:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.506822:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.506825:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506832:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0dc3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506848:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506853:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506859:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506870:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506875:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.506878:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506884:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506891:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.506893:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.506895:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506900:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0db5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.506908:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d968955 reply state 000000005b8106dc transno 4294984052 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506918:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.506923:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7c0bdcd2 (ffff9b7604f39c00) 00010000:00010000:0.0:1785774841.506925:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.506927:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.506999:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+636:19339:x1872519648595072:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 858us (1039us total) trans 4294984052 rc 0/0 00000100:00100000:0.0:1785774841.507007:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24020 00010000:00010000:1.0:1785774841.508055:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.508066:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.508083:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.508088:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.508097:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.508110:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9b7602508100) 00010000:00010000:1.0:1785774841.508112:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.508116:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.508123:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0dca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.508140:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.508141:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.508143:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.509331:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774841.509349:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671305984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774841.509403:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774841.509434:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671305984 00000100:00100000:1.0:1785774841.509439:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671305984 00000100:00100000:1.0:1785774841.509487:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1785774841.509494:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1872519671305984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785774841.509524:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774841.509556:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1872519671305984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774841.509562:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1785774841.509627:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671305984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774841.518408:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.519206:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648595328 00000100:00100000:2.0:1785774841.519217:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648595328 00000100:00100000:2.0:1785774841.519270:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24021 00000100:00100000:2.0:1785774841.519279:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+636:19339:x1872519648595328:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.519765:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.519806:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcac00/0x7b7109e1d0a00e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2f0 expref: 636 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519828:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9b7604f39b00) 00010000:00010000:2.0:1785774841.519840:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.519864:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519877:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519887:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519897:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519914:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519920:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519982:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519990:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.519996:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.520539:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2515, 64 off169152 00010000:00010000:2.0:1785774841.520606:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.520615:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.520628:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.520635:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.520642:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.520649:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.520679:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.520696:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.520703:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.521040:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.521046:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.521054:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.521057:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.521066:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.521082:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:3.0:1785774841.521085:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.521089:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.521095:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0de6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.521108:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.521110:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.521112:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.521411:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521419:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.521423:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521430:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521439:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:2.0:1785774841.521441:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.521586:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521594:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ddf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521615:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521621:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521626:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521632:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521638:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.521641:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521647:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521655:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.521657:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.521670:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521678:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0dd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.521687:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab519c27 reply state 000000000e9e385d transno 4294984053 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521699:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.521706:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x27156bd2 (ffff9b7604f39e00) 00010000:00010000:2.0:1785774841.521708:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.521711:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.521847:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+637:19339:x1872519648595328:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2566us (3445us total) trans 4294984053 rc 0/0 00000100:00100000:2.0:1785774841.521858:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24021 00000100:00100000:1.0:1785774841.532644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.532985:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648595584 00000100:00100000:0.0:1785774841.532995:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648595584 00000100:00100000:0.0:1785774841.533059:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24022 00000100:00100000:0.0:1785774841.533068:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+637:19339:x1872519648595584:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.533287:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.533313:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a010c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2f7 expref: 637 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533333:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9b7604f39500) 00010000:00010000:0.0:1785774841.533344:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.533364:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533378:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533387:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533399:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533406:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533413:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533525:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533537:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.533544:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.533976:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 64 off9088 00010000:00010000:0.0:1785774841.534266:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534276:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534284:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534291:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534298:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534305:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534324:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.534339:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534345:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534356:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534362:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.534366:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534372:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534381:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.534384:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.534387:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534394:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0dfb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534408:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534414:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534420:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534425:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.534428:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534438:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534563:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.534566:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.534570:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534576:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0ded lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.534586:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004e73996 reply state 0000000075cc69a7 transno 4294984054 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534596:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.534603:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfd213ed2 (ffff9b7604f39600) 00010000:00010000:0.0:1785774841.534605:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.534608:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774841.534748:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.534755:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.534761:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.534765:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.534772:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.534785:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9b7602508100) 00010000:00010000:3.0:1785774841.534787:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.534790:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.534807:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e02 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.534820:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.534821:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.534824:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.534986:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+638:19339:x1872519648595584:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1918us (2350us total) trans 4294984054 rc 0/0 00000100:00100000:0.0:1785774841.534995:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24022 00000100:00100000:1.0:1785774841.541501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.541590:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648595840 00000100:00100000:0.0:1785774841.541600:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648595840 00000100:00100000:0.0:1785774841.541821:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24023 00000100:00100000:0.0:1785774841.541833:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+638:19339:x1872519648595840:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.542008:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.542437:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155600/0x7b7109e1d0a012f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c2fe expref: 638 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542613:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9b7604f39a00) 00010000:00010000:0.0:1785774841.542625:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.542652:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542776:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542789:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542811:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542819:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542826:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542895:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542965:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.542973:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.543813:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2516, 64 off169216 00010000:00010000:0.0:1785774841.543893:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544506:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544517:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544526:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544532:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544539:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544597:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.544618:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544624:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544630:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544636:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.544640:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544648:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544667:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9b7602508000) 00010000:00010000:0.0:1785774841.544670:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.544675:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544682:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0e17 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544700:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544706:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544711:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544772:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544780:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.544783:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544790:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544806:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.544808:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.544811:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544822:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0e09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.544832:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042ec81cc reply state 00000000b66222d3 transno 4294984055 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544843:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.544849:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x81a24dd2 (ffff9b7604f39100) 00010000:00010000:0.0:1785774841.544851:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.544854:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.544942:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+639:19339:x1872519648595840:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 3108us (3504us total) trans 4294984055 rc 0/0 00000100:00100000:0.0:1785774841.544950:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24023 00010000:00010000:3.0:1785774841.550624:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.550638:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.550650:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.550654:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.550870:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.550892:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9b7602508000) 00010000:00010000:3.0:1785774841.550895:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.550907:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.550913:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0e1e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.551003:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.551006:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.551008:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.552841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.552966:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648596096 00000100:00100000:0.0:1785774841.552975:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648596096 00000100:00100000:0.0:1785774841.553137:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24024 00000100:00100000:0.0:1785774841.553147:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+639:19339:x1872519648596096:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.553346:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.553370:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155200/0x7b7109e1d0a0152 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c305 expref: 639 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553385:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9b7604f39900) 00010000:00010000:0.0:1785774841.553394:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.553416:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553429:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553439:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553504:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553512:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553520:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553575:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553583:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.553590:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.554011:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 64 off9152 00010000:00010000:1.0:1785774841.556598:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556618:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556629:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556638:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556645:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556651:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556678:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774841.556699:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556705:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556711:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556723:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.556728:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556736:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556746:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9b7602508100) 00010000:00010000:1.0:1785774841.556749:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774841.556753:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556759:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0e33 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556780:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556786:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556791:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556806:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556812:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.556814:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556821:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556829:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774841.556831:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.556834:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556840:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0e25 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774841.556850:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002bbd42cb reply state 000000003e4926b9 transno 4294984056 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556860:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.556867:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6cc088d2 (ffff9b7604f39300) 00010000:00010000:1.0:1785774841.556869:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774841.556871:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774841.556961:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+640:19339:x1872519648596096:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 3813us (4123us total) trans 4294984056 rc 0/0 00000100:00100000:1.0:1785774841.556970:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24024 00010000:00010000:0.0:1785774841.557185:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.557198:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.557205:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.557208:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.557216:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.557224:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.557227:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.557230:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.557236:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e3a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.557257:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.557259:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.557260:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.564356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.564422:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648596352 00000100:00100000:2.0:1785774841.564430:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648596352 00000100:00100000:2.0:1785774841.564490:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24025 00000100:00100000:2.0:1785774841.564498:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+640:19339:x1872519648596352:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.564549:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.564573:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0175 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c30c expref: 640 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564595:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9b7702bc0400) 00010000:00010000:2.0:1785774841.564605:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.564625:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564638:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564648:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564663:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564670:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564677:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564860:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564870:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.564877:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.565401:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2517, 64 off169280 00010000:00010000:2.0:1785774841.565523:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565533:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565542:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565550:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565557:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565564:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565580:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.565596:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565602:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565609:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565614:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.565618:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565625:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565634:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:2.0:1785774841.565636:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.565639:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565645:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e4f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565660:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565671:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565677:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565682:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565688:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.565690:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565695:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565702:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.565704:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.565706:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565907:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.565921:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008272614f reply state 00000000d1ae464b transno 4294984057 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565931:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.565937:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe9ca17d2 (ffff9b7702bc0600) 00010000:00010000:2.0:1785774841.565941:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.565944:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.566009:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+641:19339:x1872519648596352:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1510us (1852us total) trans 4294984057 rc 0/0 00000100:00100000:2.0:1785774841.566017:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24025 00010000:00010000:3.0:1785774841.566593:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.566601:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.566608:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.566611:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.566619:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.566628:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:3.0:1785774841.566630:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.566634:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.566639:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0e56 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.566653:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.566654:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.566656:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.573513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.573633:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648596608 00000100:00100000:1.0:1785774841.573644:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648596608 00000100:00100000:1.0:1785774841.573701:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24026 00000100:00100000:1.0:1785774841.573710:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+641:19339:x1872519648596608:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774841.573775:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774841.573810:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a0198 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c313 expref: 641 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573829:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9b77199f5000) 00010000:00010000:1.0:1785774841.573840:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774841.573864:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573877:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573887:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573897:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573905:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573911:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573972:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573980:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.573986:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774841.574493:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 64 off9216 00010000:00010000:1.0:1785774841.574556:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574566:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574575:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574582:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574589:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574595:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574646:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774841.574662:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574669:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574675:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574681:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.574685:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574693:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574701:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:1.0:1785774841.574704:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774841.574707:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574723:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0e6b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574745:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574752:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574758:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574763:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574768:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.574770:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574776:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574782:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774841.574784:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.574787:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574803:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031800/0x7b7109e1d0a0e5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774841.574813:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000465ce751 reply state 000000000fcf4a73 transno 4294984058 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574824:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.574831:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa846083f (ffff9b77199f5700) 00010000:00010000:1.0:1785774841.574833:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774841.574835:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774841.574902:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+642:19339:x1872519648596608:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1193us (1398us total) trans 4294984058 rc 0/0 00000100:00100000:1.0:1785774841.574909:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24026 00010000:00010000:2.0:1785774841.576335:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774841.576345:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.576354:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774841.576358:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.576367:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.576380:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:2.0:1785774841.576382:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774841.576386:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.576392:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0e72 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.576408:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.576410:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.576412:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.586283:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.586402:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648596864 00000100:00100000:2.0:1785774841.586412:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648596864 00000100:00100000:2.0:1785774841.586471:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24027 00000100:00100000:2.0:1785774841.586480:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+642:19339:x1872519648596864:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.586536:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.586561:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a01bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c31a expref: 642 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586585:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9b7605fccf00) 00010000:00010000:2.0:1785774841.586595:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.586615:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586629:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586638:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586649:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586656:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586663:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586730:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586738:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.586744:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.587265:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2518, 64 off169344 00010000:00010000:2.0:1785774841.587329:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587338:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587347:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587355:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587362:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587369:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587380:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.587396:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587403:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587409:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587415:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.587419:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587427:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587435:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:2.0:1785774841.587437:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.587694:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.587701:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.587707:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.587719:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.587726:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.587735:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:0.0:1785774841.587738:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.587741:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.587752:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0e8e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.587762:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.587763:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.587765:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.587832:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587840:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e87 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587860:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587866:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587872:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587878:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587883:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.587886:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587893:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587952:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.587956:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.587959:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587966:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.587976:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce9a01f0 reply state 0000000064e237be transno 4294984059 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587986:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.587993:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb56f173f (ffff9b7605fcc300) 00010000:00010000:2.0:1785774841.587995:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.587998:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.588295:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+643:19339:x1872519648596864:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1814us (2018us total) trans 4294984059 rc 0/0 00000100:00100000:2.0:1785774841.588304:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24027 00000100:00100000:0.0:1785774841.595448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.595612:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648597120 00000100:00100000:2.0:1785774841.595621:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648597120 00000100:00100000:2.0:1785774841.595704:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24028 00000100:00100000:2.0:1785774841.595721:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+643:19339:x1872519648597120:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.595773:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.595807:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154c00/0x7b7109e1d0a01de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c321 expref: 643 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.595824:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9b7604f39700) 00010000:00010000:2.0:1785774841.595834:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.595855:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.595869:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.595879:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.595888:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.595896:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596037:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596101:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596109:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596116:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.596563:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 64 off9280 00010000:00010000:2.0:1785774841.596624:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596633:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596645:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596652:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596759:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596767:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596790:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.596814:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596820:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596827:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596832:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.596836:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596843:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596852:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:2.0:1785774841.596855:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.596859:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596865:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0ea3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596879:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596884:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596890:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596895:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.596898:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596958:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596966:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.596969:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.596972:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.596978:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0e95 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.596987:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c39bd096 reply state 00000000e2f29c72 transno 4294984060 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.597002:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.597008:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5432ea3f (ffff9b7604f39400) 00010000:00010000:2.0:1785774841.597010:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.597012:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.597181:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+644:19339:x1872519648597120:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1468us (1740us total) trans 4294984060 rc 0/0 00000100:00100000:2.0:1785774841.597268:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24028 00010000:00010000:1.0:1785774841.597326:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.597332:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.597339:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.597343:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.597350:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.597358:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9b7731f88000) 00010000:00010000:1.0:1785774841.597360:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.597364:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.597369:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0eaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.597383:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.597386:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.597388:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.605538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.605646:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648597376 00000100:00100000:0.0:1785774841.605656:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648597376 00000100:00100000:0.0:1785774841.605707:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24029 00000100:00100000:0.0:1785774841.605724:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+644:19339:x1872519648597376:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.605779:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.605814:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a0201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c328 expref: 644 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.605832:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9b77199f5b00) 00010000:00010000:0.0:1785774841.605842:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.605865:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.605879:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.605889:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.605998:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.606013:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.606021:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.606098:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.606107:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.606113:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.606830:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2519, 64 off169408 00010000:00010000:0.0:1785774841.606896:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607032:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607042:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607050:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607056:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607062:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607215:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.607235:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607242:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607248:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607254:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.607258:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607266:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607274:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.607277:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.607282:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607288:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ebf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607304:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607311:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607321:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607328:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607332:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.607335:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607341:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607347:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.607349:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.607352:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607358:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0eb1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.607366:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a39dea14 reply state 00000000bc170db3 transno 4294984061 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607377:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.607384:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7f3c793f (ffff9b77199f5c00) 00010000:00010000:0.0:1785774841.607386:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.607389:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.607466:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+645:19339:x1872519648597376:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1749us (1935us total) trans 4294984061 rc 0/0 00000100:00100000:0.0:1785774841.607474:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24029 00010000:00010000:3.0:1785774841.609426:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.609439:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.609530:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.609534:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.609543:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.609558:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9b7602508100) 00010000:00010000:3.0:1785774841.609562:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.609566:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.609573:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0ec6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.611146:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.611152:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.611154:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.616093:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.616349:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648597632 00000100:00100000:1.0:1785774841.616359:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648597632 00000100:00100000:1.0:1785774841.616413:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24030 00000100:00100000:1.0:1785774841.616423:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+645:19339:x1872519648597632:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774841.616506:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774841.616531:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a0224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c32f expref: 645 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616555:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9b7605fcc000) 00010000:00010000:1.0:1785774841.616565:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774841.616585:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616597:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616606:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616616:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616623:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616629:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616688:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616695:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.616702:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774841.616938:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 64 off9344 00010000:00010000:1.0:1785774841.617002:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617011:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617019:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617239:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617248:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617255:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617273:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774841.617289:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617300:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617306:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617312:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.617316:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617323:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617331:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:1.0:1785774841.617334:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774841.617337:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617344:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0edb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617362:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617369:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617374:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617381:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617386:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.617389:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617396:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617403:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774841.617405:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.617408:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617414:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0ecd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774841.617423:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb44496f reply state 00000000ea2133fa transno 4294984062 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617432:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.617439:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x98e9a43f (ffff9b7605fccd00) 00010000:00010000:1.0:1785774841.617441:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774841.617444:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774841.617502:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+646:19339:x1872519648597632:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1081us (1424us total) trans 4294984062 rc 0/0 00000100:00100000:1.0:1785774841.617509:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24030 00010000:00010000:0.0:1785774841.617718:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.617724:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.617731:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.617735:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.617742:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.617751:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:0.0:1785774841.617753:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.617756:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.617761:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0ee2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.617775:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.617777:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.617778:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.628887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774841.629354:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648597888 00000100:00100000:0.0:1785774841.629365:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648597888 00000100:00100000:0.0:1785774841.629420:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24031 00000100:00100000:0.0:1785774841.629430:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+646:19339:x1872519648597888:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774841.629497:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774841.629523:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154a00/0x7b7109e1d0a0247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c336 expref: 646 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629541:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9b760572bd00) 00010000:00010000:0.0:1785774841.629551:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774841.629571:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629585:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629595:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629605:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629612:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629619:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629674:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629682:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.629688:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.630407:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2520, 64 off169472 00010000:00010000:0.0:1785774841.630488:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630499:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630508:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630516:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630523:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630529:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630551:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774841.630572:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630578:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630584:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630591:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.630596:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630604:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630617:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774841.630620:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774841.630623:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630630:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a0ef7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630646:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630652:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630657:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630664:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630668:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774841.630670:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630676:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630683:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774841.630685:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774841.630688:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630699:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a0ee9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774841.630707:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d2dc064 reply state 00000000bd17b041 transno 4294984063 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630781:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.630787:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x43f3333f (ffff9b760572bc00) 00010000:00010000:0.0:1785774841.630790:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774841.630800:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774841.630875:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+647:19339:x1872519648597888:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1446us (1995us total) trans 4294984063 rc 0/0 00000100:00100000:0.0:1785774841.630882:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24031 00010000:00010000:1.0:1785774841.632594:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.632608:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.632617:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.632621:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.632630:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.632643:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9b7602508100) 00010000:00010000:1.0:1785774841.632646:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.632651:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.632657:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a0efe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.632676:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.632678:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.632680:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.638970:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.640958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.641199:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648598144 00000100:00100000:2.0:1785774841.641212:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648598144 00000100:00100000:2.0:1785774841.641281:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24032 00000100:00100000:2.0:1785774841.641292:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+647:19339:x1872519648598144:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.641362:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.641396:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155800/0x7b7109e1d0a026a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c33d expref: 647 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641436:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9b760572ba00) 00010000:00010000:2.0:1785774841.641459:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.641487:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641502:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641519:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641530:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641537:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641544:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641615:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641622:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.641629:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.641923:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9408 00010000:00010000:2.0:1785774841.642005:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642014:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642022:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642207:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642214:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642220:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642243:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.642266:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642273:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642279:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642286:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.642291:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642299:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642315:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9b7731f88700) 00010000:00010000:2.0:1785774841.642317:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.642321:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642327:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642352:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642357:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642362:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642367:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642376:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.642379:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642385:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642392:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.642394:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.642397:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642403:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.642412:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bed1c5e2 reply state 000000002c280f4f transno 4294984064 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642423:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.642430:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5ae1063f (ffff9b760572b800) 00010000:00010000:2.0:1785774841.642432:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.642435:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.642531:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+648:19339:x1872519648598144:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1239us (1578us total) trans 4294984064 rc 0/0 00000100:00100000:2.0:1785774841.642539:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24032 00010000:00010000:1.0:1785774841.642889:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.642897:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.642905:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.642909:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.642917:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.642928:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9b7731f88700) 00010000:00010000:1.0:1785774841.642930:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.642933:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.642940:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.642955:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.642957:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.642959:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.650851:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.651489:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648598400 00000100:00100000:1.0:1785774841.651499:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648598400 00000100:00100000:1.0:1785774841.651584:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24033 00000100:00100000:1.0:1785774841.651594:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+648:19339:x1872519648598400:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774841.651648:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774841.651684:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a028d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c344 expref: 648 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651708:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9b7605fcc700) 00010000:00010000:1.0:1785774841.651719:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774841.651740:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651754:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651764:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651779:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651786:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651805:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651866:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651874:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.651881:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774841.652267:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2521, 64 off169536 00010000:00010000:1.0:1785774841.652342:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652351:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652360:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652367:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652374:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652382:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652396:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774841.652415:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652421:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652428:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652435:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.652440:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.652568:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.652574:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.652581:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.652584:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.652593:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.652603:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:0.0:1785774841.652606:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.652610:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.652616:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0f36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.652629:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.652631:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.652633:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.652661:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652669:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:1.0:1785774841.652671:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774841.652674:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652680:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0f2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652697:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652708:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652714:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652721:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652725:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.652728:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652734:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652740:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774841.652742:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.652745:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652751:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0f21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774841.652760:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072633399 reply state 000000004cd8d644 transno 4294984065 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652770:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.652777:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6fe0153f (ffff9b7605fcc400) 00010000:00010000:1.0:1785774841.652779:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774841.652782:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774841.655670:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+649:19339:x1872519648598400:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 4069us (4819us total) trans 4294984065 rc 0/0 00000100:00100000:1.0:1785774841.655683:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24033 00000100:00100000:3.0:1785774841.663707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.664554:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648598656 00000100:00100000:2.0:1785774841.664566:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648598656 00000100:00100000:2.0:1785774841.664657:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24034 00000100:00100000:2.0:1785774841.664675:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+649:19339:x1872519648598656:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.664747:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.664775:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a02b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c34b expref: 649 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.664809:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9b7702bc0100) 00010000:00010000:2.0:1785774841.664820:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.664842:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.664856:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.664867:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.664877:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.664889:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.664947:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665216:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665225:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665233:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.665425:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 64 off9472 00010000:00010000:2.0:1785774841.665583:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665593:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665601:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665608:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665614:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665621:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665677:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.665695:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665702:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665709:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665714:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.665718:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665726:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665734:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9b7731f88d00) 00010000:00010000:2.0:1785774841.665737:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.665740:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665747:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0f4b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665763:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665768:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665779:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665784:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.665787:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665792:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665811:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.665813:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.665816:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665822:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.665831:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026da0869 reply state 00000000a23a3588 transno 4294984066 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665842:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.665849:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa91e503f (ffff9b7702bc0300) 00010000:00010000:2.0:1785774841.665851:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.665854:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.665936:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+650:19339:x1872519648598656:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1270us (2239us total) trans 4294984066 rc 0/0 00000100:00100000:2.0:1785774841.665944:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24034 00010000:00010000:1.0:1785774841.670569:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.670584:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.670597:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.670601:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.670612:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.670632:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9b7731f88d00) 00010000:00010000:1.0:1785774841.670635:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.670640:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.670647:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0f52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.670723:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.670726:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.670728:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.672777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.672863:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648598912 00000100:00100000:2.0:1785774841.672874:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648598912 00000100:00100000:2.0:1785774841.672950:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24035 00000100:00100000:2.0:1785774841.672961:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+650:19339:x1872519648598912:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.673020:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.673052:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155400/0x7b7109e1d0a02d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c352 expref: 650 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673071:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9b760572b700) 00010000:00010000:2.0:1785774841.673086:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.673106:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673119:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673128:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673138:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673145:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673151:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673223:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673236:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673242:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.673469:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2522, 64 off169600 00010000:00010000:2.0:1785774841.673547:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673557:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673564:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673571:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673578:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673584:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673601:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.673619:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673626:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673636:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673643:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.673647:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673654:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673662:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9b7731f88200) 00010000:00010000:2.0:1785774841.673665:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.673668:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673675:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0f67 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673691:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673697:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673703:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673708:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673713:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.673717:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673723:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673729:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.673731:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.673734:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673741:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0f59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.673748:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1f21eb3 reply state 0000000049969666 transno 4294984067 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673759:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.673764:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfc27df3f (ffff9b760572b100) 00010000:00010000:2.0:1785774841.673766:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.673769:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.673838:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+651:19339:x1872519648598912:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 879us (1068us total) trans 4294984067 rc 0/0 00000100:00100000:2.0:1785774841.673845:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24035 00010000:00010000:1.0:1785774841.676411:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.676422:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.676432:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca1200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.676437:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.676454:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.676470:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9b7731f88200) 00010000:00010000:1.0:1785774841.676473:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.676476:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.676483:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1200/0x7b7109e1d0a0f6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.676504:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.676506:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.676508:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.680993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.681994:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648599168 00000100:00100000:2.0:1785774841.682268:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648599168 00000100:00100000:3.0:1785774841.682567:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24036 00000100:00100000:3.0:1785774841.682577:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+651:19339:x1872519648599168:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774841.682636:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774841.682674:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154000/0x7b7109e1d0a02f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c359 expref: 651 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682693:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9b760572be00) 00010000:00010000:3.0:1785774841.682703:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774841.682728:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682743:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682753:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682763:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682775:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682782:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682862:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682871:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.682878:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774841.683393:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 64 off9536 00010000:00010000:3.0:1785774841.683511:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683521:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683529:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683537:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683543:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683549:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683599:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774841.683616:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683623:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683629:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683635:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.683639:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683646:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683654:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9b7731f8a400) 00010000:00010000:3.0:1785774841.683657:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774841.683660:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683666:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a0f83 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683681:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683687:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683698:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683703:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683708:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.683710:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683717:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683723:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774841.683725:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774841.683728:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683734:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a0f75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774841.683741:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096724711 reply state 000000002d387c38 transno 4294984068 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683752:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.683758:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a358594 (ffff9b760572bb00) 00010000:00010000:3.0:1785774841.683760:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774841.683762:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774841.683844:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+652:19339:x1872519648599168:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1268us (2858us total) trans 4294984068 rc 0/0 00000100:00100000:3.0:1785774841.683851:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24036 00010000:00010000:2.0:1785774841.689182:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774841.689195:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.689211:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774841.689216:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.689226:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.689243:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9b7731f8a400) 00010000:00010000:2.0:1785774841.689246:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774841.689250:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.689257:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a0f8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.689281:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.689283:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.689285:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.689790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.689865:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648599424 00000100:00100000:2.0:1785774841.689874:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648599424 00000100:00100000:2.0:1785774841.689983:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24037 00000100:00100000:2.0:1785774841.689993:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+652:19339:x1872519648599424:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.690394:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.690415:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1800/0x7b7109e1d0a0319 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c360 expref: 652 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690436:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9b7702bc0700) 00010000:00010000:2.0:1785774841.690501:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.690527:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690542:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690552:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690562:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690569:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690576:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690633:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690641:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.690648:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.690977:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2523, 64 off169664 00010000:00010000:2.0:1785774841.691141:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691150:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691325:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691333:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691339:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691345:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691394:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.691412:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691419:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691425:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691430:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.691434:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691442:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691460:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9b7731f88f00) 00010000:00010000:2.0:1785774841.691463:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.691467:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691472:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0f9f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691487:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691493:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691499:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691504:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691509:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.691512:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691518:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691524:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.691526:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.691528:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691534:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0000/0x7b7109e1d0a0f91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.691542:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000451a5f8d reply state 00000000263a7fb5 transno 4294984069 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691553:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.691559:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3f3f1494 (ffff9b7702bc0000) 00010000:00010000:2.0:1785774841.691561:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.691564:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.691631:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+653:19339:x1872519648599424:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1639us (1843us total) trans 4294984069 rc 0/0 00000100:00100000:2.0:1785774841.691639:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24037 00010000:00010000:0.0:1785774841.695486:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.695499:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.695510:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.695514:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.695523:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.695540:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9b7731f88f00) 00010000:00010000:0.0:1785774841.695543:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.695547:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.695553:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0fa6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.695577:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.695580:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.695581:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.699267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.699502:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648599680 00000100:00100000:2.0:1785774841.699512:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648599680 00000100:00100000:2.0:1785774841.699575:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24038 00000100:00100000:2.0:1785774841.699585:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+653:19339:x1872519648599680:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.699640:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.699829:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb200/0x7b7109e1d0a033c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c367 expref: 653 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.699847:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9b760572bf00) 00010000:00010000:2.0:1785774841.699858:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.699880:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.699895:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.700326:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.700344:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.700351:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.700357:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.700414:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.700421:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.700428:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.700893:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 64 off9600 00010000:00010000:2.0:1785774841.701018:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701382:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701391:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701400:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701406:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701413:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701433:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.701458:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701464:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701471:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701475:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.701479:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701486:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701495:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9b7731f88b00) 00010000:00010000:2.0:1785774841.701498:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.701501:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701507:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fbb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701525:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701535:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701542:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701547:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701552:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.701554:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701560:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701566:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.701568:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.701571:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701577:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.701585:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7387e75 reply state 00000000b792a2e3 transno 4294984070 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701596:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.701602:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x584c3f94 (ffff9b760572b300) 00010000:00010000:2.0:1785774841.701605:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.701607:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.701777:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+654:19339:x1872519648599680:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2192us (2518us total) trans 4294984070 rc 0/0 00000100:00100000:2.0:1785774841.701786:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24038 00010000:00010000:1.0:1785774841.701913:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.701919:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.701926:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.701929:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.701935:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.701944:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9b7731f88b00) 00010000:00010000:1.0:1785774841.701946:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.701950:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.701960:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0fc2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.701974:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.701976:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.701977:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774841.708516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.708760:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648599936 00000100:00100000:1.0:1785774841.708770:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648599936 00000100:00100000:1.0:1785774841.708836:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24039 00000100:00100000:1.0:1785774841.708846:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+654:19339:x1872519648599936:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774841.708917:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774841.708945:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0e00/0x7b7109e1d0a035f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c36e expref: 654 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.708969:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9b7702bc0c00) 00010000:00010000:1.0:1785774841.708980:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774841.709002:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709015:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709024:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709035:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709042:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709048:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709113:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709121:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709127:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774841.709355:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2524, 64 off169728 00010000:00010000:1.0:1785774841.709419:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709428:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709435:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709453:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709460:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709466:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709490:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774841.709506:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709512:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709518:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709525:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.709529:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709536:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709544:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:1.0:1785774841.709547:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774841.709550:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709557:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a0fd7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709577:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709583:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709589:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709600:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709605:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.709608:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709614:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709620:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774841.709623:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.709625:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709630:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a0fc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774841.709639:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af474468 reply state 000000001ae230a6 transno 4294984071 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709649:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.709655:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x55367694 (ffff9b7702bc0b00) 00010000:00010000:1.0:1785774841.709666:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774841.709668:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774841.709724:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+655:19339:x1872519648599936:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 880us (1217us total) trans 4294984071 rc 0/0 00000100:00100000:1.0:1785774841.709731:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24039 00010000:00010000:2.0:1785774841.710142:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774841.710149:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.710156:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774841.710182:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.710189:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.710198:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:2.0:1785774841.710201:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774841.710204:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.710211:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a0fde lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.710225:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.710227:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.710228:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.716868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.717016:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648600192 00000100:00100000:2.0:1785774841.717034:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648600192 00000100:00100000:2.0:1785774841.717116:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24040 00000100:00100000:2.0:1785774841.717126:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+655:19339:x1872519648600192:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.717216:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.717244:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a0382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c375 expref: 655 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717269:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9b7702bc0f00) 00010000:00010000:2.0:1785774841.717279:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.717300:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717315:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717325:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717336:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717344:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717350:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717405:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717413:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717419:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.717647:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 64 off9664 00010000:00010000:2.0:1785774841.717723:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717732:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717740:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717747:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717753:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717760:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717777:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.717802:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717810:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717816:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717822:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.717826:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717835:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717844:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:2.0:1785774841.717847:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.717851:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717857:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a0ff3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717871:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717877:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717884:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717888:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.717890:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.717896:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.718523:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.718530:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.718535:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.718539:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.718546:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.718554:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9b7731f88a00) 00010000:00010000:1.0:1785774841.718557:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.718560:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.718566:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a0ffa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.718581:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.718583:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.718585:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774841.718625:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.718628:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.718631:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.718643:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a0fe5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.718654:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000816daff9 reply state 00000000b38a4a75 transno 4294984072 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.718715:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.718722:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf0e3a194 (ffff9b7702bc0200) 00010000:00010000:2.0:1785774841.718724:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.718727:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774841.720923:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+656:19339:x1872519648600192:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 3790us (4054us total) trans 4294984072 rc 0/0 00000100:00100000:3.0:1785774841.720935:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24040 00000100:00100000:0.0:1785774841.727642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774841.727722:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648600448 00000100:00100000:3.0:1785774841.727731:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648600448 00000100:00100000:3.0:1785774841.727784:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24041 00000100:00100000:3.0:1785774841.727802:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+656:19339:x1872519648600448:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774841.727859:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774841.727884:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a03a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c37c expref: 656 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.727984:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9b77199f5e00) 00010000:00010000:3.0:1785774841.727996:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774841.728019:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728133:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728144:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728155:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728441:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728503:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728574:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728582:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728588:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774841.728816:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2525, 64 off169792 00010000:00010000:3.0:1785774841.728885:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.728894:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729129:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729138:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729145:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729151:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729289:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774841.729311:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729318:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729325:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729331:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.729335:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729343:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729352:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:3.0:1785774841.729355:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774841.729359:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729365:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a100f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729381:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729386:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729397:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729402:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729406:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.729409:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729415:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729422:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774841.729424:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774841.729427:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729433:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1001 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774841.729441:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039130473 reply state 00000000d2508c84 transno 4294984073 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.729630:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.729636:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.729644:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.729647:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.729654:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.729672:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:0.0:1785774841.729674:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.729677:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.729683:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1016 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.729696:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.729698:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.729700:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.729768:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.729775:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2fe2b094 (ffff9b77199f5900) 00010000:00010000:3.0:1785774841.729777:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774841.729780:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774841.729860:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+657:19339:x1872519648600448:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2066us (2225us total) trans 4294984073 rc 0/0 00000100:00100000:3.0:1785774841.729867:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24041 00000100:00100000:2.0:1785774841.737791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.737895:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648600704 00000100:00100000:1.0:1785774841.738013:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648600704 00000100:00100000:1.0:1785774841.738314:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24042 00000100:00100000:1.0:1785774841.738327:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+657:19339:x1872519648600704:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774841.738398:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774841.738428:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0800/0x7b7109e1d0a03c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c383 expref: 657 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738464:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9b7602507600) 00010000:00010000:1.0:1785774841.738477:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774841.738503:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738518:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738529:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738540:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738548:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738554:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738621:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738629:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.738636:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774841.739563:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off9728 00010000:00010000:1.0:1785774841.739656:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739758:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739768:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739774:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739780:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739786:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739861:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774841.739881:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739888:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739895:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739901:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.739905:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739912:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739922:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:1.0:1785774841.739925:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774841.739929:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739947:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b800/0x7b7109e1d0a102b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739972:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739978:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739984:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739989:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.739994:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.739997:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.740003:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.740011:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774841.740013:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.740017:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.740140:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b200/0x7b7109e1d0a101d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774841.740155:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000515e434a reply state 000000000dcf1592 transno 4294984074 ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.740306:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.740315:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xc8efdb94 (ffff9b7702bc0900) 00010000:00010000:1.0:1785774841.740317:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774841.740321:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774841.740404:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+658:19339:x1872519648600704:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2079us (2620us total) trans 4294984074 rc 0/0 00000100:00100000:1.0:1785774841.740412:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24042 00010000:00010000:0.0:1785774841.741138:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.741146:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.741153:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.741157:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.742479:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.742495:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9b7605fd8300) 00010000:00010000:0.0:1785774841.742497:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.742502:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.742508:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a1032 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.742531:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.742533:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.742535:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.748226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.748419:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648600960 00000100:00100000:2.0:1785774841.748429:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648600960 00000100:00100000:2.0:1785774841.748487:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24043 00000100:00100000:2.0:1785774841.748497:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+658:19339:x1872519648600960:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.748549:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.748574:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0000/0x7b7109e1d0a03eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c38a expref: 658 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748597:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9b7602507b00) 00010000:00010000:2.0:1785774841.748606:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.748628:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748641:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748655:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748675:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748683:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748690:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748746:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748754:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.748761:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.749155:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2526, 64 off169856 00010000:00010000:2.0:1785774841.749312:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749323:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749331:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749338:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749345:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749351:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749412:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.749430:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749438:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749452:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749459:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.749463:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749470:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749479:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9b7731f88300) 00010000:00010000:2.0:1785774841.749482:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.749485:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749492:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a1047 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749513:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749520:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749526:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749532:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749536:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.749539:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749544:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749551:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.749553:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.749555:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749561:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1039 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.749570:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000744e5410 reply state 00000000eb41be4f transno 4294984075 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749580:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.749587:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x45da1294 (ffff9b7602507400) 00010000:00010000:2.0:1785774841.749589:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.749591:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.749691:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+659:19339:x1872519648600960:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1194us (1472us total) trans 4294984075 rc 0/0 00000100:00100000:2.0:1785774841.749698:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24043 00010000:00010000:1.0:1785774841.750555:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.750563:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.750571:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.750574:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.750582:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.750593:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9b7731f88300) 00010000:00010000:1.0:1785774841.750596:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.750599:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.750605:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044000/0x7b7109e1d0a104e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.750619:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.750622:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.750623:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.755836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.755955:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648601216 00000100:00100000:2.0:1785774841.755964:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648601216 00000100:00100000:2.0:1785774841.756104:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24044 00000100:00100000:2.0:1785774841.756115:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+659:19339:x1872519648601216:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.756202:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.756227:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0c00/0x7b7109e1d0a040e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c391 expref: 659 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756249:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9b7602507000) 00010000:00010000:2.0:1785774841.756259:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.756281:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756294:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756304:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756314:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756326:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756333:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756385:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756392:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756399:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.756594:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 64 off9792 00010000:00010000:2.0:1785774841.756652:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756671:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756679:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756686:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756693:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756698:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756714:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.756729:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756735:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756743:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756749:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.756753:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756761:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756768:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9b7731f88500) 00010000:00010000:2.0:1785774841.756771:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.756774:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756781:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1063 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756806:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756812:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756822:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756828:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756832:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.756835:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756841:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756849:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.756851:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.756854:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756860:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a1055 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.756870:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c8ad4ef reply state 000000000017f8af transno 4294984076 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756880:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.756887:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd2f04d94 (ffff9b7709388f00) 00010000:00010000:2.0:1785774841.756889:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.756891:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774841.756992:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.756998:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.757005:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.757009:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.757015:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.757032:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9b7731f88500) 00010000:00010000:1.0:1785774841.757034:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.757037:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.757043:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a106a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.757055:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.757056:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.757058:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.757393:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+660:19339:x1872519648601216:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1278us (1566us total) trans 4294984076 rc 0/0 00000100:00100000:2.0:1785774841.757401:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24044 00000100:00100000:2.0:1785774841.762437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774841.762494:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648601472 00000100:00100000:3.0:1785774841.762504:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648601472 00000100:00100000:3.0:1785774841.762564:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24045 00000100:00100000:3.0:1785774841.762573:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+660:19339:x1872519648601472:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774841.762628:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774841.762654:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a0431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c398 expref: 660 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762778:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9b7605fcce00) 00010000:00010000:3.0:1785774841.762790:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774841.762823:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762838:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762847:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762857:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762864:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762870:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762990:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.762999:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.763006:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774841.763258:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2527, 64 off169920 00010000:00010000:3.0:1785774841.763326:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.763335:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.763343:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.763351:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.763358:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.763364:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763453:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.763476:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763483:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763489:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763495:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.763499:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763506:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763516:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:2.0:1785774841.763519:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.763522:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763528:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a107f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763547:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763558:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763564:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763568:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763572:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.763573:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763577:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763581:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.763583:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.763585:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763588:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1071 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.763594:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c1299c5 reply state 000000003f197e39 transno 4294984077 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763602:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.763606:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7df9dc94 (ffff9b7602507a00) 00010000:00010000:2.0:1785774841.763609:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.763610:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.763690:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+661:19339:x1872519648601472:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1117us (1262us total) trans 4294984077 rc 0/0 00000100:00100000:2.0:1785774841.763698:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24045 00010000:00010000:0.0:1785774841.763879:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.763887:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.763894:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.763957:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.763966:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.763980:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9b7731f8a600) 00010000:00010000:0.0:1785774841.763982:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.763986:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.763997:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a1086 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.764009:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.764011:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.764012:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.770554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774841.770718:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648601728 00000100:00100000:3.0:1785774841.770728:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648601728 00000100:00100000:3.0:1785774841.770779:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24046 00000100:00100000:3.0:1785774841.770786:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+661:19339:x1872519648601728:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774841.770857:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774841.770892:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155e00/0x7b7109e1d0a0454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c39f expref: 661 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.770915:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9b760572b600) 00010000:00010000:3.0:1785774841.770927:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774841.770951:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.770966:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.770976:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.770988:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.770995:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771002:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771061:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771069:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771075:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774841.771490:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 64 off9856 00010000:00010000:3.0:1785774841.771552:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771560:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771567:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771573:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771579:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771583:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771636:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774841.771653:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771658:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771664:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771669:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.771673:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771681:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771688:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:3.0:1785774841.771691:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774841.771694:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771700:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1400/0x7b7109e1d0a109b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771714:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771720:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771725:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771730:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.771733:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771739:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771746:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774841.771748:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774841.771752:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771761:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0e00/0x7b7109e1d0a108d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774841.771770:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b31ed90b reply state 000000008b2a7a04 transno 4294984078 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771780:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.771786:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xda336479 (ffff9b7602507300) 00010000:00010000:3.0:1785774841.771788:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774841.771801:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774841.771877:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+662:19339:x1872519648601728:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1090us (1332us total) trans 4294984078 rc 0/0 00000100:00100000:3.0:1785774841.771885:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24046 00010000:00010000:0.0:1785774841.774415:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.774431:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.774615:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.774620:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.774631:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.774648:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:0.0:1785774841.774651:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.774704:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.774712:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a10a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.774739:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.774741:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.774743:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.781008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774841.781156:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648601984 00000100:00100000:3.0:1785774841.781347:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648601984 00000100:00100000:2.0:1785774841.781507:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24047 00000100:00100000:2.0:1785774841.781518:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731e17c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+662:19339:x1872519648601984:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.781572:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.781600:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155a00/0x7b7109e1d0a0477 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3a6 expref: 662 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781620:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9b760572b900) 00010000:00010000:2.0:1785774841.781633:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.781752:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781770:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781783:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781804:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781812:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781819:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781886:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781893:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.781899:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.783395:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2528, 64 off169984 00010000:00010000:2.0:1785774841.783734:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783748:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783759:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783767:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783773:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783779:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783845:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.783873:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783882:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783889:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783895:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.783898:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783906:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783917:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9b7731f88c00) 00010000:00010000:2.0:1785774841.783920:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.783924:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783930:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783950:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783957:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783964:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783970:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783976:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.783979:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783986:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.783993:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.783995:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.783998:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.784004:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.784013:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000800b88fa reply state 000000000396ebb3 transno 4294984079 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.784033:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.784039:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3abc7379 (ffff9b7602507d00) 00010000:00010000:2.0:1785774841.784042:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.784045:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.784125:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731e17c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+663:19339:x1872519648601984:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2605us (3123us total) trans 4294984079 rc 0/0 00000100:00100000:2.0:1785774841.784134:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24047 00010000:00010000:1.0:1785774841.785895:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.785907:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.785918:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.785923:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.785933:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.785949:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9b7731f88c00) 00010000:00010000:1.0:1785774841.785953:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.785957:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.785968:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10be lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.785985:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.785988:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.785989:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.791765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774841.791850:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648602240 00000100:00100000:1.0:1785774841.791861:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648602240 00000100:00100000:1.0:1785774841.792037:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24048 00000100:00100000:1.0:1785774841.792048:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+663:19339:x1872519648602240:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774841.792111:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774841.792141:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a049a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3ad expref: 663 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792197:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9b7709388100) 00010000:00010000:1.0:1785774841.792208:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774841.792236:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792258:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792275:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792286:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792295:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792302:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792364:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792371:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792378:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774841.792632:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 64 off9920 00010000:00010000:1.0:1785774841.792704:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792712:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792719:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792727:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792735:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792741:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792770:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774841.792789:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792805:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792811:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792816:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.792820:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792827:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792836:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:1.0:1785774841.792838:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774841.792842:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792848:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6800/0x7b7109e1d0a10d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.792998:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793005:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793010:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793014:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793018:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.793021:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793026:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793033:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774841.793035:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.793038:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793043:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7600/0x7b7109e1d0a10c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774841.793054:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9b698e6 reply state 0000000041737c3d transno 4294984080 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793063:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.793068:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x32204679 (ffff9b7709388a00) 00010000:00010000:1.0:1785774841.793070:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774841.793072:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774841.793149:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+664:19339:x1872519648602240:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1103us (1393us total) trans 4294984080 rc 0/0 00000100:00100000:1.0:1785774841.793156:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24048 00010000:00010000:3.0:1785774841.793335:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.793341:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.793347:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.793350:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.793356:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.793364:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9b7605fd8e00) 00010000:00010000:3.0:1785774841.793366:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.793369:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.793374:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a10da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.793388:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.793390:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.793391:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.806303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.806428:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648602496 00000100:00100000:2.0:1785774841.806441:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648602496 00000100:00100000:2.0:1785774841.806543:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24049 00000100:00100000:2.0:1785774841.806554:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+664:19339:x1872519648602496:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.806622:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.806651:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a04bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3b4 expref: 664 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806681:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9b760572b000) 00010000:00010000:2.0:1785774841.806693:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.806717:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806731:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806742:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806753:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806760:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806767:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806845:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806854:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.806862:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.807323:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2529, 64 off170048 00010000:00010000:2.0:1785774841.807411:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807421:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807429:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807437:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807443:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807449:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807480:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.807503:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807509:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807515:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807524:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.807529:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807537:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807546:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:2.0:1785774841.807549:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.807552:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807559:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a10ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807577:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807584:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807590:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807596:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807600:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.807603:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807613:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807621:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.807623:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.807626:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807633:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.807643:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffe7e375 reply state 00000000bbbb0348 transno 4294984081 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807654:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.807661:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2f29d579 (ffff9b760572b200) 00010000:00010000:2.0:1785774841.807663:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.807666:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774841.807772:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.807779:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.807785:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.807790:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.807806:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.807815:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9b7731f88100) 00010000:00010000:1.0:1785774841.807817:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.807821:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.807827:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a10f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.807840:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.807842:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.807844:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.808000:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+665:19339:x1872519648602496:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1446us (1708us total) trans 4294984081 rc 0/0 00000100:00100000:2.0:1785774841.808008:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24049 00000100:00100000:1.0:1785774841.823337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.823427:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648602752 00000100:00100000:2.0:1785774841.823437:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648602752 00000100:00100000:2.0:1785774841.823503:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24050 00000100:00100000:2.0:1785774841.823512:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+665:19339:x1872519648602752:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.823570:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.823599:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef0400/0x7b7109e1d0a04e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3bb expref: 665 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823620:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9b7605fcb700) 00010000:00010000:2.0:1785774841.823630:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.823653:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823678:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823689:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823705:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823712:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823718:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823789:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823807:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.823813:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.824311:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 64 off9984 00010000:00010000:2.0:1785774841.824373:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.824381:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.824388:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.824395:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.824400:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.824405:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825024:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.825049:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825057:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825062:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825068:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.825072:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825080:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825097:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9b7731f88900) 00010000:00010000:2.0:1785774841.825101:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.825105:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825111:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a110b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825133:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825138:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825144:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825150:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825154:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.825158:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825198:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825205:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.825208:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.825211:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825220:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a10fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.825229:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003af17817 reply state 00000000b87a4270 transno 4294984082 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825240:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.825246:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xcad70079 (ffff9b7605fcbc00) 00010000:00010000:2.0:1785774841.825248:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.825252:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.825326:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+666:19339:x1872519648602752:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1812us (1996us total) trans 4294984082 rc 0/0 00000100:00100000:2.0:1785774841.825334:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24050 00010000:00010000:1.0:1785774841.836087:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774841.836105:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.836117:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dca00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774841.836121:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.836131:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.836151:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9b7731f88900) 00010000:00010000:1.0:1785774841.836154:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774841.836766:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.836776:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1112 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.836811:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.836813:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.836815:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774841.857745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.857940:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648603008 00000100:00100000:2.0:1785774841.857949:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648603008 00000100:00100000:2.0:1785774841.858009:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24051 00000100:00100000:2.0:1785774841.858019:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+666:19339:x1872519648603008:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.858079:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.858105:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a0503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3c2 expref: 666 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.858123:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9b7709388800) 00010000:00010000:2.0:1785774841.858133:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.858155:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.858972:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.858983:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.858999:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859006:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859012:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859076:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859083:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859089:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.859320:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2530, 64 off170112 00010000:00010000:2.0:1785774841.859380:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859388:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859394:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859401:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859407:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859412:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859424:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.859439:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859444:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859449:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859454:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.859458:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859464:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859471:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9b7731f88400) 00010000:00010000:2.0:1785774841.859473:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.859476:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859484:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3200/0x7b7109e1d0a1127 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859499:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859503:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859508:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859513:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859517:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.859519:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859523:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859529:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.859531:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.859533:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859537:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1119 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.859544:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c08ae5d4 reply state 000000007c930dc1 transno 4294984083 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859554:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.859559:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x71408f79 (ffff9b7709388900) 00010000:00010000:2.0:1785774841.859561:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.859563:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.859626:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+667:19339:x1872519648603008:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1608us (1888us total) trans 4294984083 rc 0/0 00000100:00100000:2.0:1785774841.859633:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24051 00010000:00010000:0.0:1785774841.860336:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.860343:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.860349:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.860353:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.860359:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.860368:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9b7731f88400) 00010000:00010000:0.0:1785774841.860370:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.860373:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.860378:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a112e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.860391:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.860392:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.860394:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774841.876227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774841.884744:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648603264 00000100:00100000:3.0:1785774841.884757:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648603264 00000100:00100000:2.0:1785774841.891228:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24052 00000100:00100000:2.0:1785774841.891242:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+667:19339:x1872519648603264:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.891309:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.891334:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0a00/0x7b7109e1d0a0526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3c9 expref: 667 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.891353:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9b7602507f00) 00010000:00010000:2.0:1785774841.891363:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.891384:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.891397:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.891406:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.891416:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.891424:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.891431:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.892878:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.892893:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.892910:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.893136:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 64 off10048 00010000:00010000:3.0:1785774841.895027:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895045:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895055:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895064:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895085:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895090:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895107:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774841.895125:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.895130:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895140:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.895144:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895150:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895188:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9b7731f88600) 00010000:00010000:3.0:1785774841.895192:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774841.895197:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895203:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a114a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895215:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.895217:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.895218:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.895250:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895257:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895263:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895268:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.895273:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895282:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895290:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9b7731f88600) 00010000:00010000:3.0:1785774841.895292:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774841.895295:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895301:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1143 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895322:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895327:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895333:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895338:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774841.895341:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895347:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895355:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774841.895357:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774841.895360:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895370:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1135 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774841.895380:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006654153a reply state 00000000fae111a0 transno 4294984084 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895390:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.895395:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa2c3e279 (ffff9b7605fcb900) 00010000:00010000:3.0:1785774841.895397:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774841.895401:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774841.896090:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+668:19339:x1872519648603264:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 4845us (19927us total) trans 4294984084 rc 0/0 00000100:00100000:3.0:1785774841.896100:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24052 00000001:00080000:2.0:1785774841.907719:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984084 is committed 00000004:00080000:2.0:1785774841.907807:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000004:00080000:2.0:1785774841.907820:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00010000:00010000:1.0:1785774841.908034:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908046:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908052:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908058:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908063:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908071:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908086:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b93e778 (ffff9b7709388e00) 00010000:00010000:1.0:1785774841.908089:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908094:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908100:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1800/0x7b7109e1d09fd5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908119:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908126:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908131:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908136:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908139:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908144:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908152:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x53a9537d (ffff9b7709388400) 00010000:00010000:1.0:1785774841.908154:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908157:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908187:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0800/0x7b7109e1d09fd9a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908199:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908205:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908210:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908215:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908218:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908224:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908232:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x756ed0d2 (ffff9b7709388500) 00010000:00010000:1.0:1785774841.908234:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908237:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908242:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1c00/0x7b7109e1d09fdbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908254:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908265:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908271:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908276:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35aa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908279:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908285:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908292:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd3ce983f (ffff9b7605dfe600) 00010000:00010000:1.0:1785774841.908294:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908297:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908302:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35aa00/0x7b7109e1d09fde0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908313:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908320:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908326:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908331:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908334:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908339:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908346:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdb9e9594 (ffff9b7709388700) 00010000:00010000:1.0:1785774841.908349:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908352:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908357:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1a00/0x7b7109e1d09fe03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908368:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908375:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908380:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908385:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908387:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908392:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908399:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe663f479 (ffff9b7706383400) 00010000:00010000:1.0:1785774841.908402:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908405:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908411:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3000/0x7b7109e1d09fe26 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908427:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908432:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908437:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908450:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908453:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908457:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908463:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf8b3f1ce (ffff9b7605dfe100) 00010000:00010000:1.0:1785774841.908465:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908468:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908473:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a400/0x7b7109e1d09fe49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908482:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908490:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908494:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908498:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35b600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908500:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908505:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908510:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d12be7b (ffff9b7605dfeb00) 00010000:00010000:1.0:1785774841.908511:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908514:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908518:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35b600/0x7b7109e1d09fe6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908527:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908532:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908536:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908540:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908543:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908548:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908553:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6e2bbd0 (ffff9b7706383600) 00010000:00010000:1.0:1785774841.908555:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908557:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908561:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2e00/0x7b7109e1d09fe8f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908570:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908575:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908579:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908583:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908585:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908590:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908596:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x40eea295 (ffff9b7706383700) 00010000:00010000:1.0:1785774841.908598:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908600:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908605:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3e00/0x7b7109e1d09feb2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908614:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908618:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908622:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908626:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908628:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908632:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908638:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea16437d (ffff9b7706383100) 00010000:00010000:1.0:1785774841.908639:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908641:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908646:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2800/0x7b7109e1d09fed5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908653:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908661:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908666:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908676:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908679:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908684:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908689:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9897527d (ffff9b77199f5d00) 00010000:00010000:1.0:1785774841.908692:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908694:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908699:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0e00/0x7b7109e1d09fef8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908709:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908713:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908718:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908722:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908725:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908730:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908735:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe423257d (ffff9b7605dfe000) 00010000:00010000:1.0:1785774841.908737:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908739:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908743:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ac00/0x7b7109e1d09ff1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908751:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908756:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908760:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908763:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908765:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908770:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908776:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x970cb47d (ffff9b77199f5400) 00010000:00010000:1.0:1785774841.908778:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908781:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908786:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0000/0x7b7109e1d09ff3e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908802:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908808:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908813:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908817:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908819:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908824:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908829:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5239df7d (ffff9b7605dfec00) 00010000:00010000:1.0:1785774841.908831:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908834:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908839:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044600/0x7b7109e1d09ff61 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908847:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908854:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908859:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908863:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.908865:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908870:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908876:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa5436e7d (ffff9b7605dfef00) 00010000:00010000:1.0:1785774841.908878:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.908880:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908885:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d09ff84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908981:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908990:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.908996:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909002:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909006:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909012:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909020:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xead1417d (ffff9b7706383a00) 00010000:00010000:1.0:1785774841.909022:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909025:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909031:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2200/0x7b7109e1d09ffa7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909045:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909051:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909056:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909062:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909065:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909070:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909077:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d30507d (ffff9b7706383900) 00010000:00010000:1.0:1785774841.909079:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909081:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909086:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3c00/0x7b7109e1d09ffca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909099:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909105:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909110:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909113:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909116:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909121:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909127:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa468b7d (ffff9b7605dfee00) 00010000:00010000:1.0:1785774841.909129:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909131:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909136:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d09ffed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909147:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909156:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909178:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909183:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909185:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909191:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909198:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdf501a7d (ffff9b7605dfed00) 00010000:00010000:1.0:1785774841.909201:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909203:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909209:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a0010 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909221:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909227:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909232:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909236:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909239:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909245:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909252:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b6840d2 (ffff9b7706383300) 00010000:00010000:1.0:1785774841.909254:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909257:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909262:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2400/0x7b7109e1d0a0033 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909273:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909279:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909284:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909290:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909293:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909299:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909308:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0674fd2 (ffff9b7604f39800) 00010000:00010000:1.0:1785774841.909310:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909314:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909319:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a800/0x7b7109e1d0a0056 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909331:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909336:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909341:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909346:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909348:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909354:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909361:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x65f522d2 (ffff9b77199f5500) 00010000:00010000:1.0:1785774841.909363:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909365:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909371:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a0079 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909382:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909392:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909397:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909401:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909404:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909410:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909417:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x38feb1d2 (ffff9b7706383000) 00010000:00010000:1.0:1785774841.909419:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909422:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909428:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2a00/0x7b7109e1d0a009c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909440:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909447:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909452:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909457:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731fcbc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909460:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909465:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909471:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7c0bdcd2 (ffff9b7604f39c00) 00010000:00010000:1.0:1785774841.909473:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909475:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909480:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcbc00/0x7b7109e1d0a00bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909490:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909496:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909501:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909505:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731fcba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909508:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909513:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909519:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x27156bd2 (ffff9b7604f39e00) 00010000:00010000:1.0:1785774841.909521:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909524:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909529:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcba00/0x7b7109e1d0a00e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909540:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909547:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909553:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909558:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909560:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909565:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909572:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfd213ed2 (ffff9b7604f39600) 00010000:00010000:1.0:1785774841.909574:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909576:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909582:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a0105 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909594:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909605:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909610:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909615:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.909618:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909624:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909632:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x81a24dd2 (ffff9b7604f39100) 00010000:00010000:1.0:1785774841.909634:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.909637:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909643:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154e00/0x7b7109e1d0a0128 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909654:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909660:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.909665:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774841.909776:0:8659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 2501 count 1 00000040:00080000:0.0:1785774841.909831:0:8659:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1785774841.909836:0:8659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1785774841.909935:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774841.909953:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671306112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774841.910020:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774841.911281:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671306112 00000100:00100000:2.0:1785774841.911293:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671306112 00000100:00100000:2.0:1785774841.911344:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5241 00000100:00100000:2.0:1785774841.911353:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3653:x1872519671306112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774841.911382:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2510 count 1 00002000:00010000:2.0:1785774841.911413:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774841.911420:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.911436:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=1083s v=(0 0) 00000100:00100000:3.0:1785774841.911647:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774841.911668:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76057d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671306240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774841.911721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785774841.912045:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.912056:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912067:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912083:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6cc088d2 (ffff9b7604f39300) 00010000:00010000:1.0:1785774841.912086:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.912091:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912098:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154600/0x7b7109e1d0a014b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912121:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912127:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912133:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912139:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.912142:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912148:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912156:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe9ca17d2 (ffff9b7702bc0600) 00010000:00010000:1.0:1785774841.912177:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.912181:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912187:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1400/0x7b7109e1d0a016e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912206:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912212:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912219:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912223:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.912226:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912231:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912238:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa846083f (ffff9b77199f5700) 00010000:00010000:1.0:1785774841.912240:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.912243:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912249:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a0191 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912263:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912273:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912280:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912285:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.912287:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912292:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912299:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb56f173f (ffff9b7605fcc300) 00010000:00010000:1.0:1785774841.912301:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.912304:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912309:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a01b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912330:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912337:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912342:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912346:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.912350:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912356:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912363:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5432ea3f (ffff9b7604f39400) 00010000:00010000:1.0:1785774841.912365:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.912368:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912374:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154800/0x7b7109e1d0a01d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912386:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912391:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912396:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912400:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.912403:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912408:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912415:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7f3c793f (ffff9b77199f5c00) 00010000:00010000:1.0:1785774841.912418:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.912421:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.912427:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a01fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.914283:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774841.914299:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.914321:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.914334:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.914342:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.914375:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774841.914545:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671306240 00000100:00100000:0.0:1785774841.914554:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671306240 00000100:00100000:0.0:1785774841.914604:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5242 00000100:00100000:0.0:1785774841.914613:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3656:x1872519671306240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774841.914646:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2510 count 1 00002000:00010000:0.0:1785774841.914699:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774841.914706:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.914715:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ce:0x0].0x0 since=1083s v=(0 0) 00010000:00010000:0.0:1785774841.914718:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774841.914722:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.914731:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.914739:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.914745:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.914760:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1785774841.915826:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3656:x1872519671306240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1209us (4099us total) trans 4294969901 rc 0/0 00000100:00100000:0.0:1785774841.915838:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5242 00010000:00010000:0.0:1785774841.915881:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774841.915888:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.916008:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774841.916015:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.916024:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774841.916028:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.916038:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.916056:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.916063:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a1158 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774841.916081:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.916083:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774841.916085:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774841.916253:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3653:x1872519671306112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4901us (6232us total) trans 4294969900 rc 0/0 00000100:00100000:2.0:1785774841.916260:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5241 00010000:00010000:0.0:1785774841.916330:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.916333:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.916341:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.916353:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.916360:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a1151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.916374:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.916376:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.916378:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785774841.916421:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76057d0700/2, rc 0, transno 4294969901 00000100:00100000:0.0:1785774841.916432:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76057d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671306240:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1785774841.916550:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916563:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916569:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916573:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.916577:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916584:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916594:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x98e9a43f (ffff9b7605fccd00) 00010000:00010000:1.0:1785774841.916596:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.916600:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916606:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a021d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916630:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916641:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916647:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.916652:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154400 already unused, calling callback (ffffffffc18b74f0) 00000004:00080000:3.0:1785774841.916759:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307e300/2, rc 0, transno 4294969900 00000100:00100000:3.0:1785774841.916775:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671306112:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1785774841.918071:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918086:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918098:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x43f3333f (ffff9b760572bc00) 00010000:00010000:1.0:1785774841.918101:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.918105:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918112:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154400/0x7b7109e1d0a0240 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918133:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918139:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918146:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918151:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.918155:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918181:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918189:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5ae1063f (ffff9b760572b800) 00010000:00010000:1.0:1785774841.918192:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.918195:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918201:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155c00/0x7b7109e1d0a0263 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918216:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918222:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918228:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918233:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.918236:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918242:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918249:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6fe0153f (ffff9b7605fcc400) 00010000:00010000:1.0:1785774841.918251:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.918254:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918260:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a0286 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918274:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918281:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918286:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918291:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.918294:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918300:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918308:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa91e503f (ffff9b7702bc0300) 00010000:00010000:1.0:1785774841.918310:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.918312:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918317:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0200/0x7b7109e1d0a02a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918332:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918343:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918348:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918352:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.918355:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918361:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918368:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfc27df3f (ffff9b760572b100) 00010000:00010000:1.0:1785774841.918371:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.918373:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918378:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606155000/0x7b7109e1d0a02cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918391:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918397:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918402:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918406:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.918409:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918415:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918422:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a358594 (ffff9b760572bb00) 00010000:00010000:1.0:1785774841.918425:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.918428:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918433:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7606154200/0x7b7109e1d0a02ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.918445:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774841.918877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774841.919329:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648603520 00000100:00100000:2.0:1785774841.919337:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648603520 00000100:00100000:2.0:1785774841.919386:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24053 00000100:00100000:2.0:1785774841.919394:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+170:19339:x1872519648603520:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774841.919534:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774841.919551:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a0549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3d0 expref: 170 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.919563:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9b7709388d00) 00010000:00010000:2.0:1785774841.919570:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774841.919590:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.919600:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.919608:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.919619:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.919626:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.919631:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920242:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920247:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920252:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.920255:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920261:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920269:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3f3f1494 (ffff9b7702bc0000) 00010000:00010000:1.0:1785774841.920271:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.920274:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920280:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1e00/0x7b7109e1d0a0312 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920296:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920301:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920306:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920310:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731fcb800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.920313:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920318:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920323:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x584c3f94 (ffff9b760572b300) 00010000:00010000:1.0:1785774841.920325:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.920327:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920332:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731fcb800/0x7b7109e1d0a0335 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920343:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920351:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920356:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920360:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.920362:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920367:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920372:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x55367694 (ffff9b7702bc0b00) 00010000:00010000:1.0:1785774841.920373:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.920376:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920380:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0600/0x7b7109e1d0a0358 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920389:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920393:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920397:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920401:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.920405:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920411:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920417:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf0e3a194 (ffff9b7702bc0200) 00010000:00010000:1.0:1785774841.920419:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.920422:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920428:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1000/0x7b7109e1d0a037b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.920438:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.920546:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.920555:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.920563:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774841.921415:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2531, 64 off170176 00010000:00010000:2.0:1785774841.922007:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922019:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922033:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922041:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922048:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922054:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922110:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774841.922129:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922135:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922140:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922147:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.922150:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922157:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922187:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9b771992a200) 00010000:00010000:2.0:1785774841.922190:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774841.922194:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922199:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a116d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922215:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922220:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922225:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922230:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922233:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774841.922236:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922240:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922246:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774841.922248:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774841.922250:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922254:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a115f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774841.922261:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea3d29e5 reply state 0000000000492f6c transno 4294984085 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922272:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774841.922277:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77cd7179 (ffff9b7605fcbf00) 00010000:00010000:2.0:1785774841.922279:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774841.922282:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774841.922350:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+167:19339:x1872519648603520:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2955us (3474us total) trans 4294984085 rc 0/0 00000100:00100000:2.0:1785774841.922357:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24053 00010000:00010000:1.0:1785774841.923598:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923606:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923612:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.923615:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923623:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923637:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2fe2b094 (ffff9b77199f5900) 00010000:00010000:1.0:1785774841.923639:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.923644:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923651:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a039e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923676:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923682:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923687:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923691:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.923694:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923699:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923706:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xc8efdb94 (ffff9b7702bc0900) 00010000:00010000:1.0:1785774841.923709:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.923711:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923716:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca0c00/0x7b7109e1d0a03c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923732:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923740:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923745:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923750:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.923752:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923757:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923763:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x45da1294 (ffff9b7602507400) 00010000:00010000:1.0:1785774841.923766:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.923769:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923774:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1400/0x7b7109e1d0a03e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923787:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923803:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923808:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923812:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.923816:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923822:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923830:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd2f04d94 (ffff9b7709388f00) 00010000:00010000:1.0:1785774841.923832:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.923835:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923840:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a0407 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923852:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923857:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923863:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923868:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.923871:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923876:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923883:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7df9dc94 (ffff9b7602507a00) 00010000:00010000:1.0:1785774841.923885:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.923888:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923893:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1a00/0x7b7109e1d0a042a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923915:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923921:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923927:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923932:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ef1600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.923935:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923940:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923947:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xda336479 (ffff9b7602507300) 00010000:00010000:1.0:1785774841.923950:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.923952:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923958:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ef1600/0x7b7109e1d0a044d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923969:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923978:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923983:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923987:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.923989:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.923994:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924001:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3abc7379 (ffff9b7602507d00) 00010000:00010000:1.0:1785774841.924003:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924005:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924010:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3400/0x7b7109e1d0a0470 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924021:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924027:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924033:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924037:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924040:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924045:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924053:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x32204679 (ffff9b7709388a00) 00010000:00010000:1.0:1785774841.924055:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924058:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924064:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a0493 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924075:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924081:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924087:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924091:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dd600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924094:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924099:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924107:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2f29d579 (ffff9b760572b200) 00010000:00010000:1.0:1785774841.924109:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924113:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924118:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a04b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924130:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924136:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924142:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924147:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418ddc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924150:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924156:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924181:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xcad70079 (ffff9b7605fcbc00) 00010000:00010000:1.0:1785774841.924184:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924187:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924192:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a04d9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924204:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924214:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924220:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924225:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924229:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924234:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924241:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x71408f79 (ffff9b7709388900) 00010000:00010000:1.0:1785774841.924243:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924246:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924251:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a04fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924262:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924268:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924274:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924279:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924282:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924288:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924297:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa2c3e279 (ffff9b7605fcb900) 00010000:00010000:1.0:1785774841.924299:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924302:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924306:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a051f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924317:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924323:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924328:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924333:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9cc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924336:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924343:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924351:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77cd7179 (ffff9b7605fcbf00) 00010000:00010000:1.0:1785774841.924353:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924355:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924360:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a0542 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924370:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924376:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924382:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924387:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924389:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924395:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924403:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe58bac79 (ffff9b7709388b00) 00010000:00010000:1.0:1785774841.924406:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924408:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924413:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a800/0x7b7109e1d0a0565 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924430:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924439:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924445:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924450:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924453:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924459:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924466:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8bf53b79 (ffff9b7605fda200) 00010000:00010000:1.0:1785774841.924468:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924470:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924475:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ba00/0x7b7109e1d0a0588 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924487:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924493:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924499:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924505:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924509:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924514:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924520:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa6a2e1ce (ffff9b7605fcb000) 00010000:00010000:1.0:1785774841.924522:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924525:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924530:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a05ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924543:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924550:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924555:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924560:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924563:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924568:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924576:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4d0c70ce (ffff9b7605fdaf00) 00010000:00010000:1.0:1785774841.924578:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924581:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924587:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b000/0x7b7109e1d0a05ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924599:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924605:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924610:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924615:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770149b000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924617:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924623:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924630:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe8b99bce (ffff9b7602507200) 00010000:00010000:1.0:1785774841.924632:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924635:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924639:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149b000/0x7b7109e1d0a05f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924653:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924661:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924666:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924671:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605a200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924673:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924678:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924684:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x91a3d2ce (ffff9b7605fda500) 00010000:00010000:1.0:1785774841.924686:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924688:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924693:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a200/0x7b7109e1d0a0614 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924705:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924710:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924715:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924719:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924722:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924727:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924733:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0d0fdce (ffff9b7605fcb500) 00010000:00010000:1.0:1785774841.924735:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924737:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924742:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a0637 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924753:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924759:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924764:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924768:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924770:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924775:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924781:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95b00cce (ffff9b7602507c00) 00010000:00010000:1.0:1785774841.924783:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924786:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924803:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fae00/0x7b7109e1d0a065a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924817:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924823:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924829:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924834:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fa400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924837:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924843:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924850:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd0dd37ce (ffff9b7602507700) 00010000:00010000:1.0:1785774841.924853:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924855:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924861:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa400/0x7b7109e1d0a067d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924876:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924885:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924891:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924896:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924898:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924904:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924911:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77c76ece (ffff9b7605fcb300) 00010000:00010000:1.0:1785774841.924913:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924916:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924921:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a06a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924934:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924940:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924946:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924952:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.924955:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924961:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924968:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe585a9ce (ffff9b7605fcc200) 00010000:00010000:1.0:1785774841.924970:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.924973:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.924979:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a06c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925000:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925005:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925011:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925016:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925018:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925023:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925031:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4de4b8ce (ffff9b7605fda400) 00010000:00010000:1.0:1785774841.925033:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925036:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925041:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ac00/0x7b7109e1d0a06e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925054:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925059:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925065:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925070:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925072:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925079:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925086:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5501ae7b (ffff9b7605fcb100) 00010000:00010000:1.0:1785774841.925088:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925091:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925096:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a0709 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925110:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925119:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925123:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925128:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925130:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925136:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925143:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3d7b (ffff9b7605fccc00) 00010000:00010000:1.0:1785774841.925145:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925148:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925154:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a072c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925189:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925195:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925200:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925205:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925208:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925213:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925221:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x170e687b (ffff9b7602507e00) 00010000:00010000:1.0:1785774841.925223:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925226:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925232:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fba00/0x7b7109e1d0a074f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925261:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925267:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925273:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925279:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605be00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925282:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925288:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925296:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95f89f7b (ffff9b7605fda600) 00010000:00010000:1.0:1785774841.925299:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925302:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925307:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605be00/0x7b7109e1d0a0772 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925322:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925327:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925332:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925337:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925340:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925346:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925354:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd905ca7b (ffff9b7605fd8400) 00010000:00010000:1.0:1785774841.925356:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925359:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925364:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a0795 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925380:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925389:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925395:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925400:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fbc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925402:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925408:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925415:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xee04d97b (ffff9b7602508200) 00010000:00010000:1.0:1785774841.925417:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925420:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925425:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbc00/0x7b7109e1d0a07b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925438:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925444:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925450:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925454:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925457:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925462:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925470:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdfb2047b (ffff9b7602508800) 00010000:00010000:1.0:1785774841.925472:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925475:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925479:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb400/0x7b7109e1d0a07db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925491:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925497:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925503:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925507:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925510:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925515:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925522:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x869c3b7b (ffff9b7605fd8b00) 00010000:00010000:1.0:1785774841.925524:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925527:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925532:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030e00/0x7b7109e1d0a07fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925544:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925550:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925555:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925560:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925563:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925568:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925575:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9bba767b (ffff9b7602508900) 00010000:00010000:1.0:1785774841.925577:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925579:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925585:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fac00/0x7b7109e1d0a0821 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925598:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925608:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925613:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925618:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925621:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925626:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925633:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b9857b (ffff9b7605fd8700) 00010000:00010000:1.0:1785774841.925635:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925638:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925643:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030a00/0x7b7109e1d0a0844 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925657:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925663:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925668:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925673:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700030600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925677:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925682:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925689:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb4d1abd0 (ffff9b7605fd8800) 00010000:00010000:1.0:1785774841.925691:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925694:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925699:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030600/0x7b7109e1d0a0867 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925712:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925717:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925722:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925726:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925729:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925734:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925741:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7db3ad0 (ffff9b760562fb00) 00010000:00010000:1.0:1785774841.925743:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925746:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925752:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a088a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925765:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925771:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925776:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925780:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9de00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925782:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925788:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925808:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x798865d0 (ffff9b760562fe00) 00010000:00010000:1.0:1785774841.925810:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925813:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925818:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a08ad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925832:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925844:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925850:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925855:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b760605b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925858:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925864:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925872:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0729cd0 (ffff9b7605fdaa00) 00010000:00010000:1.0:1785774841.925874:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925877:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925883:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b200/0x7b7109e1d0a08d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925905:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925912:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925918:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925923:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925927:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925932:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925940:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe37fc7d0 (ffff9b7605fd8900) 00010000:00010000:1.0:1785774841.925942:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.925945:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925951:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a08f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925966:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925973:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925979:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925984:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.925987:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.925993:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926000:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x507ed6d0 (ffff9b760562f900) 00010000:00010000:1.0:1785774841.926002:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926005:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926009:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a0916 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926021:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926028:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926034:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926039:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926041:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926047:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926055:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea2c01d0 (ffff9b7605fda900) 00010000:00010000:1.0:1785774841.926057:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926060:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926065:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a0939 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926078:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926088:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926094:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926099:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926102:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926108:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926115:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe91638d0 (ffff9b7605fda000) 00010000:00010000:1.0:1785774841.926117:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926120:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926125:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1c00/0x7b7109e1d0a095c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926138:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926145:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926150:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926156:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926179:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926186:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926194:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfe3473d0 (ffff9b760562f600) 00010000:00010000:1.0:1785774841.926196:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926199:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926205:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a097f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926223:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926229:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926234:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926239:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926241:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926247:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926254:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x133382d0 (ffff9b7731f8af00) 00010000:00010000:1.0:1785774841.926255:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926258:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926264:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1200/0x7b7109e1d0a09a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926277:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926284:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926290:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926295:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926298:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926303:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926310:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xeedd9295 (ffff9b7731f8a000) 00010000:00010000:1.0:1785774841.926312:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926315:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926321:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0400/0x7b7109e1d0a09c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926336:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926345:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926351:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926355:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926358:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926364:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926371:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6be72195 (ffff9b760562ff00) 00010000:00010000:1.0:1785774841.926374:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926376:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926381:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a09e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926394:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926400:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926405:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926410:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fa800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926413:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926419:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926427:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6d724c95 (ffff9b7602508e00) 00010000:00010000:1.0:1785774841.926430:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926433:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926438:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa800/0x7b7109e1d0a0a0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926451:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926456:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926462:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926467:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926469:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926475:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926482:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a5c8395 (ffff9b760562f800) 00010000:00010000:1.0:1785774841.926484:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926487:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926492:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a0a2e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926505:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926511:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926517:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926521:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926524:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926530:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926537:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x609ae95 (ffff9b760562f300) 00010000:00010000:1.0:1785774841.926539:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926542:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926548:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8600/0x7b7109e1d0a0a51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926562:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926571:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926577:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926582:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926584:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926591:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926598:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9d08bd95 (ffff9b7731f8ad00) 00010000:00010000:1.0:1785774841.926600:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926603:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926608:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1e00/0x7b7109e1d0a0a74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926623:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926629:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926635:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926640:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731f81600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926643:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926649:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926657:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3615e895 (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774841.926660:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926663:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926669:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81600/0x7b7109e1d0a0a97 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926684:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926690:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926696:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926701:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926704:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926710:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926718:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3001f95 (ffff9b7731f8a100) 00010000:00010000:1.0:1785774841.926721:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926724:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926729:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1600/0x7b7109e1d0a0aba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926742:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926748:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926754:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926759:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.926761:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926766:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926773:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x35965a95 (ffff9b7731f8ac00) 00010000:00010000:1.0:1785774841.926775:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.926777:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.926782:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0a00/0x7b7109e1d0a0add lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.933954:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774841.933970:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.933981:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774841.933986:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.934001:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.934020:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9b771992a200) 00010000:00010000:0.0:1785774841.934023:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774841.934028:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.934035:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1174 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774841.934060:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.934062:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774841.934064:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774841.937035:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937055:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937062:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937068:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.937072:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937079:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937094:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x74956995 (ffff9b760562f500) 00010000:00010000:1.0:1785774841.937097:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.937101:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937107:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a0b00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937134:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937140:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937145:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937150:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.937153:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937261:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937272:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b93e778 (ffff9b7709388e00) 00010000:00010000:1.0:1785774841.937274:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.937278:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937283:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a0b1c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937304:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937310:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937316:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937322:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c0fb200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.937324:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937330:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937338:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x53a9537d (ffff9b7709388400) 00010000:00010000:1.0:1785774841.937340:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.937343:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937348:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb200/0x7b7109e1d0a0b38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937363:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937369:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937374:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937379:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.937382:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937388:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937396:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x756ed0d2 (ffff9b7709388500) 00010000:00010000:1.0:1785774841.937398:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.937401:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937406:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a0b54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937421:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937433:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.937439:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938517:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7731f81200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.938521:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938527:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938537:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd3ce983f (ffff9b7605dfe600) 00010000:00010000:1.0:1785774841.938539:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.938542:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938547:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f81200/0x7b7109e1d0a0b70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938572:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938577:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938582:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938586:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.938589:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938595:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938600:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdb9e9594 (ffff9b7709388700) 00010000:00010000:1.0:1785774841.938602:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.938604:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938608:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a0b8c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938620:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938626:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938631:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938635:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.938637:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938642:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.938649:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe663f479 (ffff9b7706383400) 00010000:00010000:1.0:1785774841.938652:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.939513:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939524:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a0ba8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939547:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939555:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939562:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939568:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.939571:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939578:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939588:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf8b3f1ce (ffff9b7605dfe100) 00010000:00010000:1.0:1785774841.939592:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.939595:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939602:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a0bc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939617:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939628:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939634:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939638:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.939641:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.939647:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940254:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d12be7b (ffff9b7605dfeb00) 00010000:00010000:1.0:1785774841.940259:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.940263:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940270:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a0be0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940288:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940294:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940301:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940306:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.940309:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940316:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940324:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6e2bbd0 (ffff9b7706383600) 00010000:00010000:1.0:1785774841.940326:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.940329:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940334:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a0bfc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940347:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940353:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940360:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940365:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.940368:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940374:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940380:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x40eea295 (ffff9b7706383700) 00010000:00010000:1.0:1785774841.940382:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.940386:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940393:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a0c18 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940407:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940414:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940420:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940425:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.940427:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940433:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.940439:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea16437d (ffff9b7706383100) 00010000:00010000:1.0:1785774841.943530:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.943541:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943549:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a0c34 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943583:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943593:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943599:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943603:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.943607:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943613:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943626:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9897527d (ffff9b77199f5d00) 00010000:00010000:1.0:1785774841.943628:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.943631:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943636:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a0c50 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943650:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943656:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943662:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.943668:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.944124:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944132:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944141:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe423257d (ffff9b7605dfe000) 00010000:00010000:1.0:1785774841.944144:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.944147:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944152:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3a00/0x7b7109e1d0a0c6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944527:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944536:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944543:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944549:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.944552:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944559:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944567:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x970cb47d (ffff9b77199f5400) 00010000:00010000:1.0:1785774841.944571:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.944575:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944581:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2c00/0x7b7109e1d0a0c88 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944594:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944600:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944607:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944612:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.944615:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944621:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944628:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5239df7d (ffff9b7605dfec00) 00010000:00010000:1.0:1785774841.944631:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.944634:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944640:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a0ca4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.944654:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945275:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945280:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945284:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b1a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.945287:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945293:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945301:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa5436e7d (ffff9b7605dfef00) 00010000:00010000:1.0:1785774841.945303:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.945306:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945311:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1a00/0x7b7109e1d0a0cc0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945328:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945333:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945338:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945342:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.945345:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945350:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945355:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xead1417d (ffff9b7706383a00) 00010000:00010000:1.0:1785774841.945357:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.945360:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945364:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a0cdc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945374:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945379:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945383:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945387:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.945389:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945394:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945399:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7d30507d (ffff9b7706383900) 00010000:00010000:1.0:1785774841.945401:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.945404:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945409:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7e00/0x7b7109e1d0a0cf8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945421:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945426:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945431:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.945435:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.945437:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948013:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948033:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa468b7d (ffff9b7605dfee00) 00010000:00010000:1.0:1785774841.948035:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.948040:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948047:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7a00/0x7b7109e1d0a0d14 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948097:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948110:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948117:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948123:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.948127:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948133:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948142:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdf501a7d (ffff9b7605dfed00) 00010000:00010000:1.0:1785774841.948144:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.948148:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948154:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7200/0x7b7109e1d0a0d30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948535:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948542:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948549:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948555:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.948559:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948566:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948574:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b6840d2 (ffff9b7706383300) 00010000:00010000:1.0:1785774841.948577:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.948581:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948587:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a0d4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948601:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948608:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948614:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948619:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.948622:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948628:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948636:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0674fd2 (ffff9b7604f39800) 00010000:00010000:1.0:1785774841.948639:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.948642:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.948648:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a0d68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949542:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949550:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949556:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949561:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.949564:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949570:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949580:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x65f522d2 (ffff9b77199f5500) 00010000:00010000:1.0:1785774841.949583:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.949586:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949591:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a0d84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949607:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949619:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949625:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949631:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.949634:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949640:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.949648:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x38feb1d2 (ffff9b7706383000) 00010000:00010000:1.0:1785774841.949651:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.949654:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950311:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6200/0x7b7109e1d0a0da0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950330:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950335:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950341:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950345:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.950348:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950353:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950361:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7c0bdcd2 (ffff9b7604f39c00) 00010000:00010000:1.0:1785774841.950363:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.950365:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950370:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a0dbc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950380:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950385:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950390:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950394:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.950396:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950400:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950407:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x27156bd2 (ffff9b7604f39e00) 00010000:00010000:1.0:1785774841.950409:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.950412:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950418:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7c00/0x7b7109e1d0a0dd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950431:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.950438:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951252:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951258:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.951261:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951268:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951276:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfd213ed2 (ffff9b7604f39600) 00010000:00010000:1.0:1785774841.951279:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.951282:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951287:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a0df4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951320:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951328:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951333:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951337:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.951339:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951344:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951350:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x81a24dd2 (ffff9b7604f39100) 00010000:00010000:1.0:1785774841.951352:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.951354:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951358:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a0e10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951370:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951374:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951379:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951383:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.951386:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951391:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951396:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6cc088d2 (ffff9b7604f39300) 00010000:00010000:1.0:1785774841.951398:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.951400:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951405:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a0e2c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951414:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951419:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951423:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951427:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.951429:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.951434:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952102:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe9ca17d2 (ffff9b7702bc0600) 00010000:00010000:1.0:1785774841.952107:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.952112:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952120:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6e00/0x7b7109e1d0a0e48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952139:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952146:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952153:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952255:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7700031400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.952259:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952266:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952276:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa846083f (ffff9b77199f5700) 00010000:00010000:1.0:1785774841.952278:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.952281:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952288:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031400/0x7b7109e1d0a0e64 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952311:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952322:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952329:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952334:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.952337:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952344:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952351:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb56f173f (ffff9b7605fcc300) 00010000:00010000:1.0:1785774841.952353:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.952356:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952362:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6400/0x7b7109e1d0a0e80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952375:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952382:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952388:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952393:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.952397:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952403:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952410:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5432ea3f (ffff9b7604f39400) 00010000:00010000:1.0:1785774841.952413:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.952416:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952421:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6600/0x7b7109e1d0a0e9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.952435:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953255:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953263:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953269:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.953272:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953279:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953289:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7f3c793f (ffff9b77199f5c00) 00010000:00010000:1.0:1785774841.953292:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.953295:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953301:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a0eb8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953321:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953327:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953333:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953339:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.953342:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953348:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953355:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x98e9a43f (ffff9b7605fccd00) 00010000:00010000:1.0:1785774841.953357:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.953360:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953366:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ba00/0x7b7109e1d0a0ed4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953380:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953392:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953398:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953403:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.953405:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953411:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953417:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x43f3333f (ffff9b760572bc00) 00010000:00010000:1.0:1785774841.953419:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.953422:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953427:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a0ef0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.953438:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954517:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954525:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954531:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.954535:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954543:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954554:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5ae1063f (ffff9b760572b800) 00010000:00010000:1.0:1785774841.954556:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.954560:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954566:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6000/0x7b7109e1d0a0f0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954586:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954592:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954598:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954603:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35ae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.954606:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954612:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954618:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6fe0153f (ffff9b7605fcc400) 00010000:00010000:1.0:1785774841.954620:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.954623:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954629:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35ae00/0x7b7109e1d0a0f28 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954645:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.954651:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956350:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956358:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.956362:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956369:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956380:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa91e503f (ffff9b7702bc0300) 00010000:00010000:1.0:1785774841.956382:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.956385:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956390:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7800/0x7b7109e1d0a0f44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956415:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956424:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956429:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956433:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.956435:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956439:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956893:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfc27df3f (ffff9b760572b100) 00010000:00010000:1.0:1785774841.956896:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.956899:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956904:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6a00/0x7b7109e1d0a0f60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956921:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956926:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956931:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956935:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.956938:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956943:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956948:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a358594 (ffff9b760572bb00) 00010000:00010000:1.0:1785774841.956950:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.956952:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956957:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0800/0x7b7109e1d0a0f7c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956967:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956972:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956977:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956981:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ca1600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.956983:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956987:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.956992:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3f3f1494 (ffff9b7702bc0000) 00010000:00010000:1.0:1785774841.956994:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.956997:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957002:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ca1600/0x7b7109e1d0a0f98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957011:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957016:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957020:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957024:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.957027:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957031:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957037:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x584c3f94 (ffff9b760572b300) 00010000:00010000:1.0:1785774841.957039:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.957041:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957046:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa6c00/0x7b7109e1d0a0fb4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957056:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957064:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957069:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957072:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35be00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.957075:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957079:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957084:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x55367694 (ffff9b7702bc0b00) 00010000:00010000:1.0:1785774841.957086:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.957088:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957092:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35be00/0x7b7109e1d0a0fd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957106:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957110:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957114:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957118:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.957121:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957126:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957133:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xf0e3a194 (ffff9b7702bc0200) 00010000:00010000:1.0:1785774841.957135:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.957138:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957143:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7400/0x7b7109e1d0a0fec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.957155:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960855:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960868:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960874:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.960879:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960888:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960906:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2fe2b094 (ffff9b77199f5900) 00010000:00010000:1.0:1785774841.960909:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.960915:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960921:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1008 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960961:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960968:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960974:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960979:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773c35a600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.960981:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960986:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.960994:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xc8efdb94 (ffff9b7702bc0900) 00010000:00010000:1.0:1785774841.960996:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.960999:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961004:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a600/0x7b7109e1d0a1024 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961028:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961039:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961045:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961050:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961053:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961059:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961066:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x45da1294 (ffff9b7602507400) 00010000:00010000:1.0:1785774841.961068:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961072:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961078:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a1040 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961096:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961104:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961110:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961115:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961118:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961123:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961130:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd2f04d94 (ffff9b7709388f00) 00010000:00010000:1.0:1785774841.961132:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961135:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961139:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a105c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961154:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961173:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961180:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961186:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961189:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961194:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961202:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7df9dc94 (ffff9b7602507a00) 00010000:00010000:1.0:1785774841.961205:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961208:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961214:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1078 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961230:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961236:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961242:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961247:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057b0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961249:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961255:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961263:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xda336479 (ffff9b7602507300) 00010000:00010000:1.0:1785774841.961265:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961268:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961274:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0600/0x7b7109e1d0a1094 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961287:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961299:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961306:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961311:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961314:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961321:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961327:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3abc7379 (ffff9b7602507d00) 00010000:00010000:1.0:1785774841.961330:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961332:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961339:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2600/0x7b7109e1d0a10b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961352:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961359:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961366:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961371:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605fa7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961375:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961381:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961388:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x32204679 (ffff9b7709388a00) 00010000:00010000:1.0:1785774841.961390:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961393:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961399:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605fa7000/0x7b7109e1d0a10cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961415:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961422:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961428:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961433:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961436:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961441:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961448:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x2f29d579 (ffff9b760572b200) 00010000:00010000:1.0:1785774841.961450:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961454:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961460:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a10e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961473:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961480:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961486:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961491:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961494:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961500:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961507:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xcad70079 (ffff9b7605fcbc00) 00010000:00010000:1.0:1785774841.961509:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961512:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961518:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1104 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961531:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961543:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961549:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961554:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961557:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961564:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961570:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x71408f79 (ffff9b7709388900) 00010000:00010000:1.0:1785774841.961573:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961576:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961583:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a1120 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961594:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961600:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961607:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961612:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774841.961615:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961621:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961628:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa2c3e279 (ffff9b7605fcb900) 00010000:00010000:1.0:1785774841.961630:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774841.961633:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774841.961638:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a113c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774842.010732:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.012578:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648603776 00000100:00100000:2.0:1785774842.012593:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648603776 00000100:00100000:2.0:1785774842.012700:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24054 00000100:00100000:2.0:1785774842.012709:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:19339:x1872519648603776:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.012770:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.012808:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a400/0x7b7109e1d0a056c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3d7 expref: 55 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.012831:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9b7709388c00) 00010000:00010000:2.0:1785774842.012844:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.012878:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.012907:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.012920:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.012941:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.013136:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.013145:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.013286:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.013296:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.013303:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.013888:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 64 off10112 00000100:00080000:1.0:1785774842.014573:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785774842.014867:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.014881:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.014891:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.014899:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.014915:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.014922:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.015133:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.015143:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.015152:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.015157:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.015189:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.015215:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9b771992a400) 00010000:00010000:1.0:1785774842.015219:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.015224:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.015234:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.015238:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.015240:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.016535:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.016548:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1190 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016591:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016598:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016605:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016611:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.016615:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016623:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016636:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9b771992a400) 00010000:00010000:2.0:1785774842.016639:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.016643:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016650:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1189 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016693:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016700:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016706:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016712:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016717:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.016720:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016726:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016735:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.016738:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.016741:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016746:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a117b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.016756:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000628d3a2c reply state 00000000da318425 transno 4294984086 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016767:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.016775:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe58bac79 (ffff9b771992a600) 00010000:00010000:2.0:1785774842.016778:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.016780:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.016881:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:19339:x1872519648603776:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 4167us (6155us total) trans 4294984086 rc 0/0 00000100:00100000:2.0:1785774842.016890:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24054 00000100:00100000:3.0:1785774842.030454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.033825:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648604032 00000100:00100000:0.0:1785774842.033841:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648604032 00000100:00100000:0.0:1785774842.034150:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24055 00000100:00100000:0.0:1785774842.034176:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:19339:x1872519648604032:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.034250:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.034279:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b400/0x7b7109e1d0a058f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3de expref: 56 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034309:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9b7605fda700) 00010000:00010000:0.0:1785774842.034321:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.034347:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034362:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034376:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034391:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034397:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034404:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034465:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034473:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034479:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.034724:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2532, 64 off170240 00010000:00010000:0.0:1785774842.034808:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034817:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034826:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034833:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034840:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034846:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034863:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.034883:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034889:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034906:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034914:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.034920:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034928:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034936:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9b7602508900) 00010000:00010000:0.0:1785774842.034939:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.034952:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034960:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034982:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034988:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034994:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.034999:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.035004:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.035007:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.035013:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.035031:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.035033:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.035037:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.035042:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1197 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.035052:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006dbcf09d reply state 0000000082a0122b transno 4294984087 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.035064:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.035070:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8bf53b79 (ffff9b7602508e00) 00010000:00010000:0.0:1785774842.035072:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.035075:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.035240:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+57:19339:x1872519648604032:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1079us (4795us total) trans 4294984087 rc 0/0 00000100:00100000:0.0:1785774842.035249:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24055 00010000:00010000:1.0:1785774842.035335:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.035343:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.035349:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.035353:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.035360:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.035369:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9b7602508900) 00010000:00010000:1.0:1785774842.035372:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.035375:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.035380:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a11ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.035394:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.035396:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.035398:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774842.052681:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774842.052751:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648604288 00000100:00100000:3.0:1785774842.052762:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648604288 00000100:00100000:3.0:1785774842.052834:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24056 00000100:00100000:3.0:1785774842.052845:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+57:19339:x1872519648604288:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774842.052913:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774842.052952:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a05b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3e5 expref: 57 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.052971:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9b7605fcbe00) 00010000:00010000:3.0:1785774842.052981:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774842.053003:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053032:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053044:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053059:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053067:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053073:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053133:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053141:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053147:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.053398:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 64 off10176 00010000:00010000:3.0:1785774842.053463:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053471:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053479:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053486:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053492:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053498:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053516:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774842.053532:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053537:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053543:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053549:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.053552:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053559:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053568:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9b7731f8a100) 00010000:00010000:3.0:1785774842.053570:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774842.053573:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053583:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053597:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053603:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053608:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053614:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053619:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.053621:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053627:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053634:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774842.053636:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774842.053639:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053644:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774842.053652:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000615e5027 reply state 0000000036cf2dd0 transno 4294984088 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053662:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.053668:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa6a2e1ce (ffff9b7731f8ac00) 00010000:00010000:3.0:1785774842.053670:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774842.053673:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774842.053737:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:19339:x1872519648604288:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 894us (1064us total) trans 4294984088 rc 0/0 00000100:00100000:3.0:1785774842.053744:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24056 00010000:00010000:1.0:1785774842.054434:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.054440:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.054447:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.054450:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.054457:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.054467:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9b7731f8a100) 00010000:00010000:1.0:1785774842.054469:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.054472:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.054477:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a11c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.054489:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.054491:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.054493:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.079220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774842.079511:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648604544 00000100:00100000:3.0:1785774842.079524:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648604544 00000100:00100000:3.0:1785774842.079594:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24057 00000100:00100000:3.0:1785774842.079604:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:19339:x1872519648604544:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774842.079676:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774842.079707:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a000/0x7b7109e1d0a05d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3ec expref: 58 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079726:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9b7605fda800) 00010000:00010000:3.0:1785774842.079736:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774842.079760:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079777:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079787:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079817:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079824:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079830:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079903:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079911:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.079919:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.080451:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2533, 64 off170304 00010000:00010000:3.0:1785774842.080521:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080530:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080538:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080545:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080551:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080558:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080579:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774842.080597:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080603:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080618:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080624:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.080628:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080634:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080643:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9b7731f8a000) 00010000:00010000:3.0:1785774842.080646:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774842.080650:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080657:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a11dd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080672:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080683:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080689:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080695:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080700:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.080704:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080710:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080717:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774842.080720:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774842.080724:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080730:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a11cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774842.080740:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2e7d371 reply state 0000000094e5aff8 transno 4294984089 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080751:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.080757:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4d0c70ce (ffff9b7731f8ad00) 00010000:00010000:3.0:1785774842.080760:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774842.080763:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774842.081335:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774842.081342:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.081348:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774842.081352:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.081357:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.081366:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9b7731f8a000) 00010000:00010000:0.0:1785774842.081368:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774842.081371:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.081377:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a11e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.081390:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.081392:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.081394:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.081446:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:19339:x1872519648604544:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1842us (2234us total) trans 4294984089 rc 0/0 00000100:00100000:3.0:1785774842.081455:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24057 00000100:00100000:3.0:1785774842.122151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.122359:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648604800 00000100:00100000:0.0:1785774842.122372:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648604800 00000100:00100000:0.0:1785774842.122447:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24058 00000100:00100000:0.0:1785774842.122458:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:19339:x1872519648604800:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.122523:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.122553:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149ba00/0x7b7109e1d0a05f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3f3 expref: 59 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122575:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9b7602507100) 00010000:00010000:0.0:1785774842.122585:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.122609:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122622:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122631:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122643:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122650:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122655:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122715:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122722:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.122728:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.122959:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 64 off10240 00010000:00010000:0.0:1785774842.123213:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123222:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123229:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123236:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123242:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123247:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123266:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.123295:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123301:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123307:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123319:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.123322:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123329:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123337:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9b7602508200) 00010000:00010000:0.0:1785774842.123340:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.123343:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123350:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a11f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123364:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123380:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123386:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123391:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.123394:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123399:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123410:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.123412:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.123414:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.123419:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a11eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.123428:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea0135f6 reply state 0000000042c6619d transno 4294984090 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.123612:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.123619:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.123625:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.123628:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.123635:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.123643:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9b7602508200) 00010000:00010000:1.0:1785774842.123646:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.123648:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.123654:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a1200 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.123666:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.123669:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.123671:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.124372:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.124384:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe8b99bce (ffff9b7602508800) 00010000:00010000:0.0:1785774842.124387:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.124392:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.125416:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:19339:x1872519648604800:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2951us (3268us total) trans 4294984090 rc 0/0 00000100:00100000:0.0:1785774842.125428:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24058 00000100:00100000:1.0:1785774842.152664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774842.152814:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648605056 00000100:00100000:3.0:1785774842.152824:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648605056 00000100:00100000:3.0:1785774842.152883:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24059 00000100:00100000:3.0:1785774842.152901:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:19339:x1872519648605056:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774842.152972:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774842.153000:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605aa00/0x7b7109e1d0a061b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c3fa expref: 60 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153029:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9b7605fdae00) 00010000:00010000:3.0:1785774842.153039:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774842.153061:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153074:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153082:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153096:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153103:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153114:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153218:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153226:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153233:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.153482:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2534, 64 off170368 00010000:00010000:3.0:1785774842.153555:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153564:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153572:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153579:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153585:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153590:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153605:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774842.153623:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153630:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153636:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153641:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.153646:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153653:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153662:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:3.0:1785774842.153664:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774842.153668:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153687:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1215 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153703:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153709:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153715:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153724:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153729:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.153732:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153738:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153746:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774842.153748:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774842.153751:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153757:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1207 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774842.153766:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d5e448e reply state 00000000c528bc35 transno 4294984091 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153776:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.153781:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x91a3d2ce (ffff9b7731f8af00) 00010000:00010000:3.0:1785774842.153783:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774842.153785:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774842.153878:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:19339:x1872519648605056:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 985us (1230us total) trans 4294984091 rc 0/0 00000100:00100000:3.0:1785774842.153886:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24059 00010000:00010000:1.0:1785774842.154915:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.154923:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.154931:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.154935:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.154955:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.154969:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9b7731f8a900) 00010000:00010000:1.0:1785774842.154972:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.154975:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.154981:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a121c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.155000:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.155002:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.155004:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.181276:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.181389:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648605312 00000100:00100000:0.0:1785774842.181399:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648605312 00000100:00100000:0.0:1785774842.181451:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24060 00000100:00100000:0.0:1785774842.181460:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:19339:x1872519648605312:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.181517:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.181545:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a063e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c401 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181570:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9b7605fcbb00) 00010000:00010000:0.0:1785774842.181579:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.181601:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181614:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181623:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181637:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181644:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181650:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181719:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181727:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.181734:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.181967:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 64 off10304 00000004:00080000:0.0:1785774842.181975:0:8469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1084032813832ns, next at 1085032811155ns, rc = 0 00010000:00010000:0.0:1785774842.182136:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182146:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182154:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182296:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182304:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182311:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182407:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.182426:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182434:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182440:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182446:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.182450:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182458:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182468:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9b7602508100) 00010000:00010000:0.0:1785774842.182471:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.182474:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182480:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1231 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182494:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182500:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182506:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182511:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182516:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.182519:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182525:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182532:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.182534:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.182537:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182545:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a1223 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.182554:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002012d5a3 reply state 00000000b6b9dbfd transno 4294984092 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182564:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.182569:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0d0fdce (ffff9b7602508000) 00010000:00010000:0.0:1785774842.182571:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.182573:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.182648:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:19339:x1872519648605312:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1188us (1379us total) trans 4294984092 rc 0/0 00000100:00100000:0.0:1785774842.182783:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24060 00000100:00100000:3.0:1785774842.190803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.190927:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648605568 00000100:00100000:2.0:1785774842.190938:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648605568 00000100:00100000:2.0:1785774842.190997:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24061 00000100:00100000:2.0:1785774842.191006:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:19339:x1872519648605568:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.191071:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.191098:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb800/0x7b7109e1d0a0661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c408 expref: 62 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191115:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9b7602507500) 00010000:00010000:2.0:1785774842.191125:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.191146:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191177:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191187:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191199:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191206:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191211:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191266:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191273:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191280:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.191512:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2535, 64 off170432 00000004:00080000:2.0:1785774842.191519:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1084042358159ns, next at 1085042356125ns, rc = 0 00010000:00010000:2.0:1785774842.191780:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191815:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191824:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191830:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191837:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.191847:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193124:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774842.193133:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193140:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.193144:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193157:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193190:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9b7602508100) 00010000:00010000:1.0:1785774842.193192:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.193196:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193201:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1238 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193217:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.193220:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193225:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.193227:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193233:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193239:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9b771992a100) 00010000:00010000:1.0:1785774842.193241:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.193244:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.193251:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.193253:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.193255:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.196583:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785774842.196596:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1254 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.196637:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.196645:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197511:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197520:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.197525:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197532:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197546:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9b771992a100) 00010000:00010000:2.0:1785774842.197549:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.197552:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197557:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a124d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197587:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197593:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197598:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197603:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197606:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.197609:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197613:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197619:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.197622:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.197624:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197629:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a123f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.197638:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2a73d2b reply state 00000000fff2c0e9 transno 4294984093 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197649:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.197668:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95b00cce (ffff9b771992a400) 00010000:00010000:2.0:1785774842.197671:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.197674:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.197832:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:19339:x1872519648605568:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 6823us (7042us total) trans 4294984093 rc 0/0 00000100:00100000:2.0:1785774842.197842:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24061 00010000:00010000:0.0:1785774842.199135:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.216749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774842.217047:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648605824 00000100:00100000:3.0:1785774842.217057:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648605824 00000100:00100000:3.0:1785774842.217117:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24062 00000100:00100000:3.0:1785774842.217127:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:19339:x1872519648605824:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774842.217220:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774842.218014:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa600/0x7b7109e1d0a0684 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c40f expref: 63 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218043:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9b7602507800) 00010000:00010000:3.0:1785774842.218054:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774842.218077:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218092:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218102:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218117:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218125:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218133:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218226:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218235:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.218340:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.219408:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 64 off10368 00010000:00010000:3.0:1785774842.220007:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220265:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220278:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220288:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220295:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220302:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220325:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774842.220348:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220355:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220365:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220370:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.220374:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220382:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220392:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:3.0:1785774842.220395:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774842.220399:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220404:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1269 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220424:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220429:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220434:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220504:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220509:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.220512:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220517:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220524:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774842.220527:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774842.220529:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220534:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a125b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774842.220542:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001171b9a9 reply state 000000008b2a7a04 transno 4294984094 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220551:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.220556:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd0dd37ce (ffff9b7731f8a600) 00010000:00010000:3.0:1785774842.220558:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774842.220561:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774842.220756:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:19339:x1872519648605824:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 3627us (4016us total) trans 4294984094 rc 0/0 00000100:00100000:3.0:1785774842.220766:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24062 00010000:00010000:1.0:1785774842.220901:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.220908:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.220914:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.220917:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.220924:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.220933:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:1.0:1785774842.220935:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.220938:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.220953:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1270 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.220968:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.220970:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.220973:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.235559:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.236125:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648606080 00000100:00100000:0.0:1785774842.236135:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648606080 00000100:00100000:0.0:1785774842.236237:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24063 00000100:00100000:0.0:1785774842.236255:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:19339:x1872519648606080:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.236310:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.236336:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a06a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c416 expref: 64 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236354:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9b7605fcba00) 00010000:00010000:0.0:1785774842.236363:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.236384:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236398:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236407:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236419:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236425:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236431:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236500:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236508:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.236514:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.237640:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2536, 64 off170496 00010000:00010000:0.0:1785774842.238182:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238387:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238396:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238403:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238409:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238414:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238426:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.238498:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238504:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238510:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238515:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.238518:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238524:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238532:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9b7602508200) 00010000:00010000:0.0:1785774842.238535:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.238538:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238547:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1285 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238564:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238569:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238574:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238579:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238583:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.238585:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238589:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238594:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.238596:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.238599:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238603:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a1277 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.238610:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062f4478d reply state 00000000bef03ddb transno 4294984095 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238619:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.238624:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77c76ece (ffff9b7602508100) 00010000:00010000:0.0:1785774842.238626:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.238628:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.239015:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:19339:x1872519648606080:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2758us (3462us total) trans 4294984095 rc 0/0 00010000:00010000:1.0:1785774842.239093:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.239099:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.239105:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.239108:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.239113:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.239121:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9b7602508200) 00010000:00010000:1.0:1785774842.239125:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.239128:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.239134:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a128c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.239156:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.239177:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.239180:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774842.240083:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24063 00000100:00100000:0.0:1785774842.250872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774842.251054:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648606336 00000100:00100000:3.0:1785774842.251064:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648606336 00000100:00100000:3.0:1785774842.251119:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24064 00000100:00100000:3.0:1785774842.251128:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:19339:x1872519648606336:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774842.251220:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774842.251252:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a06ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c41d expref: 65 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251276:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9b7605fcc900) 00010000:00010000:3.0:1785774842.251285:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774842.251305:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251319:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251329:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251342:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251349:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251356:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251414:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251422:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.251428:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.251649:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].35, 64 off10432 00010000:00010000:0.0:1785774842.252606:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252619:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252627:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252635:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252642:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252648:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252683:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.252702:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252709:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252716:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252723:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.252727:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252734:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252743:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:0.0:1785774842.252746:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.252750:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252756:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a12a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252771:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252776:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252781:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252786:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.252799:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252805:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252813:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.252815:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.252818:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252824:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1293 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.252833:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fd613e4 reply state 000000003f197e39 transno 4294984096 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252844:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.252850:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe585a9ce (ffff9b7731f8a400) 00010000:00010000:0.0:1785774842.252852:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.252854:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.252938:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:19339:x1872519648606336:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1809us (2073us total) trans 4294984096 rc 0/0 00000100:00100000:0.0:1785774842.252953:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24064 00010000:00010000:1.0:1785774842.256051:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.256063:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.256073:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.256076:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.256085:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.256101:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9b7731f8ab00) 00010000:00010000:1.0:1785774842.256103:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.256106:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.256112:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a12a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.256132:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.256134:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.256135:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.278031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.278109:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648606592 00000100:00100000:0.0:1785774842.278119:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648606592 00000100:00100000:0.0:1785774842.278222:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24065 00000100:00100000:0.0:1785774842.278232:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:19339:x1872519648606592:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.278299:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.278329:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605b600/0x7b7109e1d0a06ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c424 expref: 66 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278348:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9b7605fda100) 00010000:00010000:0.0:1785774842.278359:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.278381:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278395:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278404:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278418:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278425:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278431:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278495:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278503:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.278510:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.279492:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2537, 64 off170560 00010000:00010000:0.0:1785774842.279565:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.279576:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.279585:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.279593:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.279600:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.279607:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.279621:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.279639:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.279646:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.279868:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.279875:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.279883:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.279888:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.279905:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.279917:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9b7602508200) 00010000:00010000:1.0:1785774842.279920:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.279925:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.279932:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a12c4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.279943:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.279945:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.279947:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.280529:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280537:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.280541:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280547:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280557:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9b7602508200) 00010000:00010000:0.0:1785774842.280559:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.280562:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280568:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a12bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280589:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280596:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280602:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280607:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280612:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.280615:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280621:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280630:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.280632:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.280635:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280646:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a12af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.280665:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003481fd06 reply state 00000000bd17b041 transno 4294984097 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280889:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.280942:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4de4b8ce (ffff9b7602508900) 00010000:00010000:0.0:1785774842.280945:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.280948:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.281025:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+67:19339:x1872519648606592:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2793us (3001us total) trans 4294984097 rc 0/0 00000100:00100000:0.0:1785774842.281033:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24065 00000100:00100000:3.0:1785774842.314041:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774842.314195:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648606848 00000100:00100000:1.0:1785774842.314205:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648606848 00000100:00100000:1.0:1785774842.314266:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24066 00000100:00100000:1.0:1785774842.314276:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+67:19339:x1872519648606848:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:1.0:1785774842.314333:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774842.314360:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a0710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c42b expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314377:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9b7605fcb400) 00010000:00010000:1.0:1785774842.314388:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774842.314410:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314423:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314432:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314446:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314453:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314460:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314516:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314524:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314531:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774842.314748:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 64 off10496 00010000:00010000:1.0:1785774842.314823:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314832:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314839:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314847:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314854:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314860:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.314882:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774842.315888:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774842.315904:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.315913:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774842.315916:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.315924:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.315934:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:3.0:1785774842.315937:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774842.315941:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.315947:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044c00/0x7b7109e1d0a12e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.315966:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774842.315969:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774842.315971:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.316325:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316334:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316340:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316345:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.316348:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316354:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316368:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9b7605fd8900) 00010000:00010000:0.0:1785774842.316370:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.316374:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316380:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045600/0x7b7109e1d0a12d9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316405:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316412:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316418:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316423:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316427:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.316430:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316436:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316444:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.316447:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.316449:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316459:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a12cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.316470:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ddc122f reply state 000000000dcf1592 transno 4294984098 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316481:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.316487:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5501ae7b (ffff9b7605fd8c00) 00010000:00010000:0.0:1785774842.316489:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.316492:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.316571:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:19339:x1872519648606848:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2295us (2676us total) trans 4294984098 rc 0/0 00000100:00100000:0.0:1785774842.316580:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24066 00000100:00100000:3.0:1785774842.364047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.364430:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648607104 00000100:00100000:2.0:1785774842.364451:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648607104 00000100:00100000:2.0:1785774842.364564:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24067 00000100:00100000:2.0:1785774842.364575:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:19339:x1872519648607104:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.364635:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.364664:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a0733 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c432 expref: 68 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364689:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9b7605fcc500) 00010000:00010000:2.0:1785774842.364700:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.364723:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364746:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364755:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364769:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364776:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364783:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364873:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364882:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.364889:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.366546:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2538, 64 off170624 00010000:00010000:2.0:1785774842.366630:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366643:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366663:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366678:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366684:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366690:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366710:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.366730:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366736:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366741:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366747:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.366751:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366758:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366768:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9b771992ae00) 00010000:00010000:2.0:1785774842.366771:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.366774:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.366781:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a12f5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.367619:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.367627:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.367633:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.367637:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.367643:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.367662:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9b771992ae00) 00010000:00010000:1.0:1785774842.367665:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.367668:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.367675:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a12fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.367694:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.367697:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.367699:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.369081:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.369096:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.369106:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.369112:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.369117:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.370552:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.370567:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.370583:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.370587:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.370591:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.370598:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a12e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.370615:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000553bfdc0 reply state 00000000428218c6 transno 4294984099 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.370626:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.370633:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3d7b (ffff9b771992a100) 00010000:00010000:2.0:1785774842.370635:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.370639:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.370753:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+69:19339:x1872519648607104:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 6177us (7864us total) trans 4294984099 rc 0/0 00000100:00100000:2.0:1785774842.370762:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24067 00000100:00100000:1.0:1785774842.388181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774842.388476:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648607360 00000100:00100000:3.0:1785774842.388486:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648607360 00000100:00100000:3.0:1785774842.388536:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24068 00000100:00100000:3.0:1785774842.388545:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+69:19339:x1872519648607360:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774842.388610:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774842.388635:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa000/0x7b7109e1d0a0756 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c439 expref: 69 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388662:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9b7602508600) 00010000:00010000:3.0:1785774842.388677:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774842.388698:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388710:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388718:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388730:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388742:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388748:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388809:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388822:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.388834:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.389486:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 64 off10560 00010000:00010000:3.0:1785774842.389547:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389556:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389562:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389568:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389574:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389581:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389597:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774842.389613:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389618:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389624:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389630:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.389634:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389642:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389651:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9b7731f8a000) 00010000:00010000:3.0:1785774842.389653:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774842.389656:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389662:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1311 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389677:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389684:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389690:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389695:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389699:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.389701:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389706:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389711:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774842.389713:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774842.389716:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389721:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1303 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774842.389727:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009099539d reply state 00000000d2508c84 transno 4294984100 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389746:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.389751:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x170e687b (ffff9b7731f8a900) 00010000:00010000:3.0:1785774842.389753:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774842.389755:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774842.390070:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.390077:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.390083:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.390086:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.390092:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.390100:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9b7731f8a000) 00010000:00010000:1.0:1785774842.390102:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.390105:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.390109:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1318 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.390131:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.390133:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.390135:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.390739:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:19339:x1872519648607360:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2185us (2571us total) trans 4294984100 rc 0/0 00000100:00100000:3.0:1785774842.390747:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24068 00000100:00100000:3.0:1785774842.428310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.428454:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648607616 00000100:00100000:2.0:1785774842.428463:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648607616 00000100:00100000:2.0:1785774842.428524:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24069 00000100:00100000:2.0:1785774842.428534:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:19339:x1872519648607616:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.428589:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.428615:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605ae00/0x7b7109e1d0a0779 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c440 expref: 70 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428633:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9b7605fdad00) 00010000:00010000:2.0:1785774842.428644:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.428676:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428690:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428699:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428713:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428720:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428727:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428806:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428822:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.428830:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.431349:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2539, 64 off170688 00010000:00010000:2.0:1785774842.431434:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431449:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431460:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431469:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431476:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431483:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431499:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.431519:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431530:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431536:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431541:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.431545:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431552:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431563:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9b771992a800) 00010000:00010000:2.0:1785774842.431566:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.431571:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431576:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a132d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431594:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431599:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431604:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431608:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431613:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.431616:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431620:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431626:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.431627:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.431630:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431634:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a131f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.431641:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aad41e4d reply state 00000000545141f8 transno 4294984101 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431649:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.431655:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95f89f7b (ffff9b771992a900) 00010000:00010000:2.0:1785774842.431657:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.431659:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.431729:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:19339:x1872519648607616:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 3196us (3428us total) trans 4294984101 rc 0/0 00000100:00100000:2.0:1785774842.431736:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24069 00010000:00010000:1.0:1785774842.432297:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.432304:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.432310:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.432314:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.432321:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.432330:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9b771992a800) 00010000:00010000:1.0:1785774842.432333:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.432336:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.432341:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1334 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.432357:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.432359:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.432361:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774842.441907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.442027:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648607872 00000100:00100000:0.0:1785774842.442037:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648607872 00000100:00100000:0.0:1785774842.442096:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24070 00000100:00100000:0.0:1785774842.442106:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:19339:x1872519648607872:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.442200:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.442227:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf400/0x7b7109e1d0a079c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c447 expref: 71 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442251:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9b7605fd8a00) 00010000:00010000:0.0:1785774842.442261:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.442283:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442299:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442308:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442322:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442328:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442334:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442389:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442396:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442402:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.442617:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 64 off10624 00010000:00010000:0.0:1785774842.442706:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442716:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442724:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442730:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442736:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442854:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.442878:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.443055:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443063:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443070:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443075:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.443079:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443086:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443093:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9b7602508600) 00010000:00010000:0.0:1785774842.443096:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.443098:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443108:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a1349 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443121:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443126:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443132:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443137:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.443140:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443147:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443154:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.443156:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.443282:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443289:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a133b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.443299:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a633899 reply state 00000000bc170db3 transno 4294984102 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443310:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.443318:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd905ca7b (ffff9b7602508200) 00010000:00010000:0.0:1785774842.443320:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.443323:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.443430:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:19339:x1872519648607872:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1324us (1542us total) trans 4294984102 rc 0/0 00000100:00100000:0.0:1785774842.443438:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24070 00010000:00010000:3.0:1785774842.443625:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774842.443632:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.443639:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774842.443643:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.443661:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.443682:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9b7602508600) 00010000:00010000:3.0:1785774842.443685:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774842.443688:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.443695:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1350 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.443710:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774842.443713:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774842.443714:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774842.455719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774842.456153:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648608128 00000100:00100000:3.0:1785774842.456190:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648608128 00000100:00100000:3.0:1785774842.456244:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24071 00000100:00100000:3.0:1785774842.456254:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:19339:x1872519648608128:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:3.0:1785774842.456309:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774842.456335:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0faa00/0x7b7109e1d0a07bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c44e expref: 72 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456354:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9b7602508300) 00010000:00010000:3.0:1785774842.456363:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774842.456384:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456397:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456406:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456418:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456425:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456430:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456645:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456653:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.456659:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.457094:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2540, 64 off170752 00010000:00010000:2.0:1785774842.458835:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.458855:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.458866:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.458874:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.458881:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.458888:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459046:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.459068:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459075:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459082:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459088:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.459093:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459100:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459113:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9b7731f8a000) 00010000:00010000:2.0:1785774842.459116:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.459119:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459135:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1365 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459276:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459283:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459288:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459295:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459300:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.459303:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459309:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459318:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.459321:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.459324:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459335:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1357 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.459344:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9d7f3b4 reply state 000000002d387c38 transno 4294984103 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459355:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.459362:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xee04d97b (ffff9b7731f8a100) 00010000:00010000:2.0:1785774842.459364:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.459367:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.459455:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+73:19339:x1872519648608128:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 3199us (3742us total) trans 4294984103 rc 0/0 00000100:00100000:2.0:1785774842.459463:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24071 00010000:00010000:1.0:1785774842.459636:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.459643:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.459660:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.459663:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.459677:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.459686:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9b7731f8a000) 00010000:00010000:1.0:1785774842.459688:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.459692:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.459697:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a136c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.459711:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.459713:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.459715:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.481484:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.481699:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648608384 00000100:00100000:0.0:1785774842.481709:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648608384 00000100:00100000:0.0:1785774842.481775:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24072 00000100:00100000:0.0:1785774842.481796:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+73:19339:x1872519648608384:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.481869:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.482046:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fbe00/0x7b7109e1d0a07e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c455 expref: 73 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482068:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9b7602508d00) 00010000:00010000:0.0:1785774842.482080:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.482106:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482120:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482131:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482345:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482359:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482367:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482434:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482442:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.482449:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.482680:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 64 off10688 00010000:00010000:0.0:1785774842.483301:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483312:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483320:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483327:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483333:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483339:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483355:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.483373:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483379:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483385:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483391:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.483395:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483402:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483411:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9b7602508600) 00010000:00010000:0.0:1785774842.483414:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.483418:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483423:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a1381 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483441:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483447:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483457:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483462:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483467:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.483469:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483475:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483482:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.483484:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.483486:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483491:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1373 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.483500:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096f97931 reply state 000000003e4926b9 transno 4294984104 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483510:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.483515:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdfb2047b (ffff9b7602508300) 00010000:00010000:0.0:1785774842.483518:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.483520:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.483620:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:19339:x1872519648608384:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1834us (2152us total) trans 4294984104 rc 0/0 00000100:00100000:0.0:1785774842.483628:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24072 00010000:00010000:2.0:1785774842.484189:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774842.484196:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.484202:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774842.484205:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.484212:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.484223:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9b7602508600) 00010000:00010000:2.0:1785774842.484226:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774842.484229:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.484235:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1388 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.484248:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.484251:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.484252:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.495339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.495493:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648608640 00000100:00100000:2.0:1785774842.495504:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648608640 00000100:00100000:2.0:1785774842.495569:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24073 00000100:00100000:2.0:1785774842.495580:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:19339:x1872519648608640:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.495637:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.495681:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700031000/0x7b7109e1d0a0805 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c45c expref: 74 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.495708:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9b7605fd8500) 00010000:00010000:2.0:1785774842.495718:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.496069:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496086:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496096:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496114:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496125:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496132:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496298:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496307:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496314:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.496533:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2541, 64 off170816 00010000:00010000:2.0:1785774842.496595:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496604:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496611:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496617:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496623:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496628:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496643:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.496678:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496685:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496691:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496697:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.496701:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496709:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496717:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9b771992aa00) 00010000:00010000:2.0:1785774842.496720:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.496723:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.496729:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a139d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.497113:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774842.497120:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.497127:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774842.497130:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.497137:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.497146:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9b771992aa00) 00010000:00010000:0.0:1785774842.497148:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774842.497151:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.497156:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a13a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.497185:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.497198:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.497200:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.497637:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.497645:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498068:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498076:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498081:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.498084:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498090:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498098:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.498100:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.498104:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498109:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a138f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.498119:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000793e771 reply state 00000000b3364101 transno 4294984105 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498128:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.498134:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x869c3b7b (ffff9b771992ac00) 00010000:00010000:2.0:1785774842.498136:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.498139:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.498241:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:19339:x1872519648608640:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2662us (2910us total) trans 4294984105 rc 0/0 00000100:00100000:2.0:1785774842.498249:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24073 00000100:00100000:3.0:1785774842.506872:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.507016:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648608896 00000100:00100000:0.0:1785774842.507027:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648608896 00000100:00100000:0.0:1785774842.507086:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24074 00000100:00100000:0.0:1785774842.507095:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:19339:x1872519648608896:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.507203:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.507232:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fa200/0x7b7109e1d0a0828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c463 expref: 75 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507251:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9b7602508b00) 00010000:00010000:0.0:1785774842.507262:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.507285:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507299:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507309:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507324:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507330:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507336:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507394:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507403:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.507409:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.507767:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 64 off10752 00010000:00010000:0.0:1785774842.508071:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508081:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508089:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508097:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508103:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508108:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508429:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.508560:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508569:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508575:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508581:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.508586:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508593:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508609:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9b7602508600) 00010000:00010000:0.0:1785774842.508612:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.508615:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508620:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13b9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508636:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508642:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508647:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508652:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508657:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.508660:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508666:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508673:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.508675:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.508678:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508686:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.508695:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006af57783 reply state 00000000b66222d3 transno 4294984106 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508706:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.508712:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9bba767b (ffff9b7602508d00) 00010000:00010000:0.0:1785774842.508714:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.508717:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774842.509001:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.509008:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.509015:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.509018:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.509025:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.509034:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9b7602508600) 00010000:00010000:1.0:1785774842.509036:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.509039:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.509045:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a13c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.509058:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.509060:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.509062:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774842.509524:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:19339:x1872519648608896:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2427us (2659us total) trans 4294984106 rc 0/0 00000100:00100000:0.0:1785774842.509532:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24074 00000100:00100000:3.0:1785774842.529025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.529573:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648609152 00000100:00100000:0.0:1785774842.529585:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648609152 00000100:00100000:0.0:1785774842.529650:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24075 00000100:00100000:0.0:1785774842.529660:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:19339:x1872519648609152:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.529727:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.529754:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c0fb600/0x7b7109e1d0a084b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c46a expref: 76 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.529773:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9b7602508f00) 00010000:00010000:0.0:1785774842.529782:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.529819:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.529837:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.529846:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.529860:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.529868:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.529875:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.530070:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.530080:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.530088:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.531233:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2542, 64 off170880 00010000:00010000:0.0:1785774842.533206:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.533224:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.533246:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.533257:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.533263:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.533269:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.535039:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.535077:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.535088:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.535094:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.535101:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.535105:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.535113:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.535129:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9b7602508600) 00010000:00010000:0.0:1785774842.535132:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.535136:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.535147:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.535682:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.535690:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.535698:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.535702:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.535709:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.535721:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9b7602508600) 00010000:00010000:1.0:1785774842.535723:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.535727:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.535733:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a13dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.535752:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.535754:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.535756:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.538011:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538030:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538037:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538045:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538052:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.538057:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538066:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538084:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.538087:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.538091:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538098:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.538115:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f2ace59 reply state 00000000460db7f0 transno 4294984107 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538127:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.538135:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b9857b (ffff9b7602508b00) 00010000:00010000:0.0:1785774842.538137:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.538141:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.538267:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:19339:x1872519648609152:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 8604us (9247us total) trans 4294984107 rc 0/0 00000100:00100000:0.0:1785774842.538275:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24075 00000100:00100000:3.0:1785774842.583593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.583709:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648609408 00000100:00100000:0.0:1785774842.583720:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648609408 00000100:00100000:0.0:1785774842.583778:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24076 00000100:00100000:0.0:1785774842.583798:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:19339:x1872519648609408:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.584066:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.584098:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7700030400/0x7b7109e1d0a086e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c471 expref: 77 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584128:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:0.0:1785774842.584140:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.584211:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584226:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584247:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584266:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584273:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584280:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584347:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584356:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584363:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.584710:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 64 off10816 00010000:00010000:0.0:1785774842.584778:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584796:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584805:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584964:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584973:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.584980:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585001:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.585021:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585028:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585035:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585042:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.585046:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585054:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585064:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9b7602508600) 00010000:00010000:0.0:1785774842.585067:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.585071:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585077:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a13f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585094:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585106:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585111:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585116:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.585119:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585126:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585133:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.585136:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.585139:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585146:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a13e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.585154:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dada819b reply state 000000003fb18d2c transno 4294984108 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585199:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.585206:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb4d1abd0 (ffff9b7602508f00) 00010000:00010000:0.0:1785774842.585208:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.585211:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774842.585327:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774842.585335:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.585342:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774842.585345:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.585352:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.585362:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9b7602508600) 00010000:00010000:2.0:1785774842.585365:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774842.585368:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.585373:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a13f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.585389:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.585391:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.585392:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.591106:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:19339:x1872519648609408:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 7305us (7508us total) trans 4294984108 rc 0/0 00000100:00100000:2.0:1785774842.591118:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24076 00000100:00100000:3.0:1785774842.605941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.611047:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648609664 00000100:00100000:2.0:1785774842.611063:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648609664 00000100:00100000:2.0:1785774842.611129:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24077 00000100:00100000:2.0:1785774842.611140:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:19339:x1872519648609664:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.611226:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.611316:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a0891 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c478 expref: 78 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611339:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9b760562f100) 00010000:00010000:2.0:1785774842.611350:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.611374:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611389:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611400:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611415:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611422:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611429:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611557:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611566:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.611577:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.612096:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2543, 64 off170944 00010000:00010000:2.0:1785774842.612199:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612210:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612219:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612227:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612234:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612840:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612854:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.612876:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612882:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612888:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612955:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.612959:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612966:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612977:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9b771992af00) 00010000:00010000:2.0:1785774842.612979:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.612983:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.612988:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a140d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613007:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613013:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613019:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613025:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613030:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.613033:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613043:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613064:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.613067:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.613070:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613075:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a13ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.613085:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abc47ddf reply state 000000008d7bd181 transno 4294984109 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613095:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.613101:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7db3ad0 (ffff9b771992aa00) 00010000:00010000:2.0:1785774842.613104:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.613106:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.613232:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:19339:x1872519648609664:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2092us (7347us total) trans 4294984109 rc 0/0 00000100:00100000:2.0:1785774842.613601:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24077 00010000:00010000:0.0:1785774842.614596:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774842.614604:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.614611:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774842.614615:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.614622:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.614634:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9b771992af00) 00010000:00010000:0.0:1785774842.614637:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774842.614640:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.614655:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1414 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.614680:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.614682:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.614683:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.621035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.621112:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648609920 00000100:00100000:2.0:1785774842.621121:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648609920 00000100:00100000:2.0:1785774842.621210:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24078 00000100:00100000:2.0:1785774842.621220:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:19339:x1872519648609920:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.621275:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.621301:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a08b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c47f expref: 79 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621320:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9b760562f700) 00010000:00010000:2.0:1785774842.621331:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.621353:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621366:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621376:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621391:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621398:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621405:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621463:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621471:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.621478:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774842.622506:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].42, 64 off10880 00010000:00010000:3.0:1785774842.622572:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622581:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622589:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622596:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622602:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622608:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622627:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774842.622642:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622648:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622654:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.622661:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774842.622737:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.622744:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.622750:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfe00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.622753:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.622761:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.622771:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9b771992a300) 00010000:00010000:1.0:1785774842.622774:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.622777:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.622782:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1430 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.622800:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.622802:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.622803:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774842.623264:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623272:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623281:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9b771992a300) 00010000:00010000:3.0:1785774842.623283:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774842.623286:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623296:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1429 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623317:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623323:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623329:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623335:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623340:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774842.623343:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623350:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623357:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:3.0:1785774842.623359:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774842.623362:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623369:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a141b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774842.623379:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e08c6039 reply state 000000006ca18906 transno 4294984110 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623391:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.623397:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x798865d0 (ffff9b771992a700) 00010000:00010000:3.0:1785774842.623399:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774842.623401:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774842.623472:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:19339:x1872519648609920:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2251us (2444us total) trans 4294984110 rc 0/0 00000100:00100000:3.0:1785774842.623480:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24078 00000100:00100000:3.0:1785774842.632232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.632315:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648610176 00000100:00100000:2.0:1785774842.632325:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648610176 00000100:00100000:2.0:1785774842.632376:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24079 00000100:00100000:2.0:1785774842.632385:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:19339:x1872519648610176:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.632442:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.632468:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b760605a600/0x7b7109e1d0a08d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c486 expref: 80 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632487:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9b7605fdac00) 00010000:00010000:2.0:1785774842.632497:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.632519:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632534:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632543:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632558:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632565:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632572:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632630:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632637:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.632647:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.633017:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2544, 64 off171008 00010000:00010000:2.0:1785774842.633085:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633093:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633100:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633105:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633111:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633116:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633131:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.633148:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633153:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633192:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633202:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.633206:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633212:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633221:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9b771992af00) 00010000:00010000:2.0:1785774842.633223:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.633227:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633232:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1445 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633265:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633271:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633276:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633280:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633284:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.633286:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633294:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633301:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.633303:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.633306:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633312:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1437 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.633320:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096724711 reply state 000000009a2fcc21 transno 4294984111 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633331:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.633337:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0729cd0 (ffff9b771992a300) 00010000:00010000:2.0:1785774842.633339:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.633342:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.633581:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:19339:x1872519648610176:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1196us (1358us total) trans 4294984111 rc 0/0 00000100:00100000:2.0:1785774842.633589:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24079 00010000:00010000:1.0:1785774842.633737:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.633744:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.633750:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.633754:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.633760:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.633769:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9b771992af00) 00010000:00010000:1.0:1785774842.633772:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.633775:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.633781:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a144c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.633803:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.633804:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.633806:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774842.645367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.645459:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648610432 00000100:00100000:0.0:1785774842.645471:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648610432 00000100:00100000:0.0:1785774842.645530:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24080 00000100:00100000:0.0:1785774842.645542:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:19339:x1872519648610432:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.645607:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.645639:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a08fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c48d expref: 81 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645686:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:0.0:1785774842.645698:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.645723:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645737:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645747:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645763:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645771:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645779:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645862:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645871:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.645879:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.646360:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].43, 64 off10944 00010000:00010000:0.0:1785774842.646429:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647004:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647015:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647023:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647029:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647035:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647057:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.647078:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647085:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647091:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647096:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.647101:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647108:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647118:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9b760572b200) 00010000:00010000:0.0:1785774842.647121:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.647125:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647131:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1461 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647148:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647154:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647178:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647184:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647199:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.647202:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647208:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647216:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.647219:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.647222:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647229:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a1453 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.647238:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005cc24794 reply state 00000000939032fd transno 4294984112 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647249:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.647255:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe37fc7d0 (ffff9b7602508600) 00010000:00010000:0.0:1785774842.647258:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.647260:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.647334:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:19339:x1872519648610432:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1794us (1976us total) trans 4294984112 rc 0/0 00000100:00100000:0.0:1785774842.647342:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24080 00010000:00010000:2.0:1785774842.648805:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774842.648826:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.648835:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774842.648838:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.648847:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.648860:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9b760572b200) 00010000:00010000:2.0:1785774842.648863:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774842.648867:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.648873:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1468 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.648904:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.648906:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.648907:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.661323:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.661628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.661806:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648610688 00000100:00100000:0.0:1785774842.661827:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648610688 00000100:00100000:0.0:1785774842.661903:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24081 00000100:00100000:0.0:1785774842.661914:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:19339:x1872519648610688:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.661971:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.661998:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9600/0x7b7109e1d0a091d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c494 expref: 82 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662018:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9b760562f400) 00010000:00010000:0.0:1785774842.662028:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.662053:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662067:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662078:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662099:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662106:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662113:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662214:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662223:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662230:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.662495:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2545, 64 off171072 00010000:00010000:0.0:1785774842.662583:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662592:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662601:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662608:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662615:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662622:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662658:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.662685:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662691:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662697:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662702:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.662706:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662713:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662722:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9b760572bb00) 00010000:00010000:0.0:1785774842.662725:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.662728:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662734:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a147d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662752:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662762:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662767:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662772:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662777:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.662779:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662798:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662805:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.662807:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.662810:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662816:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a146f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.662825:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af474468 reply state 000000007b4467c4 transno 4294984113 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662835:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.662841:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x507ed6d0 (ffff9b760572b300) 00010000:00010000:0.0:1785774842.662844:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.662847:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.662919:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:19339:x1872519648610688:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1006us (1296us total) trans 4294984113 rc 0/0 00000100:00100000:0.0:1785774842.662927:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24081 00010000:00010000:2.0:1785774842.663157:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774842.663186:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.663193:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774842.663196:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.663203:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.663212:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9b760572bb00) 00010000:00010000:2.0:1785774842.663215:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774842.663218:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.663224:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1484 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.663238:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.663241:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.663243:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.674748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.674850:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648610944 00000100:00100000:2.0:1785774842.674861:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648610944 00000100:00100000:2.0:1785774842.674928:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24082 00000100:00100000:2.0:1785774842.674938:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:19339:x1872519648610944:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.674998:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.675026:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a0940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c49b expref: 83 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675046:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9b7605fdab00) 00010000:00010000:2.0:1785774842.675056:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.675079:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675093:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675103:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675117:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675124:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675130:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675226:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675235:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675241:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.675738:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].44, 64 off11008 00010000:00010000:2.0:1785774842.675825:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675834:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675842:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675849:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675855:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675861:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675881:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.675906:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675917:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675923:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675929:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.675933:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675941:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675950:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9b771992ae00) 00010000:00010000:2.0:1785774842.675953:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.675957:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675963:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1499 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675979:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675985:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675991:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.675996:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.676001:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.676004:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.676010:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.676018:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.676021:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.676024:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.676029:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a148b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.676038:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008a0a0d2 reply state 00000000dc44df25 transno 4294984114 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.676048:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.676055:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea2c01d0 (ffff9b771992a800) 00010000:00010000:2.0:1785774842.676057:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.676060:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.676144:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:19339:x1872519648610944:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1207us (1405us total) trans 4294984114 rc 0/0 00000100:00100000:2.0:1785774842.676152:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24082 00010000:00010000:1.0:1785774842.676316:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.676323:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.676329:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.676333:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.676339:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.676349:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9b771992ae00) 00010000:00010000:1.0:1785774842.676352:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.676354:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.676360:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.676372:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.676374:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.676376:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774842.684450:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.684669:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648611200 00000100:00100000:2.0:1785774842.684679:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648611200 00000100:00100000:2.0:1785774842.684738:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24083 00000100:00100000:2.0:1785774842.684750:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:19339:x1872519648611200:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.684851:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.684886:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0c00/0x7b7109e1d0a0963 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4a2 expref: 84 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.684917:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9b7731f8a500) 00010000:00010000:2.0:1785774842.684929:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.684955:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.684972:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.684982:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.684996:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685004:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685010:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685080:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685089:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685102:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.685701:0:8627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2546, 64 off171136 00010000:00010000:2.0:1785774842.685775:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685794:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685802:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685868:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685875:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685880:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.685978:0:8627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.685997:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686003:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686010:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686020:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.686024:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686031:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686040:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9b771992a000) 00010000:00010000:2.0:1785774842.686043:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.686046:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686052:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14b5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686069:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686075:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686081:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686087:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686093:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.686096:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686107:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686115:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.686118:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.686121:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686127:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.686137:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000863659e reply state 00000000cfba6c64 transno 4294984115 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686147:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.686153:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe91638d0 (ffff9b771992a200) 00010000:00010000:2.0:1785774842.686155:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.686157:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.686305:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:19339:x1872519648611200:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1556us (1875us total) trans 4294984115 rc 0/0 00000100:00100000:2.0:1785774842.686314:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24083 00010000:00010000:1.0:1785774842.691555:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.691569:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.691582:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.691585:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.691600:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.691617:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9b771992a000) 00010000:00010000:1.0:1785774842.691620:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.691625:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.691631:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.691670:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.691673:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.691675:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.700661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.700816:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648611456 00000100:00100000:0.0:1785774842.700826:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648611456 00000100:00100000:0.0:1785774842.700887:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24084 00000100:00100000:0.0:1785774842.700897:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:19339:x1872519648611456:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.700966:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.700993:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a0986 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4a9 expref: 85 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701018:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9b760562f200) 00010000:00010000:0.0:1785774842.701030:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.701056:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701071:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701082:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701097:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701104:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701115:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701221:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701229:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701236:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.701468:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].45, 64 off11072 00010000:00010000:0.0:1785774842.701542:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701551:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701560:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701568:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701575:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701583:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701607:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.701626:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701633:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701640:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701647:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.701651:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701659:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701682:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9b760572b800) 00010000:00010000:0.0:1785774842.701686:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.701689:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701696:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a14d1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701713:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701720:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701727:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701737:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701742:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.701745:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701750:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701757:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.701759:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.701762:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701768:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.701777:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da19c329 reply state 00000000cc04bf51 transno 4294984116 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701798:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.701804:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfe3473d0 (ffff9b760572b100) 00010000:00010000:0.0:1785774842.701806:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.701809:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.701878:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:19339:x1872519648611456:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 981us (1236us total) trans 4294984116 rc 0/0 00000100:00100000:0.0:1785774842.701886:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24084 00010000:00010000:1.0:1785774842.702074:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.702080:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.702087:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.702091:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.702098:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.702107:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9b760572b800) 00010000:00010000:1.0:1785774842.702110:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.702113:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.702119:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a14d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.702131:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.702133:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.702135:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.710035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.710127:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648611712 00000100:00100000:2.0:1785774842.710136:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648611712 00000100:00100000:2.0:1785774842.710222:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24085 00000100:00100000:2.0:1785774842.710232:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:19339:x1872519648611712:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.710288:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.710316:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a09a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4b0 expref: 86 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710334:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9b760562fd00) 00010000:00010000:2.0:1785774842.710345:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.710367:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710380:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710390:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710404:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710411:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710417:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710479:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710485:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710491:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.710684:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2547, 64 off171200 00010000:00010000:2.0:1785774842.710746:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710755:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710762:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710769:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710776:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.710791:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711100:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.711119:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711125:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711131:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711137:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.711141:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711149:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711180:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9b771992a000) 00010000:00010000:2.0:1785774842.711183:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.711187:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711194:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a14ed lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711210:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711216:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711222:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711227:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711232:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.711235:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711240:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711247:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.711249:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.711252:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711262:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a14df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.711271:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6fddcdd reply state 000000008829d513 transno 4294984117 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711281:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.711288:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x133382d0 (ffff9b771992ad00) 00010000:00010000:2.0:1785774842.711290:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.711293:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.711354:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:19339:x1872519648611712:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1124us (1329us total) trans 4294984117 rc 0/0 00000100:00100000:2.0:1785774842.711362:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24085 00010000:00010000:1.0:1785774842.720745:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.720760:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.720772:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.720776:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.720795:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.720823:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9b771992a000) 00010000:00010000:1.0:1785774842.720827:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.720832:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.720838:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a14f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.720862:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.720864:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.720866:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.726198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.726307:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648611968 00000100:00100000:0.0:1785774842.726319:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648611968 00000100:00100000:0.0:1785774842.726378:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24086 00000100:00100000:0.0:1785774842.726387:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:19339:x1872519648611968:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.726458:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.726484:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0000/0x7b7109e1d0a09cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4b7 expref: 87 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726501:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9b7731f8aa00) 00010000:00010000:0.0:1785774842.726512:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.726534:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726547:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726556:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726570:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726577:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726584:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726642:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726672:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.726678:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.727009:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].46, 64 off11136 00010000:00010000:0.0:1785774842.727070:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727078:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727085:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727090:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727095:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727101:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727116:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.727134:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727140:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727148:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727154:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.727182:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727518:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727529:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9b760572b000) 00010000:00010000:0.0:1785774842.727531:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.727535:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727542:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a1509 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727557:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727563:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727569:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727575:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727580:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.727584:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727590:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727597:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.727599:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.727602:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727608:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6400/0x7b7109e1d0a14fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.727617:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ac52a5a reply state 000000002c51aa00 transno 4294984118 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727627:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.727632:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xeedd9295 (ffff9b760572bc00) 00010000:00010000:0.0:1785774842.727634:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.727637:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774842.727750:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.727758:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.727765:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.727770:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.727777:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.727796:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9b760572b000) 00010000:00010000:1.0:1785774842.727799:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.727802:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.727815:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1510 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.727828:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.727830:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.727832:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774842.728599:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:19339:x1872519648611968:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2208us (2444us total) trans 4294984118 rc 0/0 00000100:00100000:0.0:1785774842.728608:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24086 00000100:00100000:3.0:1785774842.758766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.758983:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648612224 00000100:00100000:0.0:1785774842.758994:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648612224 00000100:00100000:0.0:1785774842.759057:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24087 00000100:00100000:0.0:1785774842.759068:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:19339:x1872519648612224:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.759127:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.759156:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9c00/0x7b7109e1d0a09ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4be expref: 88 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759214:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9b760562f000) 00010000:00010000:0.0:1785774842.759224:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.759246:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759260:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759271:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759284:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759292:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759298:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759355:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759364:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759370:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.759604:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2548, 64 off171264 00010000:00010000:0.0:1785774842.759667:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759677:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759684:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759693:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759699:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759705:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759718:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.759734:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759740:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759746:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759752:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.759756:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759763:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759772:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9b760572b600) 00010000:00010000:0.0:1785774842.759775:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.759779:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759795:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1525 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759821:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759828:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759832:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759837:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759843:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.759846:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759852:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759860:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.759862:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.759865:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.759875:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1517 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.759883:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae36c524 reply state 000000009fec2a94 transno 4294984119 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.760186:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.760203:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.760210:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9dc00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.760214:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.760221:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.760230:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9b760572b600) 00010000:00010000:1.0:1785774842.760232:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.760235:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.760246:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a152c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.760259:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.760261:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.760263:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.760674:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.760682:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6be72195 (ffff9b760572b900) 00010000:00010000:0.0:1785774842.760685:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.760688:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.760768:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:19339:x1872519648612224:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1701us (2010us total) trans 4294984119 rc 0/0 00000100:00100000:0.0:1785774842.760776:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24087 00000100:00100000:3.0:1785774842.778511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.778642:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648612480 00000100:00100000:2.0:1785774842.778671:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648612480 00000100:00100000:2.0:1785774842.778740:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24088 00000100:00100000:2.0:1785774842.778750:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:19339:x1872519648612480:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.778828:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.778856:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770149a000/0x7b7109e1d0a0a12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4c5 expref: 89 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.778877:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9b7602508500) 00010000:00010000:2.0:1785774842.778886:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.779136:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779152:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779212:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779230:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779237:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779244:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779301:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779310:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.779316:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.780056:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 64 off11200 00010000:00010000:2.0:1785774842.780126:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780137:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780145:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780153:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780200:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780207:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780221:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.780240:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780246:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780252:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780258:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.780262:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780269:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780279:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9b771992af00) 00010000:00010000:2.0:1785774842.780282:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.780286:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780296:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a1541 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780312:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780318:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780324:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780330:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780335:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418ddc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.780338:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780344:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780352:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.780354:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.780357:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780363:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a1533 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.780373:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000964b0305 reply state 000000000405c2dc transno 4294984120 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780384:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.780389:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6d724c95 (ffff9b771992ae00) 00010000:00010000:2.0:1785774842.780391:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.780394:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774842.780587:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.780594:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.780599:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.780602:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.780608:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.780617:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9b771992af00) 00010000:00010000:1.0:1785774842.780619:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.780622:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.780627:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a1548 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.780640:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.780642:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.780644:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774842.781001:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:19339:x1872519648612480:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2251us (2499us total) trans 4294984120 rc 0/0 00000100:00100000:2.0:1785774842.781010:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24088 00000100:00100000:2.0:1785774842.792718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.792825:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648612736 00000100:00100000:0.0:1785774842.792835:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648612736 00000100:00100000:0.0:1785774842.792904:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24089 00000100:00100000:0.0:1785774842.792915:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:19339:x1872519648612736:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.792973:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.793001:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a0a35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4cc expref: 90 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793018:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9b760562fa00) 00010000:00010000:0.0:1785774842.793029:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.793052:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793071:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793081:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793097:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793105:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793112:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793219:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793228:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793246:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.793508:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2549, 64 off171328 00010000:00010000:0.0:1785774842.793585:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793594:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793602:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793610:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793618:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793624:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793638:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.793654:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793662:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793668:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793675:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.793679:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793687:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793695:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9b760572b700) 00010000:00010000:0.0:1785774842.793699:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.793702:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793713:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a155d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793729:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793734:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793739:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793745:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793750:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.793752:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793759:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793766:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.793769:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.793772:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793779:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a154f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.793800:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066b381d5 reply state 00000000afda088c transno 4294984121 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793811:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.793818:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a5c8395 (ffff9b760572bf00) 00010000:00010000:0.0:1785774842.793820:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.793823:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.793889:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+91:19339:x1872519648612736:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 976us (1180us total) trans 4294984121 rc 0/0 00000100:00100000:0.0:1785774842.793897:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24089 00010000:00010000:1.0:1785774842.794096:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.794103:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.794111:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.794115:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.794122:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.794132:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9b760572b700) 00010000:00010000:1.0:1785774842.794135:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.794138:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.794145:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1564 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.794189:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.794192:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.794194:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.814779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.814903:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648612992 00000100:00100000:0.0:1785774842.814913:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648612992 00000100:00100000:0.0:1785774842.814969:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24090 00000100:00100000:0.0:1785774842.814979:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+91:19339:x1872519648612992:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.815037:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.815064:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a0a58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4d3 expref: 91 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815080:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9b760562fc00) 00010000:00010000:0.0:1785774842.815090:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.815111:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815123:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815132:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815157:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815214:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815222:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815276:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815282:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815288:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.815517:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 64 off11264 00010000:00010000:0.0:1785774842.815588:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815596:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815604:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815611:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815617:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815624:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815649:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.815666:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815672:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815678:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815684:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.815688:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815694:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815702:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9b760572ba00) 00010000:00010000:0.0:1785774842.815705:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.815708:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815713:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1579 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815728:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815738:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815744:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815750:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815754:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.815757:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815763:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815770:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.815772:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.815775:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815780:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a156b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.815799:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040fe4526 reply state 000000000cacc3d6 transno 4294984122 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815809:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.815814:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x609ae95 (ffff9b760572be00) 00010000:00010000:0.0:1785774842.815817:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.815819:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.815893:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:19339:x1872519648612992:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 914us (1124us total) trans 4294984122 rc 0/0 00000100:00100000:0.0:1785774842.815900:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24090 00010000:00010000:2.0:1785774842.816234:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774842.816242:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.816249:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9de00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774842.816253:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.816259:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.816270:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9b760572ba00) 00010000:00010000:2.0:1785774842.816272:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774842.816275:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.816281:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1580 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.816294:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.816297:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.816299:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.825641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.826845:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648613248 00000100:00100000:0.0:1785774842.826857:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648613248 00000100:00100000:0.0:1785774842.826940:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24091 00000100:00100000:0.0:1785774842.826952:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:19339:x1872519648613248:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.827020:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.827051:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b0200/0x7b7109e1d0a0a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4da expref: 92 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827071:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9b7731f8a800) 00010000:00010000:0.0:1785774842.827085:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.827110:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827125:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827137:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827151:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827182:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827206:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827266:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827274:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.827282:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785774842.830478:0:21784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2550, 64 off171392 00010000:00010000:1.0:1785774842.830585:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830599:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830609:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830618:0:21784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830629:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830635:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830676:0:21784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774842.830698:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830704:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830710:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830724:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774842.830728:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830736:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830747:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9b760572ba00) 00010000:00010000:1.0:1785774842.830750:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785774842.830754:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830760:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1595 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830793:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830800:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.830805:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.830931:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774842.830938:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.830945:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774842.830948:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.830956:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.830965:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9b760572ba00) 00010000:00010000:2.0:1785774842.830968:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785774842.830971:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.830976:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a159c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.831001:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.831004:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774842.831005:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.831068:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774842.831071:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.831077:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.831084:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:1.0:1785774842.831087:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774842.831090:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.831095:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1587 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774842.831104:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7b17e53 reply state 0000000096f0888e transno 4294984123 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.831113:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.831118:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9d08bd95 (ffff9b760572bd00) 00010000:00010000:1.0:1785774842.831121:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774842.831125:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774842.832260:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:19339:x1872519648613248:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 5305us (6622us total) trans 4294984123 rc 0/0 00000100:00100000:1.0:1785774842.832270:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24091 00000100:00100000:0.0:1785774842.861440:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.861575:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648613504 00000100:00100000:2.0:1785774842.861587:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648613504 00000100:00100000:2.0:1785774842.861654:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24092 00000100:00100000:2.0:1785774842.861664:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:19339:x1872519648613504:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.861724:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.861751:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80e00/0x7b7109e1d0a0a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4e1 expref: 93 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.861793:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:2.0:1785774842.861805:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.861991:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862006:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862016:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862032:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862039:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862045:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862113:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862121:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.862127:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.863309:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 64 off11328 00010000:00010000:2.0:1785774842.863395:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863409:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863418:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863427:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863508:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863516:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863543:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.863568:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863576:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863582:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863588:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.863594:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863602:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863620:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9b771992a000) 00010000:00010000:2.0:1785774842.863622:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.863626:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863633:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863672:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863679:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863685:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863691:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863696:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418ddc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.863699:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863705:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863714:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.863716:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.863719:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863729:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.863738:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036a99be8 reply state 000000000d3576f5 transno 4294984124 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863748:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.863754:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3615e895 (ffff9b771992af00) 00010000:00010000:2.0:1785774842.863757:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.863760:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.863872:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:19339:x1872519648613504:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2206us (2447us total) trans 4294984124 rc 0/0 00000100:00100000:2.0:1785774842.863880:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24092 00010000:00010000:0.0:1785774842.867566:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774842.867584:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.867596:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774842.867600:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.867610:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.867629:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9b771992a000) 00010000:00010000:0.0:1785774842.867631:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774842.867636:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.867641:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.867683:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.867685:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.867687:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.883737:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774842.883851:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648613760 00000100:00100000:0.0:1785774842.883862:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648613760 00000100:00100000:0.0:1785774842.883934:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24093 00000100:00100000:0.0:1785774842.883944:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:19339:x1872519648613760:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:0.0:1785774842.884007:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774842.884035:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1800/0x7b7109e1d0a0ac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4e8 expref: 94 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884054:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9b7731f8a200) 00010000:00010000:0.0:1785774842.884065:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774842.884089:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884103:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884113:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884127:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884134:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884141:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884343:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884352:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884359:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785774842.884669:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2551, 64 off171456 00010000:00010000:0.0:1785774842.884731:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884738:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884745:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884751:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884757:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884761:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884835:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785774842.884854:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884863:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884869:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884875:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.884879:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884894:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884902:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9b760572b600) 00010000:00010000:0.0:1785774842.884904:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785774842.884907:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884912:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a15cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884927:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884932:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884936:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884941:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884946:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774842.884948:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884952:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884958:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:0.0:1785774842.884960:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774842.884963:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884969:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a15bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774842.884977:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b75aba5d reply state 000000004e707b59 transno 4294984125 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884985:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.884991:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3001f95 (ffff9b760572b700) 00010000:00010000:0.0:1785774842.884993:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774842.884995:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774842.885069:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:19339:x1872519648613760:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1126us (1340us total) trans 4294984125 rc 0/0 00000100:00100000:0.0:1785774842.885077:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24093 00010000:00010000:1.0:1785774842.893992:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.894008:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.894019:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9cc00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.894024:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.894034:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.894053:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9b760572b600) 00010000:00010000:1.0:1785774842.894055:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.894060:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.894067:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a15d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.894093:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.894096:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774842.894098:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774842.896575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.897381:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648614016 00000100:00100000:2.0:1785774842.897393:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648614016 00000100:00100000:2.0:1785774842.897526:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24094 00000100:00100000:2.0:1785774842.897536:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:19339:x1872519648614016:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.897592:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.897620:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057b1000/0x7b7109e1d0a0ae4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4ef expref: 95 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897637:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9b7731f8a700) 00010000:00010000:2.0:1785774842.897659:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.897683:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897700:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897710:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897735:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897743:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897750:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897827:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897835:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.897841:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.898060:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].50, 64 off11392 00010000:00010000:2.0:1785774842.898125:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898134:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898142:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898150:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898183:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898620:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898688:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.898711:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898717:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898722:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898737:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.898741:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898749:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898757:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9b7602508500) 00010000:00010000:2.0:1785774842.898760:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.898764:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898773:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc800/0x7b7109e1d0a15e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898800:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898816:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898821:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898827:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898832:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dc600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.898835:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898840:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898847:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.898850:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.898852:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898857:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dc600/0x7b7109e1d0a15db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.898866:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006af5e47e reply state 000000001ef545a5 transno 4294984126 ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898877:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.898882:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x35965a95 (ffff9b771992a000) 00010000:00010000:2.0:1785774842.898894:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.898897:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.898975:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:19339:x1872519648614016:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 1440us (2408us total) trans 4294984126 rc 0/0 00000100:00100000:2.0:1785774842.898982:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24094 00010000:00010000:3.0:1785774842.910442:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774842.910456:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.910469:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774842.910473:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.910487:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.910507:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9b7602508500) 00010000:00010000:3.0:1785774842.910511:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785774842.910515:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.910522:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a15f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774842.910544:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774842.910546:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774842.910548:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774842.910708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774842.911453:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648614272 00000100:00100000:2.0:1785774842.911463:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648614272 00000100:00100000:2.0:1785774842.911515:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24095 00000100:00100000:2.0:1785774842.911525:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:19339:x1872519648614272:12345-192.168.202.31@tcp:36:unlinkmany.0 00010000:00010000:2.0:1785774842.911586:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774842.911606:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a0b07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4f6 expref: 96 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911622:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9b7605fcb600) 00010000:00010000:2.0:1785774842.911628:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774842.911659:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911672:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911688:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911708:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911715:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911722:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911794:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911802:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.911817:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774842.912397:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2552, 64 off171520 00010000:00010000:2.0:1785774842.912602:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912612:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912621:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912628:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912634:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912642:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912718:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774842.912748:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912754:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912760:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912765:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.912769:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912776:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912792:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9b7602184b00) 00010000:00010000:2.0:1785774842.912795:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785774842.912799:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912813:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3600/0x7b7109e1d0a1605 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912832:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912841:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912846:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912852:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912857:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774842.912860:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912866:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.912875:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9b7605dfe400) 00010000:00010000:2.0:1785774842.912877:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774842.912880:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.913721:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a15f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774842.913799:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f10cd8d reply state 00000000150cafa7 transno 4294984127 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.913995:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774842.914004:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x74956995 (ffff9b7602184300) 00010000:00010000:2.0:1785774842.914007:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774842.914011:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774842.914131:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:19339:x1872519648614272:12345-192.168.202.31@tcp:36:unlinkmany.0 Request processed in 2601us (3420us total) trans 4294984127 rc 0/0 00000100:00100000:2.0:1785774842.914142:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24095 00010000:00010000:1.0:1785774842.921614:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774842.921629:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.921642:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774842.921654:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.921664:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.921685:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9b7602184b00) 00010000:00010000:1.0:1785774842.921688:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774842.921692:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774842.921698:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec2000/0x7b7109e1d0a160c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774842.921976:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.921980:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774842.921982:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785774843.057561:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969901 is committed 00000001:00080000:0.0:1785774843.069281:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969900 is committed 00010000:00010000:2.0:1785774843.695126:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774844.072579:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671306368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774844.072671:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.072749:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671306368 00000100:00100000:1.0:1785774844.072757:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671306368 00000100:00100000:1.0:1785774844.072811:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:1.0:1785774844.072819:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671306368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774844.072852:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774844.072894:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671306368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774844.072900:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:1.0:1785774844.094673:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671306368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774844.547987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774844.553286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774844.553322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774844.553345:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774844.553372:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774844.553400:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648614912 00000100:00100000:1.0:1785774844.553409:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648614912 00000100:00100000:1.0:1785774844.553487:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648614784 00000100:00100000:1.0:1785774844.553490:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648614784 00000100:00100000:1.0:1785774844.553513:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 643 00000100:00100000:1.0:1785774844.553522:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648614912:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774844.553586:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648614912:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 65us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774844.553593:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 643 00000100:00100000:1.0:1785774844.553609:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 644 00000100:00100000:1.0:1785774844.553615:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648614784:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774844.553653:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648614784:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774844.553659:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 644 00000100:00100000:1.0:1785774844.553679:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648614656 00000100:00100000:1.0:1785774844.553682:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648614656 00000100:00100000:1.0:1785774844.553710:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648614528 00000100:00100000:1.0:1785774844.553713:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648614528 00000100:00100000:1.0:1785774844.553735:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1061 00000100:00100000:1.0:1785774844.553742:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648614656:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774844.553780:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648614656:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774844.553786:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1061 00000100:00100000:1.0:1785774844.553797:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1062 00000100:00100000:1.0:1785774844.553803:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:2416:x1872519648614528:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774844.554041:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:2416:x1872519648614528:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 237us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774844.554049:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1062 00000100:00080000:1.0:1785774844.554071:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774844.554075:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774844.554077:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774844.554079:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774844.556235:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648614400 00000100:00100000:2.0:1785774844.556253:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648614400 00000100:00100000:2.0:1785774844.556322:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 566 00000100:00100000:2.0:1785774844.556334:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648614400:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774844.556404:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648614400:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (8426us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774844.556413:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 566 00010000:00010000:1.0:1785774844.710693:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785774844.781066:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984127 is committed 00000004:00080000:2.0:1785774844.781121:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000004:00080000:2.0:1785774844.781140:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00010000:00010000:3.0:1785774844.781567:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781580:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781587:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781594:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.781599:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781606:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781623:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77cd7179 (ffff9b7605fcbf00) 00010000:00010000:3.0:1785774844.781627:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774844.781700:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671306624:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1785774844.781779:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781788:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1166 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781877:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781883:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781888:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781892:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.781895:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781900:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781908:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe58bac79 (ffff9b771992a600) 00010000:00010000:3.0:1785774844.781911:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.781914:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781919:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744600/0x7b7109e1d0a1182 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781930:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781936:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781941:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781945:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.781948:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781954:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781961:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8bf53b79 (ffff9b7602508e00) 00010000:00010000:3.0:1785774844.781964:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.781967:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781972:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a119e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781986:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781992:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.781998:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782004:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.782007:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782013:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782020:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa6a2e1ce (ffff9b7731f8ac00) 00010000:00010000:3.0:1785774844.782023:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.782026:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782032:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a11ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782046:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782052:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782057:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782063:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.782066:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782071:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782083:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4d0c70ce (ffff9b7731f8ad00) 00010000:00010000:3.0:1785774844.782085:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.782087:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782093:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a11d6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782106:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782112:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782118:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782122:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.782125:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782130:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782137:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe8b99bce (ffff9b7602508800) 00010000:00010000:3.0:1785774844.782139:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.782142:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782147:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a11f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782184:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782191:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782196:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782201:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.782204:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782210:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782219:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x91a3d2ce (ffff9b7731f8af00) 00010000:00010000:3.0:1785774844.782222:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.782224:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782230:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a120e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782244:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782249:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782254:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782260:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.782262:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782268:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782275:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0d0fdce (ffff9b7602508000) 00010000:00010000:3.0:1785774844.782277:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.782279:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.782286:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a122a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774844.782611:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.783956:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.783998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784029:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.784051:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784069:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.784089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784107:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1785774844.784113:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671306496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.784136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784152:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.784186:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784203:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.784222:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784234:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.784250:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784275:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671306752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.784295:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784311:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.784329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784344:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.784363:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784378:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671308288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.784396:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784411:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1785774844.784416:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671306880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.784435:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784444:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.784460:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.784469:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307904:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1785774844.787101:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787111:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787118:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787125:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.787129:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787137:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787157:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95b00cce (ffff9b771992a400) 00010000:00010000:3.0:1785774844.787173:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.787179:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787186:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1246 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787201:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787206:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787213:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787218:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.787221:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787227:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787234:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd0dd37ce (ffff9b7731f8a600) 00010000:00010000:3.0:1785774844.787237:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.787239:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787245:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a1262 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787259:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787265:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787271:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787276:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.787279:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787285:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787293:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x77c76ece (ffff9b7602508100) 00010000:00010000:3.0:1785774844.787295:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.787298:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787304:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a127e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787315:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787321:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787327:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787332:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.787335:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787341:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787348:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe585a9ce (ffff9b7731f8a400) 00010000:00010000:3.0:1785774844.787350:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.787352:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787358:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a129a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787370:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787375:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787381:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787386:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.787389:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787395:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787407:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x4de4b8ce (ffff9b7602508900) 00010000:00010000:3.0:1785774844.787409:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.787412:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787418:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a12b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787431:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787437:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787444:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787449:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.787453:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787459:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.787466:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x5501ae7b (ffff9b7605fd8c00) 00000100:00100000:1.0:1785774844.787823:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671306624 00000100:00100000:1.0:1785774844.787833:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671306624 00000100:00100000:1.0:1785774844.787880:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307136 00000100:00100000:1.0:1785774844.787883:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307136 00000100:00100000:1.0:1785774844.787891:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307648 00000100:00100000:1.0:1785774844.787894:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307648 00000100:00100000:1.0:1785774844.787905:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308160 00000100:00100000:1.0:1785774844.787908:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308160 00000100:00100000:1.0:1785774844.787915:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671306496 00000100:00100000:1.0:1785774844.787918:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671306496 00000100:00100000:1.0:1785774844.787930:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5243 00000100:00100000:1.0:1785774844.787938:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3654:x1872519671306624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.787968:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2512 count 1 00002000:00010000:1.0:1785774844.787999:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.788006:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788021:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.788025:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.788032:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788045:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788054:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788062:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788080:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774844.788279:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3654:x1872519671306624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 340us (5668us total) trans 4294969901 rc 0/0 00000100:00100000:1.0:1785774844.788286:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5243 00000100:00100000:1.0:1785774844.788300:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307008 00000100:00100000:1.0:1785774844.788303:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307008 00000100:00100000:1.0:1785774844.788313:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307520 00000100:00100000:1.0:1785774844.788316:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307520 00000100:00100000:1.0:1785774844.788324:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308032 00000100:00100000:1.0:1785774844.788327:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308032 00000100:00100000:1.0:1785774844.788335:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671306752 00000100:00100000:1.0:1785774844.788338:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671306752 00000100:00100000:1.0:1785774844.788346:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307264 00000100:00100000:1.0:1785774844.788349:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307264 00000100:00100000:1.0:1785774844.788357:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307776 00000100:00100000:1.0:1785774844.788360:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307776 00000100:00100000:1.0:1785774844.788368:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308288 00000100:00100000:1.0:1785774844.788371:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308288 00000100:00100000:1.0:1785774844.788380:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671306880 00000100:00100000:1.0:1785774844.788382:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671306880 00000100:00100000:1.0:1785774844.788390:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307392 00000100:00100000:1.0:1785774844.788393:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307392 00000100:00100000:1.0:1785774844.788403:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244 00000100:00100000:1.0:1785774844.788408:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3654:x1872519671307136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.788419:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2516 count 1 00002000:00010000:1.0:1785774844.788433:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.788439:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788447:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.788450:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.788454:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788462:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788470:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788493:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788506:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774844.788569:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3654:x1872519671307136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (4570us total) trans 4294969902 rc 0/0 00000100:00100000:1.0:1785774844.788576:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244 00000100:00100000:1.0:1785774844.788589:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245 00000100:00100000:1.0:1785774844.788595:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671307648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.788608:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2512 count 1 00002000:00010000:1.0:1785774844.788624:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.788639:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788648:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d0:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.788651:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.788655:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788664:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788672:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788679:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788693:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1785774844.788781:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3654:x1872519671307648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 186us (4728us total) trans 4294969902 rc 0/0 00000100:00100000:1.0:1785774844.788787:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245 00000100:00100000:1.0:1785774844.788799:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5246 00000100:00100000:1.0:1785774844.788806:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671308160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.788817:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2516 count 1 00002000:00010000:1.0:1785774844.788830:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.788835:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788843:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d4:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.788846:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.788849:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788858:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788865:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788873:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.788887:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1785774844.788943:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3654:x1872519671308160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 137us (4852us total) trans 4294969903 rc 0/0 00000100:00100000:1.0:1785774844.788949:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5246 00000100:00100000:1.0:1785774844.788960:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247 00000100:00100000:1.0:1785774844.788966:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3654:x1872519671306496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.788976:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2511 count 1 00002000:00010000:1.0:1785774844.788987:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.788992:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789001:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.789004:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.789008:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789017:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789025:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789033:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789042:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1785774844.789100:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3654:x1872519671306496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 134us (4963us total) trans 4294969903 rc 0/0 00000100:00100000:1.0:1785774844.789107:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247 00000100:00100000:1.0:1785774844.789118:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5248 00000100:00100000:1.0:1785774844.789124:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3654:x1872519671307008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.789134:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2515 count 1 00002000:00010000:1.0:1785774844.789146:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.789150:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789183:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.789186:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.789191:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789201:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789210:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789218:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789226:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1785774844.789280:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3654:x1872519671307008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 155us (5092us total) trans 4294969904 rc 0/0 00000100:00100000:1.0:1785774844.789285:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5248 00000100:00100000:1.0:1785774844.789297:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5249 00000100:00100000:1.0:1785774844.789302:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671307520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.789315:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2511 count 1 00002000:00010000:1.0:1785774844.789329:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.789333:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789345:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cf:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.789349:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.789352:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789361:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789369:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789377:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789386:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1785774844.789443:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3654:x1872519671307520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 141us (5219us total) trans 4294969904 rc 0/0 00000100:00100000:1.0:1785774844.789449:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5249 00000100:00100000:1.0:1785774844.789460:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250 00000100:00100000:1.0:1785774844.789466:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671308032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.789476:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2515 count 1 00002000:00010000:1.0:1785774844.789489:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.789493:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789505:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d3:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.789508:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.789512:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789520:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789527:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789534:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789543:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:1.0:1785774844.789600:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3654:x1872519671308032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 134us (5348us total) trans 4294969905 rc 0/0 00000100:00100000:1.0:1785774844.789606:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250 00000100:00100000:1.0:1785774844.789617:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251 00000100:00100000:1.0:1785774844.789623:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3655:x1872519671306752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.789633:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2513 count 1 00002000:00010000:1.0:1785774844.789647:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.789652:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789663:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.789665:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.789669:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789677:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789684:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789691:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789698:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:1.0:1785774844.789754:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3655:x1872519671306752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 132us (5458us total) trans 4294969905 rc 0/0 00000100:00100000:1.0:1785774844.789761:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251 00000100:00100000:1.0:1785774844.789784:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5252 00000100:00100000:1.0:1785774844.789790:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3655:x1872519671307264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.789802:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2517 count 1 00002000:00010000:1.0:1785774844.789814:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.789819:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789830:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.789832:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.789836:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789844:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789851:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789858:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789866:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:1.0:1785774844.789924:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3655:x1872519671307264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 133us (5592us total) trans 4294969906 rc 0/0 00000100:00100000:1.0:1785774844.789930:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5252 00000100:00100000:1.0:1785774844.789941:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253 00000100:00100000:1.0:1785774844.789947:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3655:x1872519671307776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.789958:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2513 count 1 00002000:00010000:1.0:1785774844.789971:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.789976:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.789989:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d1:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.789992:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.789996:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790005:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790013:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790019:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790027:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000100:00100000:1.0:1785774844.790087:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3655:x1872519671307776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 140us (5723us total) trans 4294969906 rc 0/0 00000100:00100000:1.0:1785774844.790093:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253 00000100:00100000:1.0:1785774844.790104:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5254 00000100:00100000:1.0:1785774844.790110:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3655:x1872519671308288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.790121:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2517 count 1 00002000:00010000:1.0:1785774844.790133:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.790138:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790151:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d5:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.790154:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.790179:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790190:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790198:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790205:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790214:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00000100:00100000:1.0:1785774844.790268:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3655:x1872519671308288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 158us (5870us total) trans 4294969907 rc 0/0 00000100:00100000:1.0:1785774844.790275:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5254 00000100:00100000:1.0:1785774844.790287:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5255 00000100:00100000:1.0:1785774844.790293:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3655:x1872519671306880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.790304:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2514 count 1 00002000:00010000:1.0:1785774844.790315:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.790320:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790334:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.790337:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.790342:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790351:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790359:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790367:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790375:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00000100:00100000:1.0:1785774844.790425:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3655:x1872519671306880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 133us (5989us total) trans 4294969907 rc 0/0 00000100:00100000:1.0:1785774844.790431:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5255 00000100:00100000:1.0:1785774844.790442:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256 00000100:00100000:1.0:1785774844.790447:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3655:x1872519671307392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.790457:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2518 count 1 00002000:00010000:1.0:1785774844.790469:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.790473:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790486:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.790489:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.790494:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790503:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790512:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790519:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790527:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00000100:00100000:1.0:1785774844.790576:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3655:x1872519671307392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 129us (6114us total) trans 4294969908 rc 0/0 00000100:00100000:1.0:1785774844.790582:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256 00000100:00080000:1.0:1785774844.790607:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774844.790611:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785774844.790622:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1785774844.790628:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790637:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.790641:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790653:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790669:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790677:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b9d15c/0x7b7109e1d0a1613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790698:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1785774844.790702:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790709:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.790712:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790720:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790729:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790736:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065cecf78/0x7b7109e1d0a161a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.790753:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1785774844.790757:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774844.791776:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969900 gen 2 00000004:00080000:2.0:1785774844.791978:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307e300, transno 4294969900 00000100:00100000:2.0:1785774844.791999:0:3654:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b76068d0e00 x1872519671306496/t4294969903(4294969903) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774860 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1785774844.792013:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d0e00/2, rc 0, transno 4294969903 00000100:00100000:2.0:1785774844.792019:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671306496:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774844.792035:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d0380/2, rc 0, transno 4294969904 00000100:00100000:2.0:1785774844.792039:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.792063:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969901 gen 2 00000004:00080000:2.0:1785774844.792077:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76057d0700, transno 4294969901 00000100:00100000:2.0:1785774844.792092:0:3654:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b7604d6a300 x1872519671307520/t4294969904(4294969904) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774860 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1785774844.792099:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7604d6a300/2, rc 0, transno 4294969904 00000100:00100000:2.0:1785774844.792103:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307520:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.792113:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7604d69c00/2, rc 0, transno 4294969905 00000100:00100000:2.0:1785774844.792116:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308032:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.792125:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7604d69500/2, rc 0, transno 4294969902 00000100:00100000:2.0:1785774844.792128:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307648:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.792137:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76045aad80/2, rc 0, transno 4294969903 00000100:00100000:2.0:1785774844.792140:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308160:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.792148:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d3800/2, rc 0, transno 4294969901 00000100:00100000:2.0:1785774844.792151:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671306624:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774844.792177:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d1500/2, rc 0, transno 4294969902 00000100:00100000:2.0:1785774844.792180:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671307136:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1785774844.792196:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1785774844.792203:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792213:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792216:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792226:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792241:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792248:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fc6d704/0x7b7109e1d0a1628 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792268:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1785774844.792272:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792278:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792281:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792289:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792300:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792309:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009701423f/0x7b7109e1d0a162f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792321:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1785774844.792324:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792331:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792334:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792342:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792352:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792358:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001700aea0/0x7b7109e1d0a1636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792371:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1785774844.792374:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792380:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792384:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792391:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792399:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792406:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f840770/0x7b7109e1d0a163d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792416:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1785774844.792419:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792425:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792429:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792435:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792443:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792450:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7500a11/0x7b7109e1d0a1644 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792462:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1785774844.792465:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792484:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792487:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792494:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792504:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792511:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a164b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792523:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1785774844.792527:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792533:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792536:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792548:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792558:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792566:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a1652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792577:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1785774844.792580:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792587:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792590:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792597:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792607:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792614:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1659 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792630:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774844.792634:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792639:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792642:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792655:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792665:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792672:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792684:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774844.792688:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.792694:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.792697:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792868:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.792877:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792885:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044a00/0x7b7109e1d0a12d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792921:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792929:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792936:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792941:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.792944:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792950:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792962:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3d7b (ffff9b771992a100) 00010000:00010000:3.0:1785774844.792965:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.792968:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792975:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a12ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792988:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.792995:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793001:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793006:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793009:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793015:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793022:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x170e687b (ffff9b7731f8a900) 00010000:00010000:3.0:1785774844.793024:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793027:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793032:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a130a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793049:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793055:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793061:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793066:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793068:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793074:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793085:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x95f89f7b (ffff9b771992a900) 00010000:00010000:3.0:1785774844.793088:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793091:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793096:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1326 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793107:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793113:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793119:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793125:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793128:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793134:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793141:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xd905ca7b (ffff9b7602508200) 00010000:00010000:3.0:1785774844.793144:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793147:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793153:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a1342 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793183:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793190:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793196:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793201:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793204:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793211:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793218:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xee04d97b (ffff9b7731f8a100) 00010000:00010000:3.0:1785774844.793221:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793223:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793229:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a135e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793241:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793247:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793254:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793260:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793264:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793269:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793276:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xdfb2047b (ffff9b7602508300) 00010000:00010000:3.0:1785774844.793278:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793281:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793287:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a137a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793298:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793304:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793309:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793314:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793317:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793323:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793335:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x869c3b7b (ffff9b771992ac00) 00010000:00010000:3.0:1785774844.793337:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793340:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793346:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1396 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793358:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793365:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793371:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793376:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793379:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793384:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793390:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9bba767b (ffff9b7602508d00) 00010000:00010000:3.0:1785774844.793392:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793395:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793400:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a13b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793415:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793422:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793427:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793432:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793435:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793440:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793448:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x8b9857b (ffff9b7602508b00) 00010000:00010000:3.0:1785774844.793450:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793453:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793459:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a13ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793472:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793479:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793484:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793490:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793493:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793499:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793505:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb4d1abd0 (ffff9b7602508f00) 00010000:00010000:3.0:1785774844.793508:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793510:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793516:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7400/0x7b7109e1d0a13ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793530:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793536:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793543:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793548:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793550:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793555:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793564:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x7db3ad0 (ffff9b771992aa00) 00010000:00010000:3.0:1785774844.793566:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793569:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793574:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1406 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793585:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793592:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793598:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793602:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793605:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793611:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793618:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x798865d0 (ffff9b771992a700) 00010000:00010000:3.0:1785774844.793620:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793622:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793628:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744800/0x7b7109e1d0a1422 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793641:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793648:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793654:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793659:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793662:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793668:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793674:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xa0729cd0 (ffff9b771992a300) 00010000:00010000:3.0:1785774844.793677:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793679:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793685:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744c00/0x7b7109e1d0a143e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793697:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793703:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793723:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793729:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.793733:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793738:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793745:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe37fc7d0 (ffff9b7602508600) 00010000:00010000:3.0:1785774844.793748:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.793751:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793756:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a145a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793779:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.793786:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.794085:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774844.794092:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.794100:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774844.794104:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.794112:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.794124:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.794131:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a166e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.794146:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774844.794148:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774844.794150:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.796137:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.796157:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.796185:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.796202:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.796203:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.796205:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774844.797045:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797053:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.797057:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797064:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797080:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x507ed6d0 (ffff9b760572b300) 00010000:00010000:3.0:1785774844.797083:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.797086:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797092:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a1476 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797116:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797122:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797128:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797132:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.797135:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797141:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797149:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xea2c01d0 (ffff9b771992a800) 00010000:00010000:3.0:1785774844.797151:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.797154:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797173:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1492 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797189:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797196:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797202:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797207:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.797210:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797216:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797222:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xe91638d0 (ffff9b771992a200) 00010000:00010000:3.0:1785774844.797225:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.797228:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797234:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a14ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797248:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797253:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797259:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797264:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.797267:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797272:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.797280:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xfe3473d0 (ffff9b760572b100) 00010000:00010000:3.0:1785774844.797282:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.797285:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774844.797470:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774844.797565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.797620:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785774844.797637:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774844.797665:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.797686:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785774844.797706:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.798042:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671308928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774844.798114:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785774844.798136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785774844.798155:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a14ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798192:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798198:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798203:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798208:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.798211:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798217:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798229:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x133382d0 (ffff9b771992ad00) 00010000:00010000:3.0:1785774844.798232:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.798235:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798241:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a14e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798255:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798261:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798267:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798272:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea7800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.798275:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798280:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798288:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xeedd9295 (ffff9b760572bc00) 00010000:00010000:3.0:1785774844.798300:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.798303:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798309:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a1502 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798324:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798331:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798337:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798341:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.798344:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798350:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798357:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6be72195 (ffff9b760572b900) 00010000:00010000:3.0:1785774844.798360:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.798363:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798369:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a151e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798381:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798388:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798394:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798400:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dd600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.798403:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798409:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798425:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6d724c95 (ffff9b771992ae00) 00010000:00010000:3.0:1785774844.798427:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.798429:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798434:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dd600/0x7b7109e1d0a153a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798446:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798453:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798459:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.798464:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.798466:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800891:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800916:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x6a5c8395 (ffff9b760572bf00) 00010000:00010000:3.0:1785774844.800919:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.800925:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800931:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1556 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800962:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800968:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800974:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800980:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.800983:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800989:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.800997:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x609ae95 (ffff9b760572be00) 00010000:00010000:3.0:1785774844.800999:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.801001:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801007:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1572 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801019:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801026:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801032:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801037:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.801040:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801047:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801054:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x9d08bd95 (ffff9b760572bd00) 00010000:00010000:3.0:1785774844.801056:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.801059:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801065:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a158e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801076:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801082:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801087:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801092:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418dca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.801095:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801101:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801108:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x3615e895 (ffff9b771992af00) 00010000:00010000:3.0:1785774844.801110:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.801113:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801118:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418dca00/0x7b7109e1d0a15aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801131:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801137:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801143:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801148:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.801151:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801157:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801183:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0xb3001f95 (ffff9b760572b700) 00010000:00010000:3.0:1785774844.801185:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.801188:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801193:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a15c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801204:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801210:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801216:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801221:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b77418ddc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.801224:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801228:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801235:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x35965a95 (ffff9b771992a000) 00010000:00010000:3.0:1785774844.801237:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.801240:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801246:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a15e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801259:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801265:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801271:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801276:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774844.801279:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.801284:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.802555:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x74956995 (ffff9b7602184300) 00010000:00010000:3.0:1785774844.802561:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774844.802566:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.802574:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7605ec3800/0x7b7109e1d0a15fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.802616:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.804450:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.804456:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.804480:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.804500:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.804507:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfeaa277/0x7b7109e1d0a1621 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774844.811562:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308672 00000100:00100000:2.0:1785774844.811576:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308672 00000100:00100000:2.0:1785774844.811649:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308544 00000100:00100000:2.0:1785774844.811653:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308544 00000100:00100000:2.0:1785774844.811671:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309056 00000100:00100000:2.0:1785774844.811674:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309056 00000100:00100000:2.0:1785774844.811687:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309184 00000100:00100000:2.0:1785774844.811689:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309184 00000100:00100000:2.0:1785774844.811718:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257 00000100:00100000:2.0:1785774844.811726:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3654:x1872519671308672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.811759:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2520 count 1 00002000:00010000:2.0:1785774844.811810:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.811819:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.811836:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.811840:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.811847:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.811860:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.811871:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.811879:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.811898:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774844.812120:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3654:x1872519671308672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 393us (14553us total) trans 4294969909 rc 0/0 00000100:00100000:2.0:1785774844.812128:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257 00000100:00100000:2.0:1785774844.812265:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258 00000100:00100000:2.0:1785774844.812272:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3654:x1872519671308544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.812284:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2519 count 1 00002000:00010000:2.0:1785774844.812309:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.812315:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812329:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.812332:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.812336:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812344:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812351:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812358:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812371:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774844.812434:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3654:x1872519671308544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 162us (14766us total) trans 4294969910 rc 0/0 00000100:00100000:2.0:1785774844.812440:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258 00000100:00100000:2.0:1785774844.812453:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259 00000100:00100000:2.0:1785774844.812458:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3654:x1872519671309056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.812470:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2519 count 1 00002000:00010000:2.0:1785774844.812498:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.812504:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812519:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d7:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.812522:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.812526:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812536:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812545:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812553:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812567:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1785774844.812638:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3654:x1872519671309056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 180us (14930us total) trans 4294969908 rc 0/0 00000100:00100000:2.0:1785774844.812644:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259 00000100:00100000:2.0:1785774844.812656:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260 00000100:00100000:2.0:1785774844.812662:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3654:x1872519671309184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.812672:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2520 count 1 00002000:00010000:2.0:1785774844.812686:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.812692:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812703:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d8:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.812706:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.812710:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812719:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812726:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812733:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.812742:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1785774844.812811:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3654:x1872519671309184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 149us (14674us total) trans 4294969909 rc 0/0 00000100:00100000:2.0:1785774844.812817:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260 00000100:00100000:2.0:1785774844.812848:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.812882:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671309440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.812909:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.812933:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785774844.812939:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671308800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.812959:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.812975:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671309312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.812995:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.813018:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308928 00000100:00100000:2.0:1785774844.813023:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308928 00000100:00100000:2.0:1785774844.813044:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309440 00000100:00100000:2.0:1785774844.813047:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309440 00000100:00100000:2.0:1785774844.813056:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308800 00000100:00100000:2.0:1785774844.813058:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308800 00000100:00100000:2.0:1785774844.813066:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309312 00000100:00100000:2.0:1785774844.813068:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309312 00000100:00100000:2.0:1785774844.813079:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5261 00000100:00100000:2.0:1785774844.813084:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671308928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.813099:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2522 count 1 00002000:00010000:2.0:1785774844.813114:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.813119:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813128:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.813131:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.813135:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813144:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813152:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813180:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813190:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1785774844.813257:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671308928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 171us (408us total) trans 4294969911 rc 0/0 00000100:00100000:2.0:1785774844.813264:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5261 00000100:00100000:2.0:1785774844.813276:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262 00000100:00100000:2.0:1785774844.813282:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3656:x1872519671309440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.813292:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2522 count 1 00002000:00010000:2.0:1785774844.813305:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.813310:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813318:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9da:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.813321:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.813324:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813334:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813342:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813349:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813363:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1785774844.813422:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3656:x1872519671309440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 140us (510us total) trans 4294969910 rc 0/0 00000100:00100000:2.0:1785774844.813428:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262 00000100:00100000:2.0:1785774844.813439:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263 00000100:00100000:2.0:1785774844.813445:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671308800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.813455:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2521 count 1 00002000:00010000:2.0:1785774844.813469:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.813474:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813481:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.813484:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.813487:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813495:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813502:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813508:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813522:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1785774844.813574:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671308800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 129us (614us total) trans 4294969912 rc 0/0 00000100:00100000:2.0:1785774844.813580:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263 00000100:00100000:2.0:1785774844.813591:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5264 00000100:00100000:2.0:1785774844.813597:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3656:x1872519671309312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.813607:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2521 count 1 00002000:00010000:2.0:1785774844.813619:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.813624:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813632:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d9:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.813635:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.813639:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813647:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813655:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813661:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813674:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1785774844.813725:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3656:x1872519671309312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 128us (728us total) trans 4294969911 rc 0/0 00000100:00100000:2.0:1785774844.813730:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5264 00010000:00010000:2.0:1785774844.813751:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1785774844.813757:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813777:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.813782:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813791:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813807:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813815:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e4f6ee1/0x7b7109e1d0a1675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813832:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1785774844.813835:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813847:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.813850:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813857:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813867:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813874:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb31b402/0x7b7109e1d0a167c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813886:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1785774844.813889:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813895:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.813897:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813904:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813913:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813920:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009950ac62/0x7b7109e1d0a1683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813931:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1785774844.813934:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813941:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.813943:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813951:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813959:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813966:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084080eda/0x7b7109e1d0a168a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813977:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1785774844.813980:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813986:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.813989:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.813997:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814006:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814013:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f66129b/0x7b7109e1d0a1691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814024:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774844.814027:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814033:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.814037:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814044:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814054:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814061:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c305926e/0x7b7109e1d0a1698 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814072:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774844.814075:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814081:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.814084:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814092:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814101:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814108:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008096aa70/0x7b7109e1d0a169f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814120:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774844.814124:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814129:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.814133:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814144:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814153:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814182:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012c264e5/0x7b7109e1d0a16a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.814194:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.814196:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.814198:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774844.814230:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c17480/2, rc 0, transno 4294969909 00000100:00100000:2.0:1785774844.814244:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309184:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.814258:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c14000/2, rc 0, transno 4294969910 00000100:00100000:2.0:1785774844.814267:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308544:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774844.814276:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c16a00/2, rc 0, transno 4294969908 00000100:00100000:2.0:1785774844.814279:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309056:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.814288:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c16d80/2, rc 0, transno 4294969909 00000100:00100000:2.0:1785774844.814291:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671308672:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1785774844.814315:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774844.814346:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c16680/2, rc 0, transno 4294969912 00000100:00100000:2.0:1785774844.814350:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671308800:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774844.814357:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c14e00/2, rc 0, transno 4294969911 00000100:00100000:2.0:1785774844.814361:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671309312:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.814367:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c14a80/2, rc 0, transno 4294969911 00000100:00100000:2.0:1785774844.814370:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671308928:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774844.814376:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c15500/2, rc 0, transno 4294969910 00000100:00100000:2.0:1785774844.814379:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671309440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.814489:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.814517:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.814533:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671310208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.814549:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.814563:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785774844.814569:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.814585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.814598:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671310080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.814615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.814636:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309696 00000100:00100000:2.0:1785774844.814641:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309696 00000100:00100000:2.0:1785774844.814665:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310208 00000100:00100000:2.0:1785774844.814668:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310208 00000100:00100000:2.0:1785774844.814680:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309568 00000100:00100000:2.0:1785774844.814682:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309568 00000100:00100000:2.0:1785774844.814693:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310080 00000100:00100000:2.0:1785774844.814696:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310080 00000100:00100000:2.0:1785774844.814710:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5265 00000100:00100000:2.0:1785774844.814715:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3654:x1872519671309696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.814730:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2524 count 1 00002000:00010000:2.0:1785774844.814748:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.814754:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774844.815496:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5266 00000100:00100000:0.0:1785774844.815507:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3654:x1872519671310208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1785774844.815521:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2524 count 1 00002000:00010000:0.0:1785774844.815536:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.815541:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815552:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:0.0:1785774844.815556:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774844.815561:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815574:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815592:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815600:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815618:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774844.815742:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3654:x1872519671310208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 239us (1191us total) trans 4294969913 rc 0/0 00000100:00100000:0.0:1785774844.815749:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5266 00000100:00100000:0.0:1785774844.815776:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1785774844.815782:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3654:x1872519671309568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774844.815795:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2523 count 1 00002000:00010000:0.0:1785774844.815818:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.815823:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815831:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9db:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:0.0:1785774844.815834:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774844.815838:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815847:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815854:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815860:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.815874:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1785774844.815942:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3654:x1872519671309568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 160us (1355us total) trans 4294969912 rc 0/0 00000100:00100000:0.0:1785774844.815951:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1785774844.815962:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5268 00000100:00100000:0.0:1785774844.815967:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3654:x1872519671310080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1785774844.815978:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2523 count 1 00002000:00010000:0.0:1785774844.815991:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.816007:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.816015:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=1086s v=(0 0) 00000100:00100000:3.0:1785774844.816018:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785774844.816018:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774844.816021:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.816030:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.816038:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.816045:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774844.816051:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671308416:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1785774844.816053:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1785774844.816077:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1785774844.816102:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d3100/2, rc 0, transno 4294969905 00000100:00100000:0.0:1785774844.816105:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3654:x1872519671310080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (1489us total) trans 4294969914 rc 0/0 00000100:00100000:3.0:1785774844.816111:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671306752:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1785774844.816130:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d3b80/2, rc 0, transno 4294969906 00000100:00100000:3.0:1785774844.816134:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307264:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1785774844.816143:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7604d6bb80/2, rc 0, transno 4294969906 00000100:00100000:3.0:1785774844.816151:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307776:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1785774844.816175:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76045a9f80/2, rc 0, transno 4294969907 00000100:00100000:3.0:1785774844.816179:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671308288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.816190:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671309824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.816213:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774844.816223:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785774844.816243:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1785774844.816258:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d2a00/2, rc 0, transno 4294969907 00000100:00100000:3.0:1785774844.816262:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671306880:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1785774844.816270:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d1c00/2, rc 0, transno 4294969908 00000100:00100000:3.0:1785774844.816273:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785774844.816280:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785774844.816286:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671309952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.816320:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774844.816331:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785774844.816351:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774844.816368:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671307904 00000100:00100000:3.0:1785774844.816374:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671307904 00010000:00010000:2.0:1785774844.820088:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dc:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.820099:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.820109:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.820130:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.820144:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.820151:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.820181:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1785774844.820392:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3654:x1872519671309696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5672us (5870us total) trans 4294969913 rc 0/0 00000100:00100000:1.0:1785774844.820520:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671308416 00000100:00100000:1.0:1785774844.820529:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671308416 00000100:00100000:1.0:1785774844.820556:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309824 00000100:00100000:1.0:1785774844.820559:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309824 00000100:00100000:1.0:1785774844.820568:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310336 00000100:00100000:1.0:1785774844.820570:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310336 00000100:00100000:1.0:1785774844.820579:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671309952 00000100:00100000:1.0:1785774844.820581:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671309952 00000100:00100000:1.0:1785774844.820590:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310464 00000100:00100000:1.0:1785774844.820592:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310464 00000100:00100000:1.0:1785774844.820605:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269 00000100:00100000:1.0:1785774844.820613:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671308416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.820639:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2518 count 1 00002000:00010000:1.0:1785774844.820665:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.820671:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.820681:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d6:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.820684:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.820689:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.820700:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.820708:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.820716:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.820724:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1785774844.826085:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5268 00000100:00100000:1.0:1785774844.826422:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671308416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5807us (10340us total) trans 4294969914 rc 0/0 00000100:00100000:1.0:1785774844.826434:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269 00000100:00100000:1.0:1785774844.826454:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270 00000100:00100000:1.0:1785774844.826467:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671309824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.826498:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2525 count 1 00002000:00010000:1.0:1785774844.826532:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.826539:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826555:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dd:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.826559:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.826565:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826579:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826590:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826598:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826609:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1785774844.826757:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671309824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 296us (10543us total) trans 4294969915 rc 0/0 00000100:00100000:1.0:1785774844.826773:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270 00000100:00100000:1.0:1785774844.826787:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271 00000100:00100000:1.0:1785774844.826804:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3655:x1872519671310336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.826817:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2525 count 1 00002000:00010000:1.0:1785774844.826834:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.826839:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826848:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.826852:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.826855:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826865:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826873:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826880:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.826888:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1785774844.826959:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671310336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 156us (10715us total) trans 4294969915 rc 0/0 00000100:00100000:1.0:1785774844.826966:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271 00000100:00100000:1.0:1785774844.826979:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5272 00000100:00100000:1.0:1785774844.826986:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671309952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.826997:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2526 count 1 00002000:00010000:1.0:1785774844.827010:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.827016:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827024:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9de:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.827027:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.827030:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827040:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827048:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827056:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827064:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:1.0:1785774844.827135:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671309952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 149us (10814us total) trans 4294969916 rc 0/0 00000100:00100000:1.0:1785774844.827142:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5272 00000100:00100000:1.0:1785774844.827155:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5273 00000100:00100000:1.0:1785774844.827181:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3655:x1872519671310464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.827193:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2526 count 1 00002000:00010000:1.0:1785774844.827206:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.827210:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827224:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.827227:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.827230:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827239:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827247:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827254:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.827263:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:1.0:1785774844.827964:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671310464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 802us (11611us total) trans 4294969916 rc 0/0 00000100:00100000:1.0:1785774844.827972:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5273 00000100:00100000:3.0:1785774844.828142:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274 00000100:00100000:3.0:1785774844.828153:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671307904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785774844.828180:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2514 count 1 00002000:00010000:3.0:1785774844.828198:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774844.828204:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.828213:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d2:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:3.0:1785774844.828216:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774844.828220:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.828229:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.828237:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.828244:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.828253:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:3.0:1785774844.828337:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671307904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 187us (12318us total) trans 4294969917 rc 0/0 00000100:00100000:3.0:1785774844.828344:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274 00010000:00010000:3.0:1785774844.829258:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1785774844.829267:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829277:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9da00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829281:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829302:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829320:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829326:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9b1ff1/0x7b7109e1d0a16b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829352:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1785774844.829356:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829361:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829365:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829371:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829380:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829387:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0384ce/0x7b7109e1d0a16bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829399:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1785774844.829402:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829409:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9de00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829411:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829418:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829427:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829433:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a16c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829445:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1785774844.829449:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829454:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829457:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829469:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829479:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829486:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6379f72/0x7b7109e1d0a16ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829502:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1785774844.829505:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829512:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829515:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829523:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829532:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829539:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbcdcc2b/0x7b7109e1d0a16c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829559:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1785774844.829562:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829568:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829571:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829577:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829585:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829591:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a30ca0/0x7b7109e1d0a16d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829602:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785774844.829606:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829612:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829615:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829625:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829635:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829642:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5a8bf1c/0x7b7109e1d0a16d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829653:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785774844.829656:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829661:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829664:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829671:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829680:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829687:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077a25686/0x7b7109e1d0a16de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829703:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774844.829707:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829713:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829717:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829724:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829735:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829742:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a16e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829753:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774844.829757:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829774:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774844.829777:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829964:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829975:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829982:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a16ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.829997:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774844.829999:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774844.830001:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774844.830068:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5265 00010000:00010000:2.0:1785774844.831905:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.831922:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774844.832042:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671310592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.832108:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.832375:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310592 00000100:00100000:1.0:1785774844.832383:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310592 00000100:00100000:1.0:1785774844.832436:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275 00000100:00100000:1.0:1785774844.832446:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3653:x1872519671310592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.832470:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2527 count 1 00002000:00010000:1.0:1785774844.832499:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.832507:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.832522:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.832527:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.832534:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.832548:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.832557:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.832566:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.832583:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774844.832722:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3653:x1872519671310592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 277us (612us total) trans 4294969917 rc 0/0 00000100:00100000:1.0:1785774844.832729:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275 00010000:00010000:1.0:1785774844.832749:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.832754:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.832771:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.832776:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774844.834449:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671310720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785774844.834504:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785774844.834578:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.834603:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.834612:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a16f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.834635:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.834637:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.834639:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774844.834652:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.834680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.834707:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310720 00000100:00100000:1.0:1785774844.834713:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310720 00000100:00100000:1.0:1785774844.834746:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310848 00000100:00100000:1.0:1785774844.834749:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310848 00000100:00100000:1.0:1785774844.834779:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5276 00000100:00100000:1.0:1785774844.834787:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3654:x1872519671310720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.837953:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2528 count 1 00002000:00010000:1.0:1785774844.837989:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.837998:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838015:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.838020:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.838027:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838041:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838051:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838058:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838078:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774844.838272:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3654:x1872519671310720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3483us (3766us total) trans 4294969918 rc 0/0 00000100:00100000:1.0:1785774844.838281:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5276 00000100:00100000:1.0:1785774844.838392:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5277 00000100:00100000:1.0:1785774844.838402:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3655:x1872519671310848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.838413:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2529 count 1 00002000:00010000:1.0:1785774844.838426:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.838431:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838440:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.838443:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.838447:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838456:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838464:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838470:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838484:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774844.838542:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671310848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 143us (3861us total) trans 4294969919 rc 0/0 00000100:00100000:1.0:1785774844.838549:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5277 00010000:00010000:1.0:1785774844.838574:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774844.838580:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838588:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.838592:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838603:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838618:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838627:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a16fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838646:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.838650:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838657:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.838660:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838668:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838677:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838685:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000923ba6c5/0x7b7109e1d0a1701 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.838695:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.838697:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.838699:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.838703:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785774844.841733:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969908 is committed 00000004:00080000:2.0:1785774844.853048:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7741b38380/2, rc 0, transno 4294969917 00000100:00100000:2.0:1785774844.853071:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671310592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.853094:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671311104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.853155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.853226:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671311104 00000100:00100000:2.0:1785774844.853234:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671311104 00000100:00100000:2.0:1785774844.853275:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5278 00000100:00100000:2.0:1785774844.853284:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3653:x1872519671311104:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1785774844.856969:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.856976:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.856980:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774844.857033:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605f01c00/2, rc 0, transno 4294969919 00000100:00100000:1.0:1785774844.857044:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310848:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774844.857059:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c15880/2, rc 0, transno 4294969916 00000100:00100000:1.0:1785774844.857075:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671309952:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1785774844.857085:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7741b38e00/2, rc 0, transno 4294969916 00000100:00100000:1.0:1785774844.857088:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310464:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774844.857096:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c15c00/2, rc 0, transno 4294969915 00000100:00100000:1.0:1785774844.857100:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671309824:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1785774844.857108:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7741b3b480/2, rc 0, transno 4294969915 00000100:00100000:1.0:1785774844.857112:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310336:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774844.857121:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7604d69f80/2, rc 0, transno 4294969917 00000100:00100000:1.0:1785774844.857124:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671307904:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1785774844.857133:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76045a8000/2, rc 0, transno 4294969914 00000100:00100000:1.0:1785774844.857136:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671308416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774844.857150:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774844.857191:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.857243:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.857270:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671310976 00000100:00100000:1.0:1785774844.857275:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671310976 00000100:00100000:1.0:1785774844.857318:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5279 00000100:00100000:1.0:1785774844.857325:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3655:x1872519671310976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.857342:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2530 count 1 00002000:00010000:1.0:1785774844.857371:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.857381:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857396:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.857401:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.857408:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857421:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857432:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857439:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857454:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774844.857582:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3655:x1872519671310976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 257us (338us total) trans 4294969920 rc 0/0 00000100:00100000:1.0:1785774844.857590:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5279 00010000:00010000:1.0:1785774844.857612:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.857618:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857625:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.857630:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857640:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857657:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857664:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1708 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.857685:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.857687:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.857689:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774844.857722:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969908 gen 2 00000004:00080000:1.0:1785774844.857727:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d3800, transno 4294969901 00000004:00080000:1.0:1785774844.857730:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d1500, transno 4294969902 00000004:00080000:1.0:1785774844.857733:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d0e00, transno 4294969903 00000004:00080000:1.0:1785774844.857736:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d0380, transno 4294969904 00000004:00080000:1.0:1785774844.857738:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d3100, transno 4294969905 00000004:00080000:1.0:1785774844.857741:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d3b80, transno 4294969906 00000004:00080000:1.0:1785774844.857743:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d2a00, transno 4294969907 00000004:00080000:1.0:1785774844.857745:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d1c00, transno 4294969908 00000100:00100000:1.0:1785774844.857753:0:3655:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b7605c16d80 x1872519671308672/t4294969909(4294969909) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774860 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1785774844.857760:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605f03480/2, rc 0, transno 4294969920 00000100:00100000:1.0:1785774844.857772:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671310976:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.858276:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2527 count 1 00002000:00010000:2.0:1785774844.858307:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.858314:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.858325:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9df:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.858328:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.858333:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.858345:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.858352:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.858360:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.858376:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774844.858470:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3653:x1872519671311104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5186us (5314us total) trans 4294969918 rc 0/0 00000100:00100000:2.0:1785774844.858477:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5278 00000004:00080000:2.0:1785774844.858512:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb4a680/2, rc 0, transno 4294969918 00000100:00100000:2.0:1785774844.858517:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671311104:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.858603:0:8659:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 29 changes, 12 in progress, 3 in flight, 8 done 00000100:00100000:2.0:1785774844.858676:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671311616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.858702:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.858853:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774844.858860:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671311744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.858884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.858910:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671311616 00000100:00100000:2.0:1785774844.858915:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671311616 00000100:00100000:2.0:1785774844.858937:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671311744 00000100:00100000:2.0:1785774844.858940:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671311744 00000100:00100000:2.0:1785774844.858957:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5280 00000100:00100000:2.0:1785774844.858963:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3653:x1872519671311616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.858978:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2533 count 1 00002000:00010000:2.0:1785774844.858995:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.859000:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859009:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.859012:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.859016:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859031:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859039:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859046:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859059:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774844.859130:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3653:x1872519671311616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 166us (426us total) trans 4294969921 rc 0/0 00000100:00100000:2.0:1785774844.859136:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5280 00000100:00100000:2.0:1785774844.859149:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5281 00000100:00100000:2.0:1785774844.859154:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3653:x1872519671311744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.859187:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2534 count 1 00002000:00010000:2.0:1785774844.859202:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.859207:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859215:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.859218:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.859221:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859234:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859241:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859247:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859258:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1785774844.859317:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3653:x1872519671311744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 162us (431us total) trans 4294969922 rc 0/0 00000100:00100000:2.0:1785774844.859323:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5281 00010000:00010000:2.0:1785774844.859343:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774844.859348:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859356:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.859360:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859367:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859379:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859388:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd1478d/0x7b7109e1d0a170f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859404:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774844.859407:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859414:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.859417:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859425:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859435:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859442:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042f75c46/0x7b7109e1d0a1716 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859454:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774844.859457:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859464:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.859467:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859475:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859483:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859490:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c4999fc/0x7b7109e1d0a171d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859501:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.859503:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.859505:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774844.859522:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d3800/2, rc 0, transno 4294969922 00000100:00100000:2.0:1785774844.859531:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671311744:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774844.859539:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605f02680/2, rc 0, transno 4294969921 00000100:00100000:2.0:1785774844.859542:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671311616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.859580:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671312128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.859604:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.859629:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312128 00000100:00100000:2.0:1785774844.859633:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312128 00000100:00100000:2.0:1785774844.859652:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5282 00000100:00100000:2.0:1785774844.859657:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3653:x1872519671312128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.859668:0:14719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2537 count 1 00002000:00010000:2.0:1785774844.859683:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.859688:0:14719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859697:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.859700:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.859704:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859727:0:14719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859735:0:14719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859743:0:14719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.859754:0:14719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774844.863914:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.863933:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.863950:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.863954:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.863967:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.863989:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.863997:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e63bf2/0x7b7109e1d0a1724 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864033:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.864035:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.864037:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.864056:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.864073:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774844.864096:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671311360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.864186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.864228:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671311360 00000100:00100000:1.0:1785774844.864236:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671311360 00000100:00100000:1.0:1785774844.864276:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5283 00000100:00100000:1.0:1785774844.864284:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3655:x1872519671311360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.864312:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2531 count 1 00002000:00010000:1.0:1785774844.864339:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.864346:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864358:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.864362:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.864368:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864379:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864387:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864394:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864407:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774844.864534:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671311360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 249us (348us total) trans 4294969923 rc 0/0 00000100:00100000:1.0:1785774844.864541:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5283 00010000:00010000:1.0:1785774844.864562:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.864567:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864578:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.864581:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864588:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864598:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864605:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069c2c53b/0x7b7109e1d0a172b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.864622:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.864623:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.864625:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774844.864661:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605f00000/2, rc 0, transno 4294969923 00000100:00100000:1.0:1785774844.864673:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671311360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.864771:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671311872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.864796:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.864818:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785774844.864824:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671311488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.864843:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.864859:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671312000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.864880:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.865056:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774844.865067:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671312256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.865094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.865126:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671311872 00000100:00100000:2.0:1785774844.865130:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671311872 00000100:00100000:2.0:1785774844.865154:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671311488 00000100:00100000:2.0:1785774844.865157:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671311488 00000100:00100000:2.0:1785774844.865191:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312000 00000100:00100000:2.0:1785774844.865194:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312000 00000100:00100000:2.0:1785774844.865204:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312256 00000100:00100000:2.0:1785774844.865207:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312256 00000100:00100000:2.0:1785774844.865219:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5284 00000100:00100000:2.0:1785774844.865225:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671311872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.865238:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2535 count 1 00002000:00010000:2.0:1785774844.865254:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.865260:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865269:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.865273:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.865277:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865287:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865295:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865302:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865316:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774844.865386:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3655:x1872519671311872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (588us total) trans 4294969924 rc 0/0 00000100:00100000:2.0:1785774844.865391:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5284 00000100:00100000:2.0:1785774844.865405:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5285 00000100:00100000:2.0:1785774844.865411:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671311488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.865421:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2532 count 1 00002000:00010000:2.0:1785774844.865437:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.865442:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865449:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.865453:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.865456:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865464:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865471:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865478:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865491:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774844.865548:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3655:x1872519671311488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 137us (704us total) trans 4294969925 rc 0/0 00000100:00100000:2.0:1785774844.865554:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5285 00000100:00100000:2.0:1785774844.865566:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5286 00000100:00100000:2.0:1785774844.865572:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671312000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774844.865583:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2536 count 1 00002000:00010000:2.0:1785774844.865597:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.865602:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865610:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.865613:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.865617:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865626:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865634:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865641:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.865652:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1785774844.866893:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5287 00000100:00100000:1.0:1785774844.866907:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3653:x1872519671312256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.866924:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2538 count 1 00002000:00010000:1.0:1785774844.866943:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.866949:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.866960:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.866964:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.866968:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.866979:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.866987:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.866994:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867010:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1785774844.867116:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3653:x1872519671312256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 214us (2020us total) trans 4294969927 rc 0/0 00000100:00100000:1.0:1785774844.867123:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5287 00010000:00010000:1.0:1785774844.867145:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1785774844.867150:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867182:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec3600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.867187:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867197:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867211:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867218:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5a8d3e/0x7b7109e1d0a1732 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867240:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785774844.867243:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867249:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec2000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.867252:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867259:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867273:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867281:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008089f8cc/0x7b7109e1d0a1739 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867294:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774844.867297:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867303:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.867305:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867312:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867320:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867327:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1740 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867337:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.867340:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867346:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.867348:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867355:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867362:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867368:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caebb3f9/0x7b7109e1d0a1747 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867380:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.867382:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.867384:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774844.867423:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76045a9880/2, rc 0, transno 4294969927 00000100:00100000:1.0:1785774844.867434:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671312256:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1785774844.867480:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774844.867491:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671312384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.867519:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.867538:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312384 00000100:00100000:1.0:1785774844.867543:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312384 00000100:00100000:1.0:1785774844.867568:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5288 00000100:00100000:1.0:1785774844.867574:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3655:x1872519671312384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.867587:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2539 count 1 00002000:00010000:1.0:1785774844.867601:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.867607:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867615:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.867619:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.867624:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867633:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867641:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867648:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.867660:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774844.867935:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3655:x1872519671312000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 136us (826us total) trans 4294969926 rc 0/0 00000100:00100000:2.0:1785774844.867943:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5286 00010000:00010000:2.0:1785774844.867975:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774844.867980:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.867993:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.867996:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.868004:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.868014:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.868022:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a174e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.868038:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.868039:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.868041:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.868047:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774844.868119:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3653:x1872519671312128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8460us (8512us total) trans 4294969929 rc 0/0 00000100:00100000:2.0:1785774844.868126:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5282 00000004:00080000:3.0:1785774844.868538:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7741b39880/2, rc 0, transno 4294969918 00000100:00100000:3.0:1785774844.868549:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671310720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785774844.868556:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671311232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.868586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1785774844.868615:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c17100/2, rc 0, transno 4294969912 00000100:00100000:3.0:1785774844.868624:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309568:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1785774844.868653:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7604d69180/2, rc 0, transno 4294969914 00000100:00100000:3.0:1785774844.868657:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671310080:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1785774844.868667:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605c14700/2, rc 0, transno 4294969913 00000100:00100000:3.0:1785774844.868673:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671309696:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1785774844.868700:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7604d6b800/2, rc 0, transno 4294969913 00000100:00100000:3.0:1785774844.868705:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671310208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785774844.868888:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671312768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.868914:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774844.868929:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671313280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.868949:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774844.868963:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785774844.868968:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671312640:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.868987:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774844.868998:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671313152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785774844.869015:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.871412:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671311232 00000100:00100000:2.0:1785774844.871434:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671311232 00000100:00100000:2.0:1785774844.871483:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312768 00000100:00100000:2.0:1785774844.871486:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312768 00000100:00100000:2.0:1785774844.871502:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313280 00000100:00100000:2.0:1785774844.871505:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313280 00000100:00100000:2.0:1785774844.871521:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312640 00000100:00100000:2.0:1785774844.871525:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312640 00000100:00100000:2.0:1785774844.871538:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313152 00000100:00100000:2.0:1785774844.871541:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313152 00000100:00100000:2.0:1785774844.871554:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5289 00000100:00100000:2.0:1785774844.871563:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3654:x1872519671311232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.871594:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2528 count 1 00002000:00010000:2.0:1785774844.871628:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.871636:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.871654:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e0:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.871658:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.871664:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.871678:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.871688:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.871696:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774844.872618:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5290 00000100:00100000:3.0:1785774844.872631:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3654:x1872519671312768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785774844.872652:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2531 count 1 00002000:00010000:3.0:1785774844.872673:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774844.872679:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.872691:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e3:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:3.0:1785774844.872695:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774844.872699:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.872869:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774844.873061:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3654:x1872519671311232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1499us (4473us total) trans 4294969919 rc 0/0 00000100:00100000:2.0:1785774844.873069:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5289 00000100:00100000:2.0:1785774844.873093:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5291 00000100:00100000:2.0:1785774844.873099:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3654:x1872519671313280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.873112:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2535 count 1 00002000:00010000:2.0:1785774844.873127:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.873133:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.873141:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e7:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.873145:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.873150:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.873176:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.873186:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.873194:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.873209:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774844.873275:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3654:x1872519671313280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 176us (4324us total) trans 4294969920 rc 0/0 00000100:00100000:2.0:1785774844.873282:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5291 00000100:00100000:1.0:1785774844.873885:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3655:x1872519671312384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6309us (6363us total) trans 4294969928 rc 0/0 00000100:00100000:1.0:1785774844.873893:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5288 00000100:00100000:1.0:1785774844.873910:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5292 00000100:00100000:1.0:1785774844.873917:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3654:x1872519671312640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.873931:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2530 count 1 00002000:00010000:1.0:1785774844.873945:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.873950:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.873958:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e2:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.873961:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.873965:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.873974:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.873982:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.873989:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.874004:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1785774844.874071:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671312640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 155us (5083us total) trans 4294969921 rc 0/0 00000100:00100000:1.0:1785774844.874077:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5292 00000100:00100000:1.0:1785774844.874091:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5293 00000100:00100000:1.0:1785774844.874099:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3654:x1872519671313152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.874112:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2534 count 1 00002000:00010000:1.0:1785774844.874127:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.874131:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.874140:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e6:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.874143:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.874147:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.874155:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.874180:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.874187:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.874196:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1785774844.874253:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671313152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 154us (5236us total) trans 4294969922 rc 0/0 00000100:00100000:1.0:1785774844.874259:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5293 00010000:00010000:1.0:1785774844.874286:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785774844.874593:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.874609:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.874616:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.875968:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1785774844.876104:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671312768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3475us (7187us total) trans 4294969923 rc 0/0 00000100:00100000:3.0:1785774844.876114:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5290 00000004:00080000:3.0:1785774844.876175:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb48e00/2, rc 0, transno 4294969921 00000100:00100000:3.0:1785774844.876198:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671312640:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1785774844.876213:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb49180/2, rc 0, transno 4294969922 00000100:00100000:3.0:1785774844.876217:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671313152:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1785774844.876224:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb4b800/2, rc 0, transno 4294969923 00000100:00100000:3.0:1785774844.876228:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671312768:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1785774844.876235:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb4b100/2, rc 0, transno 4294969920 00000100:00100000:3.0:1785774844.876238:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671313280:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1785774844.876247:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb4a300/2, rc 0, transno 4294969919 00000100:00100000:3.0:1785774844.876251:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671311232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1785774844.876836:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1785774844.876844:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876855:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.876860:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876869:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876887:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876895:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1763 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876916:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774844.876921:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876927:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.876930:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876937:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876947:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876955:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf8b9610/0x7b7109e1d0a176a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876970:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774844.876973:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876979:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.876982:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876989:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.876998:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877005:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007368e068/0x7b7109e1d0a1771 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877016:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774844.877020:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877026:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.877030:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877037:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877046:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877053:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a175c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877066:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.877068:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.877070:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.877076:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774844.877088:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671312512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.877128:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.877190:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785774844.877210:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312512 00000100:00100000:2.0:1785774844.877213:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.877216:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312512 00000100:00100000:2.0:1785774844.877234:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785774844.877250:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313024 00000100:00100000:2.0:1785774844.877252:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.877252:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313024 00000100:00100000:2.0:1785774844.877267:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1785774844.877267:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313536 00000100:00100000:0.0:1785774844.877269:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313536 00000100:00100000:2.0:1785774844.877272:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671312896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.877291:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.877296:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671312896 00000100:00100000:0.0:1785774844.877299:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671312896 00000100:00100000:2.0:1785774844.877303:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785774844.877316:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5294 00000100:00100000:2.0:1785774844.877322:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.877324:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3656:x1872519671312512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.877335:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313920:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774844.877347:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2529 count 1 00000100:00100000:2.0:1785774844.877352:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774844.877368:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313408 00000100:00100000:2.0:1785774844.877372:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313408 00002000:00010000:0.0:1785774844.877374:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.877381:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774844.877385:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313920 00000100:00100000:2.0:1785774844.877387:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313920 00010000:00010000:0.0:1785774844.877395:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e1:0x0].0x0 since=1086s v=(0 0) 00000100:00100000:2.0:1785774844.877396:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5295 00010000:00010000:0.0:1785774844.877400:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e1:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1785774844.877401:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3656:x1872519671313024:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1785774844.877406:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1785774844.877411:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2533 count 1 00010000:00010000:0.0:1785774844.877418:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774844.877424:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.877428:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877429:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.877436:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877437:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e5:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.877439:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.877444:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877453:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.877456:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774844.877461:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877468:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877482:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774844.877564:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3656:x1872519671313024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 162us (348us total) trans 4294969924 rc 0/0 00000100:00100000:2.0:1785774844.877571:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5295 00000100:00100000:2.0:1785774844.877584:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5296 00000100:00100000:2.0:1785774844.877590:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3656:x1872519671313536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.877600:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2537 count 1 00002000:00010000:2.0:1785774844.877613:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.877618:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877626:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e9:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.877629:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.877633:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877642:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877649:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877656:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877670:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1785774844.877743:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3656:x1872519671313536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (488us total) trans 4294969925 rc 0/0 00000100:00100000:2.0:1785774844.877749:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5296 00000100:00100000:2.0:1785774844.877761:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5297 00000100:00100000:2.0:1785774844.877785:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3656:x1872519671312896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774844.877795:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2532 count 1 00002000:00010000:2.0:1785774844.877809:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774844.877815:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877823:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e4:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:2.0:1785774844.877825:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774844.877829:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877838:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877847:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877855:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.877869:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1785774844.877918:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3656:x1872519671312896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 133us (625us total) trans 4294969927 rc 0/0 00000100:00100000:0.0:1785774844.877918:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3656:x1872519671312512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 594us (788us total) trans 4294969926 rc 0/0 00000100:00100000:2.0:1785774844.877924:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5297 00010000:00010000:1.0:1785774844.877970:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.877978:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.877982:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.877995:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878006:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878014:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e464bcf/0x7b7109e1d0a1755 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878029:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1785774844.878033:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878039:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.878042:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878050:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878059:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878066:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a1778 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878085:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785774844.878088:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878095:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.878098:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878120:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878130:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878137:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eac0d7f/0x7b7109e1d0a177f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878148:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774844.878151:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878157:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.878191:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878204:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878214:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878221:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a1786 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878232:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.878234:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878240:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.878242:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878249:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878257:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878264:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a178d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.878279:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.878280:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.878283:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774844.879068:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5294 00000100:00100000:0.0:1785774844.879085:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5298 00000100:00100000:0.0:1785774844.879093:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3656:x1872519671313408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774844.879109:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2536 count 1 00002000:00010000:0.0:1785774844.879125:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.879140:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879149:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e8:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:0.0:1785774844.879152:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774844.879156:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879178:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879185:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879191:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879208:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774844.879306:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3656:x1872519671313408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 215us (1981us total) trans 4294969928 rc 0/0 00000100:00100000:0.0:1785774844.879313:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5298 00000100:00100000:0.0:1785774844.879326:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5299 00000100:00100000:0.0:1785774844.879332:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3656:x1872519671313920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774844.879342:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2540 count 1 00002000:00010000:0.0:1785774844.879354:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.879359:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879367:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ec:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:0.0:1785774844.879371:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774844.879375:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879384:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879391:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879399:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.879413:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1785774844.879477:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3656:x1872519671313920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 145us (2123us total) trans 4294969929 rc 0/0 00000100:00100000:0.0:1785774844.879483:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5299 00010000:00010000:2.0:1785774844.880531:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774844.880540:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880550:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9dc00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.880553:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880564:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880579:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880587:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000801f5deb/0x7b7109e1d0a1794 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880610:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774844.880614:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880627:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.880630:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880638:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880647:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880655:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b562d7e8/0x7b7109e1d0a179b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.880666:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.880668:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.880670:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.880676:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774844.880722:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb48000/2, rc 0, transno 4294969927 00000100:00100000:2.0:1785774844.880746:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671312896:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.880759:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307f800/2, rc 0, transno 4294969928 00000100:00100000:2.0:1785774844.880773:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313408:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.880782:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307ea00/2, rc 0, transno 4294969929 00000100:00100000:2.0:1785774844.880785:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313920:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.881034:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb49c00/2, rc 0, transno 4294969926 00000100:00100000:2.0:1785774844.881039:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671312512:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.881049:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fb4aa00/2, rc 0, transno 4294969924 00000100:00100000:2.0:1785774844.881052:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313024:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774844.881060:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307f480/2, rc 0, transno 4294969925 00000100:00100000:2.0:1785774844.881063:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671313536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.881717:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671314048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774844.881776:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.882027:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314048 00000100:00100000:0.0:1785774844.882035:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314048 00000100:00100000:0.0:1785774844.882084:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5300 00000100:00100000:0.0:1785774844.882093:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3656:x1872519671314048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774844.882114:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2541 count 1 00002000:00010000:0.0:1785774844.882140:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774844.882147:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.882180:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ed:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:0.0:1785774844.882185:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774844.882191:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.882204:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.882213:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.882221:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.882236:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774844.882372:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3656:x1872519671314048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 280us (596us total) trans 4294969930 rc 0/0 00000100:00100000:0.0:1785774844.882380:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5300 00010000:00010000:2.0:1785774844.888558:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774844.888573:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.888587:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.888592:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.888603:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.888626:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.888635:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ca01526/0x7b7109e1d0a17a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.888668:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.888671:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.888673:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785774844.888738:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307fb80/2, rc 0, transno 4294969930 00000100:00100000:2.0:1785774844.888771:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671314048:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1785774844.889095:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774844.889114:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671313664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774844.889222:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.889264:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671314176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774844.889297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1785774844.889330:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d3b80/2, rc 0, transno 4294969929 00000100:00100000:1.0:1785774844.889336:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671312128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774844.889345:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774844.889351:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671313792:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774844.889372:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774844.889400:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313664 00000100:00100000:1.0:1785774844.889408:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313664 00000100:00100000:1.0:1785774844.889456:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314176 00000100:00100000:1.0:1785774844.889459:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314176 00000100:00100000:1.0:1785774844.889471:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671313792 00000100:00100000:1.0:1785774844.889473:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671313792 00000100:00100000:1.0:1785774844.889493:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5301 00000100:00100000:1.0:1785774844.889501:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3653:x1872519671313664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.889531:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2538 count 1 00002000:00010000:1.0:1785774844.889560:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.889567:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.889587:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ea:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.889592:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.889599:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.889612:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.889622:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.889630:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.889643:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774844.889973:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3653:x1872519671313664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 290us (568us total) trans 4294969931 rc 0/0 00000100:00100000:1.0:1785774844.889981:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5301 00000100:00100000:1.0:1785774844.889998:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5302 00000100:00100000:1.0:1785774844.890004:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3653:x1872519671314176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.890019:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2542 count 1 00002000:00010000:1.0:1785774844.890033:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.890038:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890052:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ee:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.890055:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.890059:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890067:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890075:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890083:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890098:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774844.890184:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3653:x1872519671314176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 156us (870us total) trans 4294969932 rc 0/0 00000100:00100000:1.0:1785774844.890192:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5302 00000100:00100000:1.0:1785774844.890203:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5303 00000100:00100000:1.0:1785774844.890209:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3653:x1872519671313792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774844.890220:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2539 count 1 00002000:00010000:1.0:1785774844.890236:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.890241:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890254:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9eb:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.890257:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.890260:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890268:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890276:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890283:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890465:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1785774844.890530:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3653:x1872519671313792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 320us (1156us total) trans 4294969933 rc 0/0 00000100:00100000:1.0:1785774844.890536:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5303 00010000:00010000:1.0:1785774844.890558:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785774844.890563:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890571:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.890576:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890590:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890604:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890612:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890627:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774844.890630:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890636:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.890639:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890646:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890653:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890660:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eabfd41f/0x7b7109e1d0a17b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890674:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774844.890678:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890684:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774844.890687:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890694:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.890703:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774844.891641:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785774844.891678:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76045a8a80/2, rc 0, transno 4294969928 00000100:00100000:0.0:1785774844.891690:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671312384:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1785774844.891720:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7605f03100/2, rc 0, transno 4294969925 00000100:00100000:0.0:1785774844.891729:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671311488:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1785774844.891745:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d3100/2, rc 0, transno 4294969926 00000100:00100000:0.0:1785774844.891752:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671312000:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1785774844.891775:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d1500/2, rc 0, transno 4294969924 00000100:00100000:0.0:1785774844.891782:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671311872:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774844.891811:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671314432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774844.891847:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774844.891871:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774844.891876:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671314560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774844.891894:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785774844.892037:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e82d9d3/0x7b7109e1d0a17b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892061:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.892063:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.892065:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.892071:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774844.892081:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314432 00000100:00100000:1.0:1785774844.892086:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314432 00000100:00100000:1.0:1785774844.892126:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314560 00000100:00100000:1.0:1785774844.892129:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314560 00000100:00100000:1.0:1785774844.892148:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5304 00000100:00100000:1.0:1785774844.892154:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3655:x1872519671314432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.892195:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2541 count 1 00002000:00010000:1.0:1785774844.892221:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.892227:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892238:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.892241:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.892246:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892258:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892267:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892275:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892481:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774844.892597:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3655:x1872519671314432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 442us (749us total) trans 4294969930 rc 0/0 00000100:00100000:1.0:1785774844.892604:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5304 00000100:00100000:1.0:1785774844.892618:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5305 00000100:00100000:1.0:1785774844.892624:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3655:x1872519671314560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774844.892635:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2542 count 1 00002000:00010000:1.0:1785774844.892651:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774844.892655:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892663:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:1.0:1785774844.892666:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774844.892671:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892680:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892688:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892695:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774844.892920:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774844.892986:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3655:x1872519671314560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 362us (1090us total) trans 4294969931 rc 0/0 00000100:00100000:1.0:1785774844.892993:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5305 00000100:00100000:3.0:1785774844.897154:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671314304:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785774844.897238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774844.897273:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314304 00000100:00100000:3.0:1785774844.897281:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314304 00000100:00100000:3.0:1785774844.897336:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5306 00000100:00100000:3.0:1785774844.897345:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671314304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785774844.897376:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2540 count 1 00002000:00010000:3.0:1785774844.897405:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774844.897467:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.897483:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=1086s v=(0 0) 00010000:00010000:3.0:1785774844.897487:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774844.897493:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.897508:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.897519:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774844.897526:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774844.897627:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969918 is committed 00010000:00010000:2.0:1785774844.902964:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774844.902980:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.902994:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.902998:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903010:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903033:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903041:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a17be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903063:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774844.903067:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903073:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.903076:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903085:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903095:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903103:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a17c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903116:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774844.903120:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903127:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774844.903130:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903138:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903148:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774844.903156:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.903172:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774844.903175:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.917936:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774844.917950:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774844.918048:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307c380/2, rc 0, transno 4294969933 00000100:00100000:1.0:1785774844.919052:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671313792:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1785774844.919071:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307f100/2, rc 0, transno 4294969931 00010000:00010000:2.0:1785774844.928884:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774844.931478:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785774844.931492:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a17cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774844.936480:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671313664:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1785774844.936550:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307d180/2, rc 0, transno 4294969932 00000100:00100000:1.0:1785774844.936557:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671314176:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1785774844.936592:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b773fa81c00/2, rc 0, transno 4294969931 00000100:00100000:1.0:1785774844.936601:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671314560:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774844.936610:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307e300/2, rc 0, transno 4294969930 00000100:00100000:1.0:1785774844.936613:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671314432:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774844.959041:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3654:x1872519671314304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61691us (61796us total) trans 4294969932 rc 0/0 00000100:00100000:2.0:1785774844.959054:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5306 00000004:00080000:2.0:1785774844.959110:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760307d500/2, rc 0, transno 4294969932 00000100:00100000:2.0:1785774844.959129:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671314304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774845.096373:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774845.096397:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671314688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774845.096482:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774845.098733:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314688 00000100:00100000:0.0:1785774845.098746:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314688 00000100:00100000:0.0:1785774845.098832:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1785774845.098843:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671314688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774845.098878:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1785774845.098950:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671314688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774845.098957:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000004:00080000:0.0:1785774845.099018:0:8660:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1086949856860ns, next at 1087949854550ns, rc = 0 00000100:00100000:0.0:1785774845.099036:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774845.099047:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671314816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774845.099080:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785774845.099217:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774845.099229:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314816 00000100:00100000:1.0:1785774845.099233:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314816 00000100:00100000:1.0:1785774845.099261:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1785774845.099268:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3653:x1872519671314816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774845.099279:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774845.099321:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3653:x1872519671314816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774845.099328:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1785774845.099368:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671314816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774845.099398:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671314688:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1785774845.733340:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774846.116355:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671315200:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.116432:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774846.116644:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315200 00000100:00100000:0.0:1785774846.116651:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315200 00000100:00100000:0.0:1785774846.116697:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:0.0:1785774846.116705:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671315200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.116767:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671315200:12345-0@lo:400:kworker.0 Request processed in 62us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774846.116783:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:0.0:1785774846.116826:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671315200:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.116862:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671315328:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.116887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774846.116920:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315328 00000100:00100000:0.0:1785774846.116924:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315328 00000100:00100000:0.0:1785774846.116958:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1785774846.116964:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671315328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.117228:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671315072:0@lo:400:kworker.0 00000100:00100000:1.0:1785774846.117739:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671314944:0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.127862:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774846.127947:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671315584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774846.128001:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774846.128679:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315584 00000100:00100000:2.0:1785774846.128689:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315584 00000100:00100000:2.0:1785774846.128765:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:2.0:1785774846.128773:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671315584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774846.128823:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774846.128876:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671315584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774846.128883:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:2.0:1785774846.128937:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671315584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774846.129202:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315072 00000100:00100000:3.0:1785774846.129206:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315072 00000100:00100000:3.0:1785774846.129244:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1785774846.129251:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671315072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.129289:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671315072:12345-0@lo:400:kworker.0 Request processed in 39us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774846.129296:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1785774846.130747:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671315328:12345-0@lo:400:kworker.0 Request processed in 13778us (13854us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774846.130767:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1785774846.131278:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671315328:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.131344:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671315712:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.131386:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774846.131437:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315712 00000100:00100000:0.0:1785774846.131442:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315712 00000100:00100000:0.0:1785774846.131632:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1785774846.131640:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671315712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.131682:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671315712:12345-0@lo:400:kworker.0 Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774846.131688:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1785774846.131711:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671315712:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.131737:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671315840:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.131773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774846.131834:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671316224:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.131857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774846.131895:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671316352:0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.131913:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774846.131934:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315840 00000100:00100000:0.0:1785774846.131937:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315840 00000100:00100000:0.0:1785774846.131965:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316352 00000100:00100000:0.0:1785774846.131968:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316352 00000100:00100000:0.0:1785774846.133553:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1785774846.133569:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671315840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.133648:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671315840:12345-0@lo:400:kworker.0 Request processed in 86us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774846.133655:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1785774846.133669:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1785774846.133675:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671316352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774846.133700:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671316352:12345-0@lo:400:kworker.0 Request processed in 26us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774846.133705:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1785774846.133783:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671316352:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.133794:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671315840:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.136130:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671316096:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.136207:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774846.136259:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671315072:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.136279:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774846.136285:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671315968:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.136307:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774846.148224:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316224 00000100:00100000:3.0:1785774846.148239:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316224 00000100:00100000:3.0:1785774846.148299:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316096 00000100:00100000:3.0:1785774846.148302:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316096 00000100:00100000:3.0:1785774846.148326:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1785774846.148335:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3653:x1872519671316224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.148407:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3653:x1872519671316224:12345-0@lo:400:kworker.0 Request processed in 73us (16548us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774846.148424:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1785774846.148440:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1785774846.148446:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671316096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.148569:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671316096:12345-0@lo:400:kworker.0 Request processed in 123us (12361us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774846.148575:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1785774846.148617:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671316096:0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.151682:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315968 00000100:00100000:2.0:1785774846.151694:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315968 00000100:00100000:2.0:1785774846.151787:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1785774846.151799:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671315968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.151889:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671315968:12345-0@lo:400:kworker.0 Request processed in 93us (15580us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774846.151899:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00080000:2.0:1785774846.152822:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774846.152827:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785774846.152830:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774846.152869:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671316224:0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.152940:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671316736:0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.152973:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774846.153512:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671316608:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.153543:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774846.153573:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671315968:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.153585:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774846.153591:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671316480:0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.153613:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774846.153641:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316480 00000100:00100000:3.0:1785774846.153645:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316480 00000100:00100000:3.0:1785774846.153680:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1785774846.153687:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671316480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774846.153724:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671316480:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774846.153730:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:3.0:1785774846.153744:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774846.153772:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671316480:0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.154908:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316736 00000100:00100000:2.0:1785774846.154917:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316736 00000100:00100000:2.0:1785774846.154955:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316608 00000100:00100000:2.0:1785774846.154959:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316608 00000100:00100000:2.0:1785774846.154979:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1785774846.154998:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3653:x1872519671316736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.155060:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3653:x1872519671316736:12345-0@lo:400:kworker.0 Request processed in 63us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774846.155067:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1785774846.155080:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1785774846.155086:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671316608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.155119:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671316608:12345-0@lo:400:kworker.0 Request processed in 33us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774846.155125:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00080000:2.0:1785774846.155141:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774846.155180:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671316608:0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.155207:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969918 gen 2 00000004:00080000:2.0:1785774846.155212:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7604d69500, transno 4294969902 00000004:00080000:2.0:1785774846.155227:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76045aad80, transno 4294969903 00000004:00080000:2.0:1785774846.155231:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7604d6a300, transno 4294969904 00000004:00080000:2.0:1785774846.155234:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7604d69c00, transno 4294969905 00000004:00080000:2.0:1785774846.155237:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7604d6bb80, transno 4294969906 00000004:00080000:2.0:1785774846.155240:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76045a9f80, transno 4294969907 00000004:00080000:2.0:1785774846.155243:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c16a00, transno 4294969908 00000004:00080000:2.0:1785774846.155246:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c17480, transno 4294969909 00000004:00080000:2.0:1785774846.155248:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c15500, transno 4294969910 00000004:00080000:2.0:1785774846.155251:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c14e00, transno 4294969911 00000004:00080000:2.0:1785774846.155254:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c17100, transno 4294969912 00000004:00080000:2.0:1785774846.155256:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c14700, transno 4294969913 00000004:00080000:2.0:1785774846.155258:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76045a8000, transno 4294969914 00000004:00080000:2.0:1785774846.155261:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c15c00, transno 4294969915 00000004:00080000:2.0:1785774846.155263:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c15880, transno 4294969916 00000004:00080000:2.0:1785774846.155265:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7604d69f80, transno 4294969917 00000004:00080000:2.0:1785774846.155268:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb4a680, transno 4294969918 00000100:00100000:2.0:1785774846.155275:0:3653:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b773fb4a300 x1872519671311232/t4294969919(4294969919) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774860 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785774846.155285:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671316736:0@lo:400:kworker.0 00000004:00080000:0.0:1785774846.160677:0:9847:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 17 changes, 15 in progress, 0 in flight, 17 done 00000100:00100000:1.0:1785774846.163373:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774846.165631:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671315456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774846.165701:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774846.166645:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671315456 00000100:00100000:2.0:1785774846.166655:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671315456 00000100:00100000:2.0:1785774846.166704:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1785774846.166715:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671315456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774846.166760:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774846.166829:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671315456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774846.166836:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1785774846.167102:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671315456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774846.176536:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671314944 00000100:00100000:3.0:1785774846.176551:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671314944 00000100:00100000:2.0:1785774846.177559:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1785774846.177570:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671314944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.177666:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671314944:12345-0@lo:400:kworker.0 Request processed in 98us (14303us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774846.177674:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1785774846.178707:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671314944:0@lo:400:kworker.0 00000100:00100000:2.0:1785774846.640298:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1785774846.641095:0:9848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1088491933002ns, next at 1089491930507ns, rc = 0 00000100:00100000:2.0:1785774846.650761:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671316864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774846.651596:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774846.651785:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316864 00000100:00100000:0.0:1785774846.651795:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316864 00000100:00100000:0.0:1785774846.651850:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1785774846.651859:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3653:x1872519671316864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774846.651883:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774846.651944:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3653:x1872519671316864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774846.651951:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1785774846.652007:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671316864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785774846.764001:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774847.780437:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774848.806519:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774849.190707:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774849.190740:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671316992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774849.190807:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774849.190868:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671316992 00000100:00100000:1.0:1785774849.190876:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671316992 00000100:00100000:1.0:1785774849.190919:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:1.0:1785774849.190927:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671316992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774849.190959:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774849.191005:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671316992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.191012:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:1.0:1785774849.191056:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671316992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774849.195059:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671317248:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195137:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774849.195208:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671317760:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774849.195258:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671318272:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195281:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774849.195302:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1785774849.195308:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671317376:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774849.195344:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671317888:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195368:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774849.195608:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671318400:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195635:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774849.195673:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671317248 00000100:00100000:1.0:1785774849.195681:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671317248 00000100:00100000:1.0:1785774849.195737:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671317760 00000100:00100000:1.0:1785774849.195740:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671317760 00000100:00100000:1.0:1785774849.195769:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318272 00000100:00100000:1.0:1785774849.195772:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318272 00000100:00100000:1.0:1785774849.195786:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671317376 00000100:00100000:1.0:1785774849.195788:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671317376 00000100:00100000:1.0:1785774849.195804:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1785774849.195811:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671317248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195863:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671317248:12345-0@lo:400:kworker.0 Request processed in 52us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.195871:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1785774849.195888:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1785774849.195894:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671317760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195922:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671317760:12345-0@lo:400:kworker.0 Request processed in 29us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.195928:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1785774849.195938:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1785774849.195944:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671318272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.195970:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671318272:12345-0@lo:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.195976:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1785774849.195986:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1785774849.195991:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671317376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.196016:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671317376:12345-0@lo:400:kworker.0 Request processed in 24us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.196022:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1785774849.196039:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671317888 00000100:00100000:1.0:1785774849.196042:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671317888 00000100:00100000:1.0:1785774849.196068:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318400 00000100:00100000:1.0:1785774849.196071:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318400 00000100:00100000:1.0:1785774849.196151:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1785774849.196182:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671317888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.196263:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671317888:12345-0@lo:400:kworker.0 Request processed in 104us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.196269:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1785774849.196282:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1785774849.196287:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671318400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.196314:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671318400:12345-0@lo:400:kworker.0 Request processed in 27us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.196319:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00080000:1.0:1785774849.196340:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774849.196343:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774849.196346:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774849.196491:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671317504:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196525:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774849.196546:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671318016:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196566:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774849.196588:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671318528:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196608:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774849.196627:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1785774849.196633:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671317120:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196658:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774849.196678:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671317632:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196698:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774849.196714:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671318144:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196744:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774849.196769:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671317632 00000100:00100000:3.0:1785774849.196774:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671317632 00000100:00100000:3.0:1785774849.196804:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318144 00000100:00100000:3.0:1785774849.196807:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318144 00000100:00100000:3.0:1785774849.196823:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1785774849.196829:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671317632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196864:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671317632:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.196870:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1785774849.196882:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1785774849.196888:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671318144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.196915:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671318144:12345-0@lo:400:kworker.0 Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.196920:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1785774849.196940:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318016 00000100:00100000:3.0:1785774849.196943:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318016 00000100:00100000:3.0:1785774849.196964:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318528 00000100:00100000:3.0:1785774849.196967:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318528 00000100:00100000:3.0:1785774849.196987:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1785774849.196993:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3655:x1872519671318016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197022:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3655:x1872519671318016:12345-0@lo:400:kworker.0 Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.197028:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1785774849.197038:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1785774849.197043:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3655:x1872519671318528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197066:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3655:x1872519671318528:12345-0@lo:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.197071:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1785774849.197101:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671317504 00000100:00100000:3.0:1785774849.197104:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671317504 00000100:00100000:3.0:1785774849.197135:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:3.0:1785774849.197141:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671317504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197205:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671317504:12345-0@lo:400:kworker.0 Request processed in 63us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.197211:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00100000:3.0:1785774849.197237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671317120 00000100:00100000:3.0:1785774849.197241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671317120 00000100:00100000:3.0:1785774849.197263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1785774849.197269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671317120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197298:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671317120:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.197303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00080000:3.0:1785774849.197335:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774849.197338:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785774849.197340:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774849.197358:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671317120:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197370:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671317632:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197392:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671318144:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197400:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671317504:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197409:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671318016:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.197416:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671318528:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.197636:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671317376:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.197653:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671317888:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.197665:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671318400:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.197675:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671317248:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.197684:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671317760:0@lo:400:kworker.0 00000100:00100000:1.0:1785774849.197693:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671318272:0@lo:400:kworker.0 00000100:00100000:3.0:1785774849.681364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774849.681425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774849.681463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774849.681495:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615424 00000100:00100000:3.0:1785774849.681504:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615424 00000100:00100000:3.0:1785774849.681578:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 653 00000100:00100000:3.0:1785774849.681602:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648615424:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774849.681688:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648615424:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.681709:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 653 00000100:00100000:3.0:1785774849.681767:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615040 00000100:00100000:3.0:1785774849.681771:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615040 00000100:00100000:3.0:1785774849.681798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 569 00000100:00100000:3.0:1785774849.681804:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648615040:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774849.681830:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648615040:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774849.681836:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 569 00000100:00080000:3.0:1785774849.681861:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774849.682204:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615168 00000100:00100000:1.0:1785774849.682209:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615168 00000100:00100000:1.0:1785774849.682253:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1075 00000100:00100000:1.0:1785774849.682261:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648615168:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774849.682296:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648615168:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.682303:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1075 00000100:00080000:3.0:1785774849.682835:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774849.689754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774849.689790:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774849.689921:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615296 00000100:00100000:1.0:1785774849.689932:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615296 00000100:00100000:1.0:1785774849.690014:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1076 00000100:00100000:1.0:1785774849.690025:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648615296:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774849.690098:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648615296:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.690105:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1076 00000100:00100000:1.0:1785774849.690127:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615552 00000100:00100000:1.0:1785774849.690130:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615552 00000100:00100000:1.0:1785774849.690180:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 654 00000100:00100000:1.0:1785774849.690189:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648615552:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774849.690216:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648615552:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774849.690223:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 654 00000100:00080000:3.0:1785774849.691006:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774849.691012:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1785774849.832698:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774850.213611:0:8660:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1092064448447ns, next at 1093064445916ns, rc = 0 00000100:00100000:1.0:1785774850.213645:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671318656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774850.213723:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.213795:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318656 00000100:00100000:1.0:1785774850.213802:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318656 00000100:00100000:1.0:1785774850.213846:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1785774850.213855:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3656:x1872519671318656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774850.213883:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774850.213939:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3656:x1872519671318656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774850.213958:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1785774850.214009:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671318656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774850.216350:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671318784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774850.216424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.216475:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318784 00000100:00100000:1.0:1785774850.216482:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318784 00000100:00100000:1.0:1785774850.216532:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1785774850.216542:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671318784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774850.216562:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774850.216602:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671318784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774850.216609:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1785774850.216654:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671318784:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1785774850.223313:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000004:00080000:2.0:1785774850.223337:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00000100:00100000:1.0:1785774850.223582:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774850.223642:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.223677:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774850.223695:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.223726:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785774850.223733:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774850.223752:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.223767:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785774850.223784:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.223809:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319040 00000100:00100000:1.0:1785774850.223815:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319040 00000100:00100000:1.0:1785774850.223852:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319552 00000100:00100000:1.0:1785774850.223854:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319552 00000100:00100000:1.0:1785774850.223868:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319168 00000100:00100000:1.0:1785774850.223870:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319168 00000100:00100000:1.0:1785774850.223881:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319680 00000100:00100000:1.0:1785774850.223883:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319680 00000100:00100000:1.0:1785774850.223899:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5307 00000100:00100000:1.0:1785774850.223906:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3655:x1872519671319040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774850.223997:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2544 count 1 00002000:00010000:1.0:1785774850.224031:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.224039:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224056:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f0:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.224060:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.224067:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224222:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224235:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224243:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224260:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774850.224557:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671319040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 650us (914us total) trans 4294969934 rc 0/0 00000100:00100000:1.0:1785774850.224565:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5307 00000100:00100000:1.0:1785774850.224582:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5308 00000100:00100000:1.0:1785774850.224589:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3655:x1872519671319552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774850.224600:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2548 count 1 00002000:00010000:1.0:1785774850.224614:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.224619:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224628:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f4:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.224632:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.224636:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224652:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224661:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224668:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224681:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774850.224752:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671319552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 164us (1056us total) trans 4294969935 rc 0/0 00000100:00100000:1.0:1785774850.224759:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5308 00000100:00100000:1.0:1785774850.224770:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5309 00000100:00100000:1.0:1785774850.224776:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3655:x1872519671319168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774850.224786:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2545 count 1 00002000:00010000:1.0:1785774850.224798:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.224803:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224812:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f1:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.224815:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.224820:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224835:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224844:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224851:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.224866:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1785774850.225091:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5310 00000100:00100000:2.0:1785774850.225100:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3655:x1872519671319680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774850.225113:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2549 count 1 00002000:00010000:2.0:1785774850.225128:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.225134:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225142:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f5:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.225146:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.225150:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225175:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225184:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225198:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225223:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1785774850.225286:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3655:x1872519671319680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 187us (1500us total) trans 4294969937 rc 0/0 00000100:00100000:2.0:1785774850.225293:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5310 00010000:00010000:2.0:1785774850.225309:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1785774850.225315:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225324:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.225329:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225339:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225356:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225376:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caebb3f9/0x7b7109e1d0a17d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225393:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774850.225398:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225405:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.225408:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225416:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225426:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225433:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069c2c53b/0x7b7109e1d0a17da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225444:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774850.225448:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225454:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.225458:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225465:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225480:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225487:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d91b0a01/0x7b7109e1d0a17e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225508:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774850.225511:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225517:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.225521:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225529:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225538:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225545:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094999119/0x7b7109e1d0a17e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225555:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.225557:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.225559:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774850.225572:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671318912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.225603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.225622:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.225639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.225657:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785774850.225662:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.225679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.225692:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.225708:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.225742:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671318912 00000100:00100000:2.0:1785774850.225748:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671318912 00000100:00100000:2.0:1785774850.225767:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319424 00000100:00100000:2.0:1785774850.225769:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319424 00000100:00100000:2.0:1785774850.225776:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319296 00000100:00100000:2.0:1785774850.225778:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319296 00000100:00100000:2.0:1785774850.225786:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319808 00000100:00100000:2.0:1785774850.225788:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319808 00000100:00100000:2.0:1785774850.225798:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5311 00000100:00100000:2.0:1785774850.225803:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671318912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774850.225815:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2543 count 1 00002000:00010000:2.0:1785774850.225830:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.225835:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225843:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ef:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.225846:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.225850:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225859:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225867:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225874:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.225887:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774850.226697:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5312 00000100:00100000:0.0:1785774850.226707:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3654:x1872519671319424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774850.226731:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2547 count 1 00002000:00010000:0.0:1785774850.226748:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774850.226752:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.226766:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f3:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:0.0:1785774850.226769:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774850.226774:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.226784:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.226792:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.226798:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.226806:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1785774850.226882:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3654:x1872519671319424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 176us (1241us total) trans 4294969939 rc 0/0 00000100:00100000:0.0:1785774850.226888:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5312 00000100:00100000:0.0:1785774850.226905:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5313 00000100:00100000:1.0:1785774850.229212:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3655:x1872519671319168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4421us (5443us total) trans 4294969936 rc 0/0 00000100:00100000:1.0:1785774850.229224:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5309 00010000:00010000:1.0:1785774850.229254:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774850.229261:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229273:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.229277:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229287:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229304:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229312:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008864bd47/0x7b7109e1d0a17ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229330:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774850.229333:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229339:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.229341:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229348:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229356:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229362:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005638ca5/0x7b7109e1d0a17f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229374:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.229376:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.229378:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.229684:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.229690:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774850.229707:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5314 00000100:00100000:1.0:1785774850.229730:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671319808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785774850.229757:0:14725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2550 count 1 00002000:00010000:1.0:1785774850.229783:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.229789:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229801:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f6:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.229805:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.229810:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229822:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229832:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229839:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.229859:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774850.229901:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774850.229906:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774850.230438:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671318912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4632us (4833us total) trans 4294969938 rc 0/0 00000100:00100000:2.0:1785774850.230447:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5311 00000100:00100000:2.0:1785774850.230601:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774850.230636:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.230670:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774850.230691:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1785774850.230744:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b0700/2, rc 0, transno 4294969938 00000100:00100000:2.0:1785774850.230761:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671318912:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774850.230775:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b3480/2, rc 0, transno 4294969939 00000100:00100000:2.0:1785774850.230779:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.230793:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785774850.230799:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774850.230822:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.230832:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774850.230848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.230866:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671319936 00000100:00100000:2.0:1785774850.230872:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671319936 00000100:00100000:2.0:1785774850.230894:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320448 00000100:00100000:2.0:1785774850.230896:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320448 00000100:00100000:2.0:1785774850.230904:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320320 00000100:00100000:2.0:1785774850.230906:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320320 00000100:00100000:2.0:1785774850.230928:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320832 00000100:00100000:2.0:1785774850.230930:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320832 00000100:00100000:2.0:1785774850.230940:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5315 00000100:00100000:2.0:1785774850.230954:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3654:x1872519671319936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774850.230971:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2543 count 1 00002000:00010000:2.0:1785774850.230993:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.230998:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231010:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.231014:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.231019:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231033:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231041:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231053:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231067:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774850.231210:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3654:x1872519671319936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 256us (574us total) trans 4294969933 rc 0/0 00000100:00100000:2.0:1785774850.231216:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5315 00000100:00100000:2.0:1785774850.231229:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5316 00000100:00100000:2.0:1785774850.231234:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3654:x1872519671320448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774850.231245:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2547 count 1 00002000:00010000:2.0:1785774850.231258:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.231263:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231270:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.231273:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.231277:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231286:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231293:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231305:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231317:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774850.231374:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3654:x1872519671320448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (681us total) trans 4294969934 rc 0/0 00000100:00100000:2.0:1785774850.231379:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5316 00000100:00100000:2.0:1785774850.231391:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5317 00000100:00100000:2.0:1785774850.231397:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3654:x1872519671320320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774850.231408:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2546 count 1 00002000:00010000:2.0:1785774850.231420:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.231425:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231433:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.231436:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.231439:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231448:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231455:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231466:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231474:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1785774850.231533:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3654:x1872519671320320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 135us (708us total) trans 4294969935 rc 0/0 00000100:00100000:2.0:1785774850.231539:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5317 00000100:00100000:2.0:1785774850.231551:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5318 00000100:00100000:2.0:1785774850.231558:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3654:x1872519671320832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785774850.231569:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2550 count 1 00002000:00010000:2.0:1785774850.231581:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.231585:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231593:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.231595:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.231599:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231608:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231616:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231627:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231636:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1785774850.231691:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3654:x1872519671320832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 133us (842us total) trans 4294969936 rc 0/0 00000100:00100000:2.0:1785774850.231698:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5318 00010000:00010000:2.0:1785774850.231725:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1785774850.231730:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231738:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.231742:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231751:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231765:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231772:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007071e5d3/0x7b7109e1d0a1804 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231788:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785774850.231792:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231798:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.231801:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231808:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231815:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231822:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3b4d7c7/0x7b7109e1d0a180b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231831:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785774850.231834:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231840:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.231844:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231851:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231863:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231868:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048e3010f/0x7b7109e1d0a1812 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231878:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774850.231880:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231886:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.231889:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231896:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231904:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231910:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddb864eb/0x7b7109e1d0a1819 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.231918:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.231920:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.231922:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.231928:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774850.231980:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.232005:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1785774850.232030:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471f100/2, rc 0, transno 4294969935 00000100:00100000:2.0:1785774850.232041:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320320:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774850.232049:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471fb80/2, rc 0, transno 4294969936 00000100:00100000:2.0:1785774850.232053:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320832:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774850.232059:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471c700/2, rc 0, transno 4294969933 00000100:00100000:2.0:1785774850.232063:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319936:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785774850.232069:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471e680/2, rc 0, transno 4294969934 00000100:00100000:2.0:1785774850.232072:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774850.232145:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320960 00000100:00100000:2.0:1785774850.232148:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320960 00000100:00100000:2.0:1785774850.232180:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5319 00000100:00100000:2.0:1785774850.232186:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671320960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774850.232198:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2551 count 1 00002000:00010000:2.0:1785774850.232217:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.232222:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232231:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f7:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.232234:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.232237:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232251:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232258:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232264:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232276:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785774850.232302:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774850.232306:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232313:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774850.232317:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232324:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232334:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232340:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1820 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.232353:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.232356:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.232357:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.232364:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774850.232375:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671321472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774850.232400:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.232413:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774850.232418:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671321344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774850.232437:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1785774850.232525:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969932 is committed 00000100:00100000:2.0:1785774850.232661:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321472 00000100:00100000:2.0:1785774850.232665:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321472 00000100:00100000:2.0:1785774850.232682:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321344 00000100:00100000:2.0:1785774850.232684:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321344 00000100:00100000:2.0:1785774850.232694:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5320 00000100:00100000:2.0:1785774850.232699:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671321472:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774850.235634:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3654:x1872519671319296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774850.235673:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2546 count 1 00002000:00010000:0.0:1785774850.235706:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774850.235726:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235750:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f2:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:0.0:1785774850.235755:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774850.235761:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235774:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235785:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235793:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235824:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774850.235895:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5321 00000100:00100000:0.0:1785774850.235904:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3654:x1872519671321344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1785774850.235930:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2552 count 1 00002000:00010000:0.0:1785774850.235949:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774850.235954:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235962:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:0.0:1785774850.235965:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774850.235969:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235978:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235986:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.235992:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.236007:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1785774850.236184:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3654:x1872519671321344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 281us (3745us total) trans 4294969937 rc 0/0 00000100:00100000:0.0:1785774850.236192:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5321 00000100:00100000:0.0:1785774850.236245:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774850.236281:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774850.236312:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774850.236331:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774850.236344:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671321216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774850.236360:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774850.236377:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1785774850.236383:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774850.236401:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774850.236415:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774850.236434:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774850.236450:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671321088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785774850.236471:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774850.236482:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671321600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785774850.236501:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774850.236520:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320192 00000100:00100000:0.0:1785774850.236526:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320192 00000100:00100000:0.0:1785774850.236548:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320704 00000100:00100000:0.0:1785774850.236550:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320704 00000100:00100000:0.0:1785774850.236560:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321216 00000100:00100000:0.0:1785774850.236562:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321216 00000100:00100000:0.0:1785774850.236570:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320064 00000100:00100000:0.0:1785774850.236572:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320064 00000100:00100000:0.0:1785774850.236578:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671320576 00000100:00100000:0.0:1785774850.236580:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671320576 00000100:00100000:0.0:1785774850.236588:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321088 00000100:00100000:0.0:1785774850.236590:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321088 00000100:00100000:0.0:1785774850.236599:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321600 00000100:00100000:0.0:1785774850.236601:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321600 00000100:00100000:0.0:1785774850.236612:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5322 00000100:00100000:0.0:1785774850.236617:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671320192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1785774850.236629:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2545 count 1 00002000:00010000:0.0:1785774850.236643:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774850.236648:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.236657:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:0.0:1785774850.236660:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774850.236664:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.236678:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.236686:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.236693:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.236706:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1785774850.237465:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.237470:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237491:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237510:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237517:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923ba6c5/0x7b7109e1d0a17fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237535:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785774850.237538:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237544:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.237547:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237555:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237563:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237569:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a1827 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237587:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774850.237591:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237598:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9cc00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.237601:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237609:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237620:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237628:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d05f70/0x7b7109e1d0a182e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237639:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774850.237642:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237648:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.237652:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237665:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237674:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237681:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa1014da/0x7b7109e1d0a1835 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237691:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.237692:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.237694:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774850.237794:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3654:x1872519671319296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2185us (12113us total) trans 4294969940 rc 0/0 00000100:00100000:1.0:1785774850.237802:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5313 00000100:00100000:1.0:1785774850.237822:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5323 00000100:00100000:1.0:1785774850.237828:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671320704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.237842:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2549 count 1 00002000:00010000:1.0:1785774850.237857:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.237862:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237871:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.237875:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.237879:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237890:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237899:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237907:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.237919:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774850.238001:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671320704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 173us (1668us total) trans 4294969938 rc 0/0 00000100:00100000:1.0:1785774850.238007:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5323 00000100:00100000:1.0:1785774850.238020:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5324 00000100:00100000:1.0:1785774850.238026:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671321216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.238037:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2551 count 1 00002000:00010000:1.0:1785774850.238050:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.238055:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.238064:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.238067:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.238072:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.238087:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.238095:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.238103:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.238110:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774850.238179:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671321216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 153us (1818us total) trans 4294969939 rc 0/0 00000100:00100000:1.0:1785774850.238185:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5324 00000100:00100000:1.0:1785774850.238197:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5325 00010000:00010000:3.0:1785774850.243867:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774850.243883:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.243897:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.243902:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.243927:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.243958:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.243967:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eabfd41f/0x7b7109e1d0a183c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.243993:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774850.243997:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244009:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8e00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.244012:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244020:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244029:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244037:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a1843 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244049:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.244050:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.244052:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.244059:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774850.244100:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5326 00000100:00100000:3.0:1785774850.244119:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671320576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785774850.244152:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2548 count 1 00002000:00010000:3.0:1785774850.244441:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774850.244450:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244463:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:3.0:1785774850.244468:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774850.244474:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244496:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244506:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244513:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244533:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785774850.244708:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671320576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 598us (8271us total) trans 4294969940 rc 0/0 00000100:00100000:3.0:1785774850.244726:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5326 00000100:00100000:3.0:1785774850.244748:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5327 00000100:00100000:3.0:1785774850.244755:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3656:x1872519671321088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785774850.244768:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2552 count 1 00002000:00010000:3.0:1785774850.244784:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774850.244789:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244798:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f8:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:3.0:1785774850.244801:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774850.244805:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244816:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244824:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244831:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.244845:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1785774850.244932:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3656:x1872519671321088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 178us (8460us total) trans 4294969941 rc 0/0 00000100:00100000:3.0:1785774850.244939:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5327 00000100:00100000:3.0:1785774850.245760:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5328 00000100:00100000:3.0:1785774850.245769:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3656:x1872519671321600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785774850.245785:0:14722:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2554 count 1 00002000:00010000:3.0:1785774850.246145:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774850.246153:0:14722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246181:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:3.0:1785774850.246185:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774850.246190:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246261:0:14722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246270:0:14722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246277:0:14722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246286:0:14722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1785774850.246397:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671321600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 629us (9894us total) trans 4294969941 rc 0/0 00000100:00100000:3.0:1785774850.246405:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5328 00010000:00010000:3.0:1785774850.246431:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785774850.246436:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246444:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.246447:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246456:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246471:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.246479:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a184a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774850.246653:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3656:x1872519671320192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10034us (10370us total) trans 4294969942 rc 0/0 00000100:00100000:0.0:1785774850.246660:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5322 00000100:00100000:0.0:1785774850.246800:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3654:x1872519671319808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17075us (21090us total) trans 4294969942 rc 0/0 00000100:00100000:0.0:1785774850.246806:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5314 00000004:00080000:0.0:1785774850.246853:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b1f80/2, rc 0, transno 4294969936 00000100:00100000:0.0:1785774850.246869:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319168:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1785774850.246880:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b1180/2, rc 0, transno 4294969937 00000100:00100000:0.0:1785774850.246883:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319680:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1785774850.246891:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b0a80/2, rc 0, transno 4294969934 00000100:00100000:0.0:1785774850.246893:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319040:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1785774850.246901:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b2a00/2, rc 0, transno 4294969935 00000100:00100000:0.0:1785774850.246904:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671319552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1785774850.247921:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774850.247929:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.247939:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc0caa300) 00000100:00100000:1.0:1785774850.248636:0:3656:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969932 gen 2 00000004:00080000:1.0:1785774850.248644:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c16d80, transno 4294969909 00000004:00080000:1.0:1785774850.248656:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c14000, transno 4294969910 00000004:00080000:1.0:1785774850.248659:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c14a80, transno 4294969911 00000004:00080000:1.0:1785774850.248662:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605c16680, transno 4294969912 00000004:00080000:1.0:1785774850.248664:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7604d6b800, transno 4294969913 00000004:00080000:1.0:1785774850.248667:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7604d69180, transno 4294969914 00000004:00080000:1.0:1785774850.248671:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7741b3b480, transno 4294969915 00000004:00080000:1.0:1785774850.248673:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7741b38e00, transno 4294969916 00000004:00080000:1.0:1785774850.248675:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7741b38380, transno 4294969917 00000004:00080000:1.0:1785774850.248678:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7741b39880, transno 4294969918 00000004:00080000:1.0:1785774850.248681:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605f01c00, transno 4294969919 00000004:00080000:1.0:1785774850.248684:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605f03480, transno 4294969920 00000004:00080000:1.0:1785774850.248687:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605f02680, transno 4294969921 00000004:00080000:1.0:1785774850.248689:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d3800, transno 4294969922 00000004:00080000:1.0:1785774850.248692:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605f00000, transno 4294969923 00000004:00080000:1.0:1785774850.248694:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d1500, transno 4294969924 00000004:00080000:1.0:1785774850.248697:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7605f03100, transno 4294969925 00000004:00080000:1.0:1785774850.248700:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d3100, transno 4294969926 00000004:00080000:1.0:1785774850.248703:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76045a9880, transno 4294969927 00000004:00080000:1.0:1785774850.248705:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76045a8a80, transno 4294969928 00000004:00080000:1.0:1785774850.248707:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d3b80, transno 4294969929 00000004:00080000:1.0:1785774850.248710:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307e300, transno 4294969930 00000004:00080000:1.0:1785774850.248721:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fa81c00, transno 4294969931 00000004:00080000:1.0:1785774850.248724:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307d500, transno 4294969932 00000100:00100000:1.0:1785774850.248732:0:3656:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b760471c700 x1872519671319936/t4294969933(4294969933) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774866 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1785774850.248743:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471ca80/2, rc 0, transno 4294969940 00000100:00100000:1.0:1785774850.248748:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320576:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.248765:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7741b79500/2, rc 0, transno 4294969941 00000100:00100000:1.0:1785774850.248769:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671321088:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1785774850.248777:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d0e00/2, rc 0, transno 4294969941 00000100:00100000:1.0:1785774850.248780:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671321600:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.248789:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471c000/2, rc 0, transno 4294969942 00000100:00100000:1.0:1785774850.248792:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320192:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.248801:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471d180/2, rc 0, transno 4294969938 00000100:00100000:1.0:1785774850.248804:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320704:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.248813:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d1c00/2, rc 0, transno 4294969939 00000100:00100000:1.0:1785774850.248817:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671321216:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.248986:0:8659:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 5 changes, 12 in progress, 3 in flight, 24 done 00000100:00100000:1.0:1785774850.249066:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774850.249235:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.249278:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785774850.249285:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671321728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774850.249306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.249321:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774850.249337:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.249358:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671321856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774850.249377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.249394:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774850.249399:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671321984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774850.249417:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774850.249443:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671322112 00000100:00100000:1.0:1785774850.249449:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671322112 00000100:00100000:1.0:1785774850.249497:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321728 00000100:00100000:1.0:1785774850.249500:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321728 00000100:00100000:1.0:1785774850.249518:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671322240 00000100:00100000:1.0:1785774850.249520:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671322240 00000100:00100000:1.0:1785774850.249532:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321856 00000100:00100000:1.0:1785774850.249535:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321856 00000100:00100000:1.0:1785774850.249544:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671321984 00000100:00100000:1.0:1785774850.249546:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671321984 00000100:00100000:1.0:1785774850.249557:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5329 00000100:00100000:1.0:1785774850.249564:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671322112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.249588:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2558 count 1 00002000:00010000:1.0:1785774850.249618:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.249625:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249640:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.249644:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.249650:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249663:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249673:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249680:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249692:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785774850.249797:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671322112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 232us (561us total) trans 4294969943 rc 0/0 00000100:00100000:1.0:1785774850.249804:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5329 00000100:00100000:1.0:1785774850.249819:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5330 00000100:00100000:1.0:1785774850.249825:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671321728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.249836:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2555 count 1 00002000:00010000:1.0:1785774850.249850:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.249856:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249865:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.249868:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.249872:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249882:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249891:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249899:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.249906:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1785774850.249971:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671321728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 145us (663us total) trans 4294969944 rc 0/0 00000100:00100000:1.0:1785774850.249977:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5330 00000100:00100000:1.0:1785774850.249990:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5331 00000100:00100000:1.0:1785774850.249996:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3655:x1872519671322240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.250005:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2559 count 1 00002000:00010000:1.0:1785774850.250019:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.250024:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250037:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.250040:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.250045:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250055:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250064:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250071:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250092:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1785774850.250145:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671322240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 150us (806us total) trans 4294969945 rc 0/0 00000100:00100000:1.0:1785774850.250151:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5331 00000100:00100000:1.0:1785774850.250181:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5332 00000100:00100000:1.0:1785774850.250187:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3653:x1872519671321856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.250199:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2556 count 1 00002000:00010000:1.0:1785774850.250214:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.250218:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250231:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.250234:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.250237:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250246:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250253:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250260:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250269:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1785774850.250330:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3653:x1872519671321856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 142us (951us total) trans 4294969946 rc 0/0 00000100:00100000:1.0:1785774850.250336:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5332 00000100:00100000:1.0:1785774850.250349:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5333 00000100:00100000:1.0:1785774850.250355:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3653:x1872519671321984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.250366:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2557 count 1 00002000:00010000:1.0:1785774850.250379:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.250384:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250398:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.250401:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.250405:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250414:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250422:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250430:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250439:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1785774850.250498:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3653:x1872519671321984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 142us (1079us total) trans 4294969947 rc 0/0 00000100:00100000:1.0:1785774850.250504:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5333 00000004:00080000:1.0:1785774850.250551:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b1c00/2, rc 0, transno 4294969944 00000100:00100000:1.0:1785774850.250557:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671321728:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.250566:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b2300/2, rc 0, transno 4294969945 00000100:00100000:1.0:1785774850.250569:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322240:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.250576:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b0e00/2, rc 0, transno 4294969943 00000100:00100000:1.0:1785774850.250579:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322112:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.250600:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b1500/2, rc 0, transno 4294969947 00000100:00100000:1.0:1785774850.250604:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671321984:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1785774850.250611:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b1880/2, rc 0, transno 4294969946 00000100:00100000:1.0:1785774850.250614:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671321856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774850.250639:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3656:x1872519671320064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774850.250652:0:14730:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2544 count 1 00002000:00010000:1.0:1785774850.250666:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.250671:0:14730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250679:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.250682:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.250686:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250694:0:14730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250702:0:14730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250708:0:14730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.250729:0:14730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1785774850.250797:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3656:x1872519671320064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12593us (14394us total) trans 4294969948 rc 0/0 00000100:00100000:1.0:1785774850.250803:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5325 00000004:00080000:1.0:1785774850.250827:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b760471f800/2, rc 0, transno 4294969948 00000100:00100000:1.0:1785774850.250831:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671320064:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1785774850.251289:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1785774850.251297:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251307:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.251310:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251319:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251336:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251344:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97fff45/0x7b7109e1d0a1858 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251357:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1785774850.251361:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251367:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.251370:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251377:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251386:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251394:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ea1876/0x7b7109e1d0a185f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251407:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1785774850.251410:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251416:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.251419:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251427:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251437:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251444:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015df66d4/0x7b7109e1d0a1866 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251457:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785774850.251460:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251466:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.251469:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.251475:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251580:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251589:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251599:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251607:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bafd577c/0x7b7109e1d0a1851 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251620:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785774850.251624:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251630:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774850.251633:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251639:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251648:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251655:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf8b9610/0x7b7109e1d0a1874 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251664:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785774850.251667:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251672:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774850.251675:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251681:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251690:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251696:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b813b2fb/0x7b7109e1d0a187b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251705:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774850.251709:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251726:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9000 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774850.251730:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251737:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251746:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251752:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5a8ebfb/0x7b7109e1d0a1882 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.251762:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774850.251764:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774850.251766:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.253277:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.253293:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007368e068/0x7b7109e1d0a186d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.253313:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.253315:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.253317:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.253325:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774850.254746:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1785774850.255046:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2553 count 1 00000100:00100000:2.0:1785774850.255180:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671322368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.255228:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.255263:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671322880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.255282:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.255300:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774850.255306:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671322496:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.255322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.255342:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322624:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.255361:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.255377:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774850.255382:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.255401:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.255426:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671322368 00000100:00100000:2.0:1785774850.255431:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671322368 00000100:00100000:2.0:1785774850.255463:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671322880 00000100:00100000:2.0:1785774850.255466:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671322880 00000100:00100000:2.0:1785774850.255478:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671322496 00000100:00100000:2.0:1785774850.255481:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671322496 00000100:00100000:2.0:1785774850.255505:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671322624 00000100:00100000:2.0:1785774850.255507:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671322624 00000100:00100000:2.0:1785774850.255521:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671322752 00000100:00100000:2.0:1785774850.255523:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671322752 00000100:00100000:2.0:1785774850.255534:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5334 00000100:00100000:2.0:1785774850.255541:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3653:x1872519671322368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774850.255563:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2553 count 1 00002000:00010000:2.0:1785774850.255585:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.255593:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255608:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f9:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.255613:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.255620:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255634:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255650:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255658:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255674:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785774850.255765:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3653:x1872519671322368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 223us (536us total) trans 4294969944 rc 0/0 00000100:00100000:2.0:1785774850.255772:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5334 00000100:00100000:2.0:1785774850.255787:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5335 00000100:00100000:2.0:1785774850.255792:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3653:x1872519671322880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774850.255802:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2557 count 1 00002000:00010000:2.0:1785774850.255815:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.255820:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255829:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fd:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.255832:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.255836:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255845:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255859:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255866:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.255877:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774850.255931:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3653:x1872519671322880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 139us (648us total) trans 4294969945 rc 0/0 00000100:00100000:2.0:1785774850.255938:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5335 00010000:00010000:3.0:1785774850.256784:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785774850.256794:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256804:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.256809:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256818:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256833:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256840:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1889 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256858:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785774850.256862:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256867:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745600 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:3.0:1785774850.256870:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256876:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256884:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256890:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddd741f1/0x7b7109e1d0a1890 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.256900:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.256902:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774850.256904:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774850.257603:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5336 00000100:00100000:3.0:1785774850.257617:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3653:x1872519671322496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785774850.257640:0:14530:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2554 count 1 00002000:00010000:3.0:1785774850.257660:0:14530:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774850.257667:0:14530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.257677:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fa:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:3.0:1785774850.257681:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774850.257686:0:14530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.257696:0:14530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.257704:0:14530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.257720:0:14530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.257740:0:14530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785774850.257865:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3653:x1872519671322496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 252us (2541us total) trans 4294969946 rc 0/0 00000100:00100000:3.0:1785774850.257873:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5336 00000100:00100000:3.0:1785774850.257890:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5337 00000100:00100000:3.0:1785774850.257897:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3655:x1872519671322624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785774850.257919:0:14530:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2555 count 1 00002000:00010000:3.0:1785774850.257932:0:14530:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774850.257938:0:14530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774850.258031:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3654:x1872519671320960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22752us (22932us total) trans 4294969943 rc 0/0 00000100:00100000:0.0:1785774850.258041:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5319 00000100:00100000:0.0:1785774850.258059:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5338 00000100:00100000:0.0:1785774850.258066:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3655:x1872519671322752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785774850.259038:0:8661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2556 count 1 00002000:00010000:0.0:1785774850.259070:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:2.0:1785774850.259291:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603081f80/2, rc 0, transno 4294969946 00000100:00100000:2.0:1785774850.259308:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671322496:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774850.259331:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603080e00/2, rc 0, transno 4294969944 00000100:00100000:2.0:1785774850.259335:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671322368:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774850.259345:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603083480/2, rc 0, transno 4294969945 00000100:00100000:2.0:1785774850.259348:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671322880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.259427:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774850.259436:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671323008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.259480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.259521:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671323136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785774850.259544:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774850.259571:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323008 00000100:00100000:2.0:1785774850.259576:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323008 00000100:00100000:2.0:1785774850.259600:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323136 00000100:00100000:2.0:1785774850.259603:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323136 00000100:00100000:2.0:1785774850.259616:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5339 00000100:00100000:2.0:1785774850.259622:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3653:x1872519671323008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774850.259638:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2558 count 1 00002000:00010000:2.0:1785774850.259654:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.259659:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259671:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fe:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.259676:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.259681:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259694:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259703:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259720:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259738:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1785774850.259850:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3653:x1872519671323008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 227us (369us total) trans 4294969947 rc 0/0 00000100:00100000:2.0:1785774850.259857:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5339 00000100:00100000:2.0:1785774850.259874:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5340 00000100:00100000:2.0:1785774850.259881:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3655:x1872519671323136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774850.259892:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2559 count 1 00002000:00010000:2.0:1785774850.259905:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774850.259909:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259917:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:2.0:1785774850.259920:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774850.259924:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259932:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774850.259939:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.260024:0:8661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.260035:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fc:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:0.0:1785774850.260038:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774850.260043:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.260052:0:8661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.260060:0:8661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.260067:0:8661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.260307:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fb:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:3.0:1785774850.260310:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774850.260315:0:14530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.260325:0:14530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.260333:0:14530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.260340:0:14530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.260384:0:8661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1785774850.260466:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3655:x1872519671322752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2400us (5064us total) trans 4294969948 rc 0/0 00000100:00100000:0.0:1785774850.260473:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5338 00000004:00080000:0.0:1785774850.260598:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d0380/2, rc 0, transno 4294969937 00000100:00100000:0.0:1785774850.260604:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671321344:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1785774850.260616:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7741b78700/2, rc 0, transno 4294969943 00000100:00100000:0.0:1785774850.260619:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671320960:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1785774850.260628:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b0380/2, rc 0, transno 4294969940 00000100:00100000:0.0:1785774850.260630:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319296:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1785774850.260640:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76044b3b80/2, rc 0, transno 4294969942 00000100:00100000:0.0:1785774850.260643:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671319808:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1785774850.262284:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774850.265288:0:14530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1785774850.265482:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3655:x1872519671322624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7582us (10115us total) trans 4294969949 rc 0/0 00000100:00100000:3.0:1785774850.265497:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5337 00010000:00010000:0.0:1785774850.266386:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1785774850.266488:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1785774850.266497:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266509:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.266513:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266525:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266546:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266554:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bed4bde/0x7b7109e1d0a18ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266581:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785774850.266585:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266592:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.266596:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266604:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266614:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266621:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c5f54ea/0x7b7109e1d0a18a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266637:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785774850.266641:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266648:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.266651:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266658:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266667:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266674:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52674f5/0x7b7109e1d0a189e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266688:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774850.266692:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266699:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.266701:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266709:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266733:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.266740:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.266742:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.266744:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774850.267536:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785774850.267544:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b721ffbd/0x7b7109e1d0a18b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774850.267724:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3655:x1872519671323136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7830us (8164us total) trans 4294969950 rc 0/0 00000100:00100000:2.0:1785774850.267734:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5340 00000004:00080000:2.0:1785774850.267792:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76054b0700/2, rc 0, transno 4294969947 00000100:00100000:2.0:1785774850.267798:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671323008:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774850.267820:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76054b2a00/2, rc 0, transno 4294969950 00000100:00100000:2.0:1785774850.267824:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671323136:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774850.267833:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603080380/2, rc 0, transno 4294969948 00000100:00100000:2.0:1785774850.267836:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322752:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1785774850.267844:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603082300/2, rc 0, transno 4294969949 00000100:00100000:2.0:1785774850.267847:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671322624:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1785774850.267858:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.267925:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774850.268112:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.268121:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774850.268125:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.268133:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.268145:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774850.268152:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd435e7/0x7b7109e1d0a1897 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774850.272062:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774850.272086:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.272104:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=1092s v=(0 0) 00010000:00010000:1.0:1785774850.272109:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774850.272115:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.272135:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.272145:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.272153:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.272195:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785774850.275265:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774850.275280:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.275295:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774850.275300:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.275312:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.275332:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.275339:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077a25686/0x7b7109e1d0a18ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774850.275363:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.275365:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774850.275367:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774850.275556:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3654:x1872519671321472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 42852us (43151us total) trans 4294969949 rc 0/0 00000100:00100000:1.0:1785774850.275566:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5320 00000004:00080000:1.0:1785774850.275682:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b76068d2a00/2, rc 0, transno 4294969949 00000100:00100000:1.0:1785774850.275689:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671321472:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1785774850.275893:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774850.275896:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774850.275898:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785774850.276342:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969939 is committed 00010000:00010000:3.0:1785774850.280217:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785774850.465694:0:21920:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60j path oi.1/0x1:0xc:0x0 is not in 'O/1/d/' format 00010000:00010000:1.0:1785774850.866621:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774851.239153:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774851.239202:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671323264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774851.239336:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774851.239774:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323264 00000100:00100000:0.0:1785774851.239798:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323264 00000100:00100000:0.0:1785774851.239891:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:0.0:1785774851.239906:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671323264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774851.239969:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774851.240039:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671323264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774851.240047:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:0.0:1785774851.240107:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671323264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774851.240567:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774851.240585:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671323392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774851.240644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774851.240824:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323392 00000100:00100000:3.0:1785774851.240832:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323392 00000100:00100000:3.0:1785774851.240894:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1785774851.240904:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671323392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1785774851.240931:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774851.240975:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671323392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774851.240981:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1785774851.241017:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671323392:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785774851.241209:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774851.760081:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774851.760114:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671323520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774851.760224:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774851.760301:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323520 00000100:00100000:0.0:1785774851.760310:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323520 00000100:00100000:0.0:1785774851.760388:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1785774851.760399:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+16:3653:x1872519671323520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774851.760424:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774851.760471:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+16:3653:x1872519671323520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774851.760477:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00080000:0.0:1785774851.760498:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774851.760529:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969939 gen 2 00000004:00080000:0.0:1785774851.760534:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb4a300, transno 4294969919 00000004:00080000:0.0:1785774851.760541:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb4b100, transno 4294969920 00000004:00080000:0.0:1785774851.760544:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb48e00, transno 4294969921 00000004:00080000:0.0:1785774851.760547:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb49180, transno 4294969922 00000004:00080000:0.0:1785774851.760550:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb4b800, transno 4294969923 00000004:00080000:0.0:1785774851.760552:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb4aa00, transno 4294969924 00000004:00080000:0.0:1785774851.760555:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307f480, transno 4294969925 00000004:00080000:0.0:1785774851.760558:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb49c00, transno 4294969926 00000004:00080000:0.0:1785774851.760561:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b773fb48000, transno 4294969927 00000004:00080000:0.0:1785774851.760565:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307f800, transno 4294969928 00000004:00080000:0.0:1785774851.760567:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307ea00, transno 4294969929 00000004:00080000:0.0:1785774851.760570:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307fb80, transno 4294969930 00000004:00080000:0.0:1785774851.760573:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307f100, transno 4294969931 00000004:00080000:0.0:1785774851.760575:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307d180, transno 4294969932 00000004:00080000:0.0:1785774851.760577:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760307c380, transno 4294969933 00000004:00080000:0.0:1785774851.760580:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b0a80, transno 4294969934 00000004:00080000:0.0:1785774851.760583:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b2a00, transno 4294969935 00000004:00080000:0.0:1785774851.760585:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b1f80, transno 4294969936 00000004:00080000:0.0:1785774851.760588:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b1180, transno 4294969937 00000004:00080000:0.0:1785774851.760591:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b0700, transno 4294969938 00000004:00080000:0.0:1785774851.760594:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b3480, transno 4294969939 00000100:00100000:0.0:1785774851.760603:0:3653:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b76044b0380 x1872519671319296/t4294969940(4294969940) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785774866 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785774851.760622:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671323520:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1785774851.766231:0:9847:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 11 in progress, 0 in flight, 21 done 00010000:00010000:1.0:1785774851.876551:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774852.912462:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774853.924616:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785774854.014880:0:22018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774854.014888:0:22018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1785774854.014912:0:22018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1785774854.014919:0:22018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1785774854.165591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774854.165781:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615680 00000100:00100000:3.0:1785774854.165792:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615680 00000100:00100000:3.0:1785774854.165869:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24096 00000100:00100000:3.0:1785774854.165880:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:19535:x1872519648615680:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:3.0:1785774854.165927:0:6529:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff9b771ed86bf8 uarg=0000000000000000 00000004:00000080:3.0:1785774854.165972:0:6529:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff9b771ed86bf8 00000004:00000080:3.0:1785774854.165979:0:6529:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:3.0:1785774854.166017:0:6529:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785774854.166021:0:6529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1785774854.166040:0:6529:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:3.0:1785774854.166098:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1785774854.166104:0:6529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1785774854.166110:0:6529:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000100:00080000:1.0:1785774854.166662:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1785774854.167071:0:6529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1785774854.167318:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:19535:x1872519648615680:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 1436us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774854.167338:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24096 00000100:00100000:3.0:1785774854.308517:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671324032:0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.308606:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774854.308686:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671324544:0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.308713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774854.308730:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671325056:0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.308765:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774854.308789:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1785774854.308794:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671323904:0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.308817:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774854.308834:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671324416:0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.308852:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774854.308868:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671324928:0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.308886:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774854.308915:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323904 00000100:00100000:3.0:1785774854.308922:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323904 00000100:00100000:3.0:1785774854.308965:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:3.0:1785774854.308974:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671323904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.309024:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671323904:12345-0@lo:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774854.309031:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:3.0:1785774854.309068:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671323904:0@lo:400:kworker.0 00000100:00100000:1.0:1785774854.309302:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324032 00000100:00100000:1.0:1785774854.309307:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324032 00000100:00100000:1.0:1785774854.309332:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324416 00000100:00100000:1.0:1785774854.309335:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324416 00000100:00100000:1.0:1785774854.309359:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324928 00000100:00100000:1.0:1785774854.309362:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324928 00000100:00100000:1.0:1785774854.309383:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1785774854.309391:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671324032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774854.309430:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671324032:12345-0@lo:400:kworker.0 Request processed in 40us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774854.309436:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1785774854.309449:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1785774854.309455:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671324416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774854.309481:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671324416:12345-0@lo:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774854.309486:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1785774854.309497:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1785774854.309503:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671324928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774854.309528:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671324928:12345-0@lo:400:kworker.0 Request processed in 26us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774854.309534:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:1.0:1785774854.309558:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774854.309579:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671324416:0@lo:400:kworker.0 00000100:00100000:1.0:1785774854.309588:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671324928:0@lo:400:kworker.0 00000100:00100000:1.0:1785774854.309597:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671324032:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311096:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671323648:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311149:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774854.311228:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671324160:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311252:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774854.311278:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671324672:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311301:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774854.311330:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671325184:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311351:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774854.311373:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1785774854.311380:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671323776:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311401:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774854.311419:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671324288:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311438:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774854.311453:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671324800:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311472:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774854.311508:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324544 00000100:00100000:0.0:1785774854.311514:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324544 00000100:00100000:0.0:1785774854.311567:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325056 00000100:00100000:0.0:1785774854.311570:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325056 00000100:00100000:0.0:1785774854.311588:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324672 00000100:00100000:0.0:1785774854.311590:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324672 00000100:00100000:0.0:1785774854.311605:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325184 00000100:00100000:0.0:1785774854.311607:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325184 00000100:00100000:0.0:1785774854.311628:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1785774854.311634:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671324544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311705:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671324544:12345-0@lo:400:kworker.0 Request processed in 70us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.311712:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1785774854.311727:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1785774854.311734:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671325056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.311960:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671325056:12345-0@lo:400:kworker.0 Request processed in 226us (3193us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.311967:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1785774854.311980:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1785774854.311986:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671324672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.312022:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3655:x1872519671324672:12345-0@lo:400:kworker.0 Request processed in 36us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.312028:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1785774854.312039:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1785774854.312045:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3655:x1872519671325184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.312072:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3655:x1872519671325184:12345-0@lo:400:kworker.0 Request processed in 27us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.312078:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1785774854.312102:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324160 00000100:00100000:0.0:1785774854.312105:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324160 00000100:00100000:0.0:1785774854.312134:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:0.0:1785774854.312139:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671324160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.312201:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671324160:12345-0@lo:400:kworker.0 Request processed in 61us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.312207:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:0.0:1785774854.312232:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323776 00000100:00100000:0.0:1785774854.312236:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323776 00000100:00100000:0.0:1785774854.312257:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324288 00000100:00100000:0.0:1785774854.312259:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324288 00000100:00100000:0.0:1785774854.312270:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671324800 00000100:00100000:0.0:1785774854.312273:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671324800 00000100:00100000:0.0:1785774854.312285:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1785774854.312290:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671323776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.312317:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671323776:12345-0@lo:400:kworker.0 Request processed in 27us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.313463:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1785774854.313489:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1785774854.313500:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671324288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.313940:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671324288:12345-0@lo:400:kworker.0 Request processed in 443us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.313947:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1785774854.313961:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1785774854.313968:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671324800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.313999:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671324800:12345-0@lo:400:kworker.0 Request processed in 32us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.314004:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00080000:0.0:1785774854.314030:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774854.314035:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774854.314038:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774854.314099:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671324544:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.314112:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671325056:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.314144:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671323776:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.314154:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671324288:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.314184:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671324800:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.314206:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671324160:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.314218:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671324672:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.314228:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671325184:0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.315620:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671323648 00000100:00100000:0.0:1785774854.315632:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671323648 00000100:00100000:0.0:1785774854.315933:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1785774854.315941:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671323648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774854.316008:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671323648:12345-0@lo:400:kworker.0 Request processed in 68us (4859us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.316015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1785774854.316066:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671323648:0@lo:400:kworker.0 00000100:00100000:3.0:1785774854.321404:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774854.321430:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671325312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774854.321499:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774854.321605:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325312 00000100:00100000:3.0:1785774854.321613:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325312 00000100:00100000:3.0:1785774854.321938:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:3.0:1785774854.321949:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671325312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774854.321984:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:3.0:1785774854.322045:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671325312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774854.322052:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1785774854.322221:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671325312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774854.787919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774854.788965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774854.788994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774854.789021:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774854.789053:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616192 00000100:00100000:3.0:1785774854.789063:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616192 00000100:00100000:3.0:1785774854.789118:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616064 00000100:00100000:3.0:1785774854.789121:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616064 00000100:00100000:3.0:1785774854.789146:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 659 00000100:00100000:3.0:1785774854.789155:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648616192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774854.789245:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648616192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774854.789252:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 659 00000100:00100000:3.0:1785774854.789314:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 660 00000100:00100000:3.0:1785774854.789392:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648616064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774854.789423:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648616064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 102us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774854.789429:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 660 00000100:00100000:0.0:1785774854.791736:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615808 00000100:00100000:0.0:1785774854.792222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615808 00000100:00100000:0.0:1785774854.793107:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 571 00000100:00100000:0.0:1785774854.793119:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648615808:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774854.793223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648615808:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 106us (5312us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.793231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 571 00000100:00100000:0.0:1785774854.793816:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648615936 00000100:00100000:0.0:1785774854.793822:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648615936 00000100:00100000:0.0:1785774854.793872:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1083 00000100:00100000:0.0:1785774854.793880:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648615936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774854.793999:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648615936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 119us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774854.794005:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1083 00000100:00080000:0.0:1785774854.794023:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774854.794027:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774854.794030:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785774854.957846:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785774855.180087:0:22066:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007fffd3eea510 00000004:00000080:1.0:1785774855.180104:0:22066:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=424066b2 len=576 karg=ffff9b7735b22800 uarg=0000000000000000 00000004:00000080:1.0:1785774855.180292:0:22066:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b2 len=576 karg=ffff9b7735b22800 00000004:00000080:1.0:1785774855.180300:0:22066:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:1.0:1785774855.180366:0:22066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785774855.180372:0:22066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1785774855.180393:0:22066:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:1.0:1785774855.180439:0:22066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1785774855.180445:0:22066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1785774855.180545:0:22066:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:1.0:1785774855.181388:0:22066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00000080:1.0:1785774855.181417:0:22066:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0001: Purge request: id=1 00000040:00080000:0.0:1785774855.181608:0:22066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774855.181612:0:22066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1785774855.181681:0:22066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1785774855.181686:0:22066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1785774855.181720:0:22066:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:0.0:1785774855.181723:0:22066:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0001: changelog off 00000004:00000080:0.0:1785774855.185452:0:22066:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0001: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:0.0:1785774855.186049:0:22066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1785774855.186141:0:22066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774855.186145:0:22066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1785774855.186697:0:22066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1785774855.186705:0:22066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1785774855.333325:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671325440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774855.333396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774855.333474:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325440 00000100:00100000:1.0:1785774855.333483:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325440 00000100:00100000:1.0:1785774855.333526:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1785774855.333535:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+22:3653:x1872519671325440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774855.333561:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1785774855.333599:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+22:3653:x1872519671325440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774855.333607:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1785774855.333650:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671325440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774855.334229:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774855.334239:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671325568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774855.334268:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774855.334299:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325568 00000100:00100000:3.0:1785774855.334304:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325568 00000100:00100000:3.0:1785774855.334331:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1785774855.334337:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671325568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774855.334351:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1785774855.334382:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671325568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774855.334387:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1785774855.334419:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671325568:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1785774855.976069:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774856.356386:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671325696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774856.356488:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774856.356584:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325696 00000100:00100000:3.0:1785774856.356592:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325696 00000100:00100000:3.0:1785774856.356645:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1785774856.356665:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671325696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1785774856.356698:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774856.356751:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671325696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774856.356762:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1785774856.356809:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671325696:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785774856.358427:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774856.358819:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774856.358840:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671325824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774856.359002:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774856.359060:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325824 00000100:00100000:2.0:1785774856.359067:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325824 00000100:00100000:2.0:1785774856.359118:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:2.0:1785774856.359128:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671325824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774856.359187:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774856.359248:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671325824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774856.359362:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671325824:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1785774856.360501:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969949 is committed 00000100:00100000:2.0:1785774856.360838:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000001:00080000:0.0:1785774856.365359:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969950 is committed 00000004:00080000:2.0:1785774856.366215:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000040:00080000:0.0:1785774856.401561:0:22114:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774856.401570:0:22114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1785774856.402123:0:22114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1785774856.402133:0:22114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1785774856.868383:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671325952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774856.868480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774856.868542:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671325952 00000100:00100000:1.0:1785774856.868558:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671325952 00000100:00100000:1.0:1785774856.868817:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1785774856.868830:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671325952:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785774856.868837:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1785774856.868858:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774856.868945:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671325952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774856.868956:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1785774856.869042:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969950 gen 2 00000004:00080000:0.0:1785774856.869049:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b0380, transno 4294969940 00000004:00080000:0.0:1785774856.869062:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7741b79500, transno 4294969941 00000004:00080000:0.0:1785774856.869064:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b3b80, transno 4294969942 00000004:00080000:0.0:1785774856.869067:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7741b78700, transno 4294969943 00000004:00080000:0.0:1785774856.869071:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603080e00, transno 4294969944 00000004:00080000:0.0:1785774856.869073:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603083480, transno 4294969945 00000004:00080000:0.0:1785774856.869077:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603081f80, transno 4294969946 00000004:00080000:0.0:1785774856.869080:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76054b0700, transno 4294969947 00000004:00080000:0.0:1785774856.869083:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603080380, transno 4294969948 00000004:00080000:0.0:1785774856.869085:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603082300, transno 4294969949 00000004:00080000:0.0:1785774856.869088:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76054b2a00, transno 4294969950 00000100:00100000:0.0:1785774856.869104:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671325952:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1785774856.869322:0:9847:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 11 done 00010000:00010000:3.0:1785774856.999669:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774858.025590:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785774858.071695:0:22162:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785774858.071702:0:22162:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1785774858.072791:0:22162:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:1.0:1785774858.072995:0:22162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1785774858.227828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774858.230456:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616320 00000100:00100000:0.0:1785774858.230471:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616320 00000100:00100000:0.0:1785774858.230559:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24097 00000100:00100000:0.0:1785774858.230572:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:19568:x1872519648616320:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:0.0:1785774858.230618:0:6530:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9b771ed873f8 uarg=0000000000000000 00000004:00000080:0.0:1785774858.230677:0:6530:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9b771ed873f8 00000004:00000080:0.0:1785774858.230685:0:6530:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:0.0:1785774858.230725:0:6530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774858.230729:0:6530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1785774858.230772:0:6530:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:0.0:1785774858.230825:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:0.0:1785774858.230831:0:6530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1785774858.230835:0:6530:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1785774858.230849:0:6530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774858.230851:0:6530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000100:00080000:2.0:1785774858.231290:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1785774858.236742:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 400 count 1 00000040:00080000:0.0:1785774858.236758:0:6530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1785774858.237977:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:19568:x1872519648616320:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 7401us (10149us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774858.237989:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24097 00010000:00010000:3.0:1785774859.060586:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774859.432370:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671326208:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.432440:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774859.432522:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671326336:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.432589:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774859.432634:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326336 00000100:00100000:1.0:1785774859.432642:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326336 00000100:00100000:1.0:1785774859.432686:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:1.0:1785774859.432694:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671326336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.432743:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671326336:12345-0@lo:400:kworker.0 Request processed in 50us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774859.432751:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:1.0:1785774859.432788:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671326336:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.432836:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671326720:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.432858:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774859.432902:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671326848:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.432923:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774859.432962:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326208 00000100:00100000:1.0:1785774859.432966:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326208 00000100:00100000:1.0:1785774859.432992:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326720 00000100:00100000:1.0:1785774859.432995:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326720 00000100:00100000:1.0:1785774859.433019:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326848 00000100:00100000:1.0:1785774859.433021:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326848 00000100:00100000:1.0:1785774859.433041:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1785774859.433047:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671326208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433076:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671326208:12345-0@lo:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774859.433082:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1785774859.433094:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1785774859.433100:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671326720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433126:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671326720:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774859.433131:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1785774859.433142:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1785774859.433148:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671326848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433202:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671326848:12345-0@lo:400:kworker.0 Request processed in 54us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774859.433207:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1785774859.433235:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671326848:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433256:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671326720:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433264:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671326208:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433296:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671327232:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433315:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774859.433334:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671327232 00000100:00100000:1.0:1785774859.433337:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671327232 00000100:00100000:1.0:1785774859.433355:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1785774859.433360:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671327232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433399:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671327232:12345-0@lo:400:kworker.0 Request processed in 39us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774859.433404:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1785774859.433422:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671327232:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433443:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671327360:0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433460:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774859.433481:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671327360 00000100:00100000:1.0:1785774859.433484:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671327360 00000100:00100000:1.0:1785774859.433504:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1785774859.433509:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671327360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774859.433538:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671327360:12345-0@lo:400:kworker.0 Request processed in 29us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774859.433543:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1785774859.433563:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671327360:0@lo:400:kworker.0 00000100:00080000:2.0:1785774859.433789:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774859.433793:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774859.433798:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774859.433805:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671327744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774859.433830:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.433854:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671327744 00000100:00100000:2.0:1785774859.433857:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671327744 00000100:00100000:2.0:1785774859.433877:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:2.0:1785774859.433882:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671327744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774859.433920:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:2.0:1785774859.433972:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671327744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.433977:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:2.0:1785774859.434003:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671327744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774859.435234:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671326464:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.435304:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671326976:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435323:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.435337:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671327488:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.435368:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1785774859.435373:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671326080:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435393:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.435410:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671326592:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435426:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.435439:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671327104:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435453:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.435469:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671327616:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435498:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774859.435533:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326976 00000100:00100000:2.0:1785774859.435539:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326976 00000100:00100000:2.0:1785774859.435578:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671327488 00000100:00100000:2.0:1785774859.435581:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671327488 00000100:00100000:2.0:1785774859.435600:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671327104 00000100:00100000:2.0:1785774859.435603:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671327104 00000100:00100000:2.0:1785774859.435617:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671327616 00000100:00100000:2.0:1785774859.435619:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671327616 00000100:00100000:2.0:1785774859.435650:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1785774859.435656:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671326976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435692:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671326976:12345-0@lo:400:kworker.0 Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.435698:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1785774859.435710:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1785774859.435715:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671327488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435735:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671327488:12345-0@lo:400:kworker.0 Request processed in 21us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.435741:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1785774859.435748:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1785774859.435753:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671327104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435772:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671327104:12345-0@lo:400:kworker.0 Request processed in 19us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.435777:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1785774859.435785:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1785774859.435790:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671327616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435811:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671327616:12345-0@lo:400:kworker.0 Request processed in 21us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.435816:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1785774859.435830:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326080 00000100:00100000:2.0:1785774859.435833:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326080 00000100:00100000:2.0:1785774859.435853:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1785774859.435858:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671326080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435882:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671326080:12345-0@lo:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.435887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00080000:2.0:1785774859.435929:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774859.435933:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774859.435941:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326592 00000100:00100000:2.0:1785774859.435943:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326592 00000100:00100000:2.0:1785774859.435963:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:2.0:1785774859.435968:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671326592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.435994:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671326592:12345-0@lo:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.435999:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:2.0:1785774859.436024:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671326080:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.436034:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671326592:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.436041:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969949 gen 2 00000004:00080000:2.0:1785774859.436047:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471c700, transno 4294969933 00000004:00080000:2.0:1785774859.436056:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471e680, transno 4294969934 00000004:00080000:2.0:1785774859.436058:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471f100, transno 4294969935 00000004:00080000:2.0:1785774859.436061:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471fb80, transno 4294969936 00000004:00080000:2.0:1785774859.436064:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d0380, transno 4294969937 00000004:00080000:2.0:1785774859.436067:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471d180, transno 4294969938 00000004:00080000:2.0:1785774859.436070:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d1c00, transno 4294969939 00000004:00080000:2.0:1785774859.436072:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471ca80, transno 4294969940 00000004:00080000:2.0:1785774859.436074:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d0e00, transno 4294969941 00000004:00080000:2.0:1785774859.436077:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471c000, transno 4294969942 00000004:00080000:2.0:1785774859.436079:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b0e00, transno 4294969943 00000004:00080000:2.0:1785774859.436081:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b1c00, transno 4294969944 00000004:00080000:2.0:1785774859.436083:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b2300, transno 4294969945 00000004:00080000:2.0:1785774859.436085:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b1880, transno 4294969946 00000004:00080000:2.0:1785774859.436087:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76044b1500, transno 4294969947 00000004:00080000:2.0:1785774859.436089:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b760471f800, transno 4294969948 00000004:00080000:2.0:1785774859.436092:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b76068d2a00, transno 4294969949 00000100:00100000:2.0:1785774859.436095:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671327104:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.436103:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671327616:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.436111:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671326976:0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.436117:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671327488:0@lo:400:kworker.0 00000004:00080000:2.0:1785774859.436309:0:8659:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 17 done 00000100:00100000:2.0:1785774859.436325:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671326464 00000100:00100000:2.0:1785774859.436329:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671326464 00000100:00100000:2.0:1785774859.436352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1785774859.436357:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671326464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774859.436389:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671326464:12345-0@lo:400:kworker.0 Request processed in 32us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.436394:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1785774859.436416:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671326464:0@lo:400:kworker.0 00000020:00000080:2.0:1785774859.617381:0:22210:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffe7dbfa500 00000004:00000080:2.0:1785774859.617406:0:22210:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9b771189dc00 uarg=0000000000000000 00000004:00000080:2.0:1785774859.617462:0:22210:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9b771189dc00 00000004:00000080:2.0:1785774859.617471:0:22210:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:2.0:1785774859.618140:0:22210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785774859.618146:0:22210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1785774859.619594:0:22210:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:2.0:1785774859.619667:0:22210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:2.0:1785774859.619677:0:22210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1785774859.619727:0:22210:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:2.0:1785774859.619772:0:22210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785774859.619776:0:22210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1785774859.621819:0:22210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:2.0:1785774859.621836:0:22210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:2.0:1785774859.621887:0:22210:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=1 00000040:00080000:2.0:1785774859.621952:0:22210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785774859.621955:0:22210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1785774859.623674:0:22210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1785774859.623681:0:22210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1785774859.623719:0:22210:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1785774859.623721:0:22210:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:2.0:1785774859.630189:0:22210:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:2.0:1785774859.630407:0:22210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785774859.630411:0:22210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1785774859.632318:0:22210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:2.0:1785774859.632335:0:22210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1785774859.632449:0:22210:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785774859.632453:0:22210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1785774859.634211:0:22210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:2.0:1785774859.634227:0:22210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1785774859.922471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774859.922578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774859.922600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774859.922638:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616960 00000100:00100000:3.0:1785774859.922648:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616960 00000100:00100000:2.0:1785774859.923042:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616448 00000100:00100000:2.0:1785774859.923047:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616448 00000100:00100000:2.0:1785774859.923090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 573 00000100:00100000:2.0:1785774859.923100:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648616448:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774859.926460:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 665 00000100:00100000:3.0:1785774859.926494:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648616960:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774859.926578:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648616960:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 106us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774859.926585:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 665 00000100:00100000:3.0:1785774859.926686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774859.926713:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616704 00000100:00100000:3.0:1785774859.926721:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616704 00000100:00100000:3.0:1785774859.926760:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616576 00000100:00100000:3.0:1785774859.926762:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616576 00000100:00100000:3.0:1785774859.926781:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1090 00000100:00100000:3.0:1785774859.926787:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648616704:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774859.926813:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648616704:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774859.926823:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1090 00000100:00100000:3.0:1785774859.926832:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1091 00000100:00100000:3.0:1785774859.926838:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2416:x1872519648616576:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774859.926855:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2416:x1872519648616576:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 18us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774859.926861:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1091 00000100:00100000:3.0:1785774859.926933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774859.926950:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648616832 00000100:00100000:3.0:1785774859.926952:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648616832 00000100:00100000:3.0:1785774859.926976:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 666 00000100:00100000:3.0:1785774859.926981:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648616832:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774859.927001:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648616832:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774859.927007:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 666 00000100:00100000:2.0:1785774859.932555:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648616448:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 9446us (10080us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774859.932569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 573 00000100:00080000:2.0:1785774859.932632:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785774859.932638:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774859.932640:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785774860.068600:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774860.454363:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774860.454384:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671327872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774860.454445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774860.454796:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671327872 00000100:00100000:3.0:1785774860.454804:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671327872 00000100:00100000:3.0:1785774860.454846:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1785774860.454855:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671327872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774860.454881:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1785774860.454923:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671327872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774860.454929:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1785774860.454968:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671327872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774860.455308:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671328000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774860.455337:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774860.455373:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671328000 00000100:00100000:2.0:1785774860.455377:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671328000 00000100:00100000:2.0:1785774860.455398:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1785774860.455404:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671328000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774860.455413:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1785774860.455440:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671328000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774860.455446:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1785774860.455472:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671328000:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1785774860.741911:0:22258:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785774860.741924:0:22258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1785774860.742754:0:22258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:0.0:1785774860.742765:0:22258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1785774861.093840:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774861.476648:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671328256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774861.476724:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774861.477317:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671328128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774861.477354:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774861.477556:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671328128 00000100:00100000:3.0:1785774861.477564:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671328128 00000100:00100000:3.0:1785774861.477630:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:3.0:1785774861.477638:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671328128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1785774861.477676:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1785774861.477786:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671328128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774861.477794:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:2.0:1785774861.478333:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671328128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774861.480013:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671328256 00000100:00100000:0.0:1785774861.480028:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671328256 00000100:00100000:0.0:1785774861.480135:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1785774861.480147:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671328256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1785774861.480227:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774861.480812:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671328256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 665us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774861.480820:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1785774861.480949:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671328256:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1785774861.481634:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774861.989728:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774861.989804:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774861.989960:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671328384 00000100:00100000:0.0:1785774861.989969:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671328384 00000100:00100000:0.0:1785774861.990041:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1785774861.990050:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671328384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774861.990073:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774861.990126:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671328384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774861.990133:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00080000:2.0:1785774861.990271:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774861.990306:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671328384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785774862.117897:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774863.141349:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785774863.785032:0:22307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 12:34:20 (1785774860) 00000100:00100000:3.0:1785774864.012375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.012513:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648617216 00000100:00100000:0.0:1785774864.012524:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648617216 00000100:00100000:0.0:1785774864.012602:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24098 00000100:00100000:0.0:1785774864.012611:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:19731:x1872519648617216:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774864.012633:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774864.012636:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00080000:1.0:1785774864.012775:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785774864.012842:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b773c35a000/0x7b7109e1d09fd2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c22c expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.012862:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774864.012866:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774864.012880:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a18c1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c4fd expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.013012:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.013024:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.013034:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.013050:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.013057:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.013064:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774864.018328:0:21784:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa00:0x0], index 0: 0 00010000:00010000:0.0:1785774864.020788:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a18d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020809:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a18d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020821:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a18d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020866:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020878:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020884:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020890:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774864.020895:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020907:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020919:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774864.020922:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774864.020927:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020934:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a18c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774864.020948:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007eb29017 reply state 000000007169deca transno 4294984128 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020959:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.020964:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa58cf3a (ffff9b7707de8e00) 00010000:00010000:0.0:1785774864.020967:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774864.020969:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774864.021006:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a18c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4fd expref: 13 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.021022:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d000/0x7b7109e1d0a18d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c4fd expref: 12 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.021029:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a6:0x0].0x0 (ffff9b7707de8000) 00010000:00010000:0.0:1785774864.021032:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774864.021034:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9d000, rc 0) 00000100:00100000:0.0:1785774864.021109:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:19731:x1872519648617216:12345-192.168.202.31@tcp:101:dd.0 Request processed in 8498us (8741us total) trans 4294984128 rc 0/0 00000100:00100000:0.0:1785774864.021118:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24098 00000100:00100000:1.0:1785774864.039122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774864.039428:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648617344 00000100:00100000:3.0:1785774864.039437:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648617344 00000100:00100000:3.0:1785774864.039505:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5341 00000100:00100000:3.0:1785774864.039515:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:19731:x1872519648617344:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774864.039531:0:14729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774864.039551:0:14729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a18e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c504 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774864.039574:0:14729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774864.039606:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=1105s v=(0 0) 00010000:00010000:3.0:1785774864.039611:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774864.039619:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a18e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c504 expref: 8 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.039640:0:14729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a18e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c504 expref: 8 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.039651:0:14729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce600, rc 0) 00000100:00100000:3.0:1785774864.039707:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:19731:x1872519648617344:12345-192.168.202.31@tcp:101:dd.0 Request processed in 194us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.039713:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5341 00000100:00080000:1.0:1785774864.039988:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774864.048980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774864.049069:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648617600 00000100:00100000:2.0:1785774864.049079:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648617600 00000100:00100000:2.0:1785774864.049215:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5222 00000100:00100000:2.0:1785774864.049239:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:19731:x1872519648617600:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774864.049543:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:19731:x1872519648617600:12345-192.168.202.31@tcp:35:dd.0 Request processed in 317us (569us total) trans 4294984129 rc 0/0 00000100:00100000:2.0:1785774864.049551:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5222 00000100:00100000:0.0:1785774864.107950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.107986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.108019:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648617728 00000100:00100000:0.0:1785774864.108029:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648617728 00002000:00100000:0.0:1785774864.108085:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff9b7605c15880 x1872519648617728/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:555/0 lens 4584/0 e 0 to 0 dl 1785774875 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774864.108095:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c15880 with x1872519648617728 ext(0->4095) 00002000:00010000:0.0:1785774864.108101:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c15880 00000100:00100000:0.0:1785774864.108128:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 14 00000100:00100000:0.0:1785774864.108137:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648617728:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774864.109835:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648617856 00000100:00100000:0.0:1785774864.109845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648617856 00000100:00100000:0.0:1785774864.109900:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1493 00000100:00100000:0.0:1785774864.109909:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:18395:x1872519648617856:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774864.109922:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1785774864.109935:0:6516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1785774864.109939:0:6516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb mtime from disk: 0 -> 1785774607 00002000:00010000:0.0:1785774864.109941:0:6516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb atime from disk: 0 -> 1785774607 00002000:00010000:0.0:1785774864.109944:0:6516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb ctime from disk: 0 -> 1785774607 00002000:00010000:0.0:1785774864.109946:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1785774864.109970:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a5435e/0x7b7109e1d0894e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea022597ace expref: 6 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.110002:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774864.110059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:18395:x1872519648617856:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 151us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.110067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1493 00000100:00080000:0.0:1785774864.110091:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774864.122929:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648617728:12345-192.168.202.31@tcp:4:dd.0 Request processed in 14784us (14979us total) trans 4294969950 rc 0/0 00000100:00100000:2.0:1785774864.122942:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 14 00002000:00100000:2.0:1785774864.122955:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff9b7605c15880 x1872519648617728/t4294969950(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:555/0 lens 4584/448 e 0 to 0 dl 1785774875 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774864.122964:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c15880 with x1872519648617728 ext(0->4095) 00002000:00010000:2.0:1785774864.122971:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c15880 00000100:00100000:1.0:1785774864.139653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.139917:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648617984 00000100:00100000:0.0:1785774864.139926:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648617984 00000100:00100000:0.0:1785774864.139994:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1494 00000100:00100000:0.0:1785774864.140004:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:6199:x1872519648617984:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774864.140021:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:0.0:1785774864.140039:0:19895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 35583 00002000:00010000:0.0:1785774864.140042:0:19895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1785774312 00002000:00010000:0.0:1785774864.140044:0:19895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1785774312 00002000:00010000:0.0:1785774864.140047:0:19895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 72 00010000:00010000:0.0:1785774864.140071:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cddf4ae/0x7b7109e1d011982 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.31@tcp remote: 0x11643ea02257e044 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774864.140273:0:19895:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1785774864.140276:0:19895:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 0 -> 1785774863 00002000:00010000:0.0:1785774864.140278:0:19895:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 0 -> 1785774863 00002000:00010000:0.0:1785774864.140280:0:19895:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1785774864.140291:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbbc0d9/0x7b7109e1d0a18e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c504 expref: 9 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.140328:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b5d8d7/0x7b7109e1d089402 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea022597a96 expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.140340:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774864.140399:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:6199:x1872519648617984:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 398us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.141034:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1494 00010000:00010000:1.0:1785774864.164338:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774864.425255:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774864.425387:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648618112 00000100:00100000:3.0:1785774864.425398:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648618112 00000100:00100000:3.0:1785774864.425467:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24099 00000100:00100000:3.0:1785774864.425478:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:19744:x1872519648618112:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:3.0:1785774864.425503:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774864.425525:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a18eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c50b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.425634:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a18f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.425648:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a18f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.425660:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a18f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774864.425764:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:3.0:1785774864.425769:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785774864.425814:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a18f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.425841:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a18eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c50b expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.425862:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a18f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c50b expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.425870:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774864.425873:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774864.425876:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cec00, rc 0) 00000100:00100000:3.0:1785774864.425943:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:19744:x1872519648618112:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 468us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.425949:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24099 00000100:00100000:2.0:1785774864.431407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774864.431491:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648618368 00000100:00100000:3.0:1785774864.431502:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648618368 00000100:00100000:3.0:1785774864.431586:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24100 00000100:00100000:3.0:1785774864.431596:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:19744:x1872519648618368:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:3.0:1785774864.431625:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774864.431628:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785774864.431659:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a18f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c50b expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.431679:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774864.431793:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774864.431808:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a18f9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c512 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.431936:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1900 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.431953:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.431966:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774864.431979:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a6:0x0]: returning size 4096 00010000:00010000:3.0:1785774864.433549:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a18f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c512 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.433570:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c512 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774864.433591:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a6:0x0].0x0 (ffff9b7707de8000) 00010000:00010000:3.0:1785774864.433593:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774864.433596:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cea00, rc 0) 00000100:00100000:3.0:1785774864.433666:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:19744:x1872519648618368:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 2071us (2274us total) trans 4294984130 rc 0/0 00000100:00100000:3.0:1785774864.433680:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24100 00000100:00100000:1.0:1785774864.443438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.445736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648618496 00000100:00100000:0.0:1785774864.445751:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648618496 00000100:00100000:0.0:1785774864.445828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1495 00000100:00100000:0.0:1785774864.445837:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7707d70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648618496:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774864.445852:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774864.445875:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1900 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c512 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.445893:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a6:0x0].0x0 (ffff9b7707de8000) 00010000:00010000:0.0:1785774864.445898:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774864.445959:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7707d70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648618496:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 123us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.445965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1495 00000100:00100000:0.0:1785774864.447435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774864.447705:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648618624 00000100:00100000:2.0:1785774864.447712:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648618624 00000100:00100000:2.0:1785774864.447757:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5342 00000100:00100000:2.0:1785774864.447766:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2417:x1872519648618624:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:2.0:1785774864.447782:0:14712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774864.447801:0:14712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c519 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774864.447826:0:14712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa00:0x0] initial LVB size: 4096, mtime: 0x6a70c30f, atime: 0x0, ctime: 0x6a70c30f, blocks: 0x8 00010000:00010000:2.0:1785774864.447843:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=1106s v=(0 0) 00010000:00010000:2.0:1785774864.447848:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774864.447856:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 8 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774864.447875:0:14712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 8 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774864.447887:0:14712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:2.0:1785774864.447927:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648618624:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 162us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774864.447934:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5342 00000100:00100000:3.0:1785774864.458828:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774864.459001:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648618752 00000100:00100000:2.0:1785774864.459011:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648618752 00000100:00100000:2.0:1785774864.459071:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5343 00000100:00100000:2.0:1785774864.459079:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:19744:x1872519648618752:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:2.0:1785774864.459239:0:14722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774864.459259:0:14722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1915 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c520 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774864.459299:0:14722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 9 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774864.459309:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774864.459313:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774864.459318:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1915 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c520 expref: 9 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774864.459348:0:14722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 9 pid: 14712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774864.459361:0:14722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 9 pid: 14712 timeout: 1206 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774864.459373:0:14722:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14722:1872519671328512:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774864.459509:0:14722:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605e5ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1785774864.469074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.469225:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648618880 00000100:00100000:0.0:1785774864.469234:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648618880 00010000:00010000:0.0:1785774864.469274:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 10 pid: 14712 timeout: 1206 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774864.469315:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1675 00000100:00100000:0.0:1785774864.469324:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648618880:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774864.469339:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774864.469359:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 10 pid: 14712 timeout: 1206 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.469371:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 10 pid: 14712 timeout: 1206 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.469394:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774864.469398:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774864.469405:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1915 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c520 expref: 10 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.469414:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1915 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c520 expref: 10 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774864.469445:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1915 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c520 expref: 10 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774864.469458:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9541:1872519671328640:192.168.202.31@tcp:105: 00000100:00100000:0.0:1785774864.469534:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605d22c00 going to sleep for 11 seconds 00010000:00010000:2.0:1785774864.475261:0:14722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bed4bde/0x7b7109e1d0a190e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c519 expref: 10 pid: 14712 timeout: 1206 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774864.475290:0:14722:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:14722:1872519671328512:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774864.475323:0:14722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086adbb6d/0x7b7109e1d0a1915 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c520 expref: 9 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774864.475345:0:14722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744800, rc 0) 00000100:00100000:2.0:1785774864.475441:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:19744:x1872519648618752:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 16362us (16621us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774864.475450:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5343 00000100:00100000:2.0:1785774864.476307:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9541:1872519671328640:192.168.202.31@tcp:105: 00010000:00010000:2.0:1785774864.476320:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774864.476364:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648618880:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 7038us (7296us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774864.476373:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1675 00000100:00100000:0.0:1785774864.492853:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774864.492960:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648619008 00000100:00100000:1.0:1785774864.492970:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648619008 00002000:00100000:1.0:1785774864.493031:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff9b7605c14380 x1872519648619008/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1785774875 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774864.493042:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c14380 with x1872519648619008 ext(0->4095) 00002000:00010000:1.0:1785774864.493048:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c14380 00000100:00100000:1.0:1785774864.493081:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00100000:1.0:1785774864.493100:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648619008:12345-192.168.202.31@tcp:3:dd.0 00000100:00100000:1.0:1785774864.493290:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648619008:12345-192.168.202.31@tcp:3:dd.0 Request processed in 201us (450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1785774864.493297:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 15 00002000:00100000:1.0:1785774864.493302:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff9b7605c14380 x1872519648619008/t0(0) o3->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:555/0 lens 488/4536 e 0 to 0 dl 1785774875 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774864.493310:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c14380 with x1872519648619008 ext(0->4095) 00002000:00010000:1.0:1785774864.493313:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c14380 00000100:00100000:1.0:1785774864.506095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.506282:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648619264 00000100:00100000:0.0:1785774864.506292:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648619264 00000100:00100000:0.0:1785774864.506357:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5223 00000100:00100000:0.0:1785774864.506366:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:19744:x1872519648619264:12345-192.168.202.31@tcp:35:multiop.0 00000100:00100000:0.0:1785774864.506659:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:19744:x1872519648619264:12345-192.168.202.31@tcp:35:multiop.0 Request processed in 294us (579us total) trans 4294984131 rc 0/0 00000100:00100000:0.0:1785774864.506667:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5223 00000100:00100000:3.0:1785774864.549218:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774864.549244:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671328768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774864.549323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774864.549919:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671329280:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.549950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774864.549977:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671329792:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550001:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774864.550035:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671330304:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550059:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774864.550075:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1785774864.550080:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671328896:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550116:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774864.550137:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671329408:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774864.550194:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671329920:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774864.550241:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329792 00000100:00100000:0.0:1785774864.550248:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329792 00000100:00100000:0.0:1785774864.550298:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330304 00000100:00100000:0.0:1785774864.550301:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330304 00000100:00100000:0.0:1785774864.550326:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1785774864.550333:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671329792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550374:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671329792:12345-0@lo:400:kworker.0 Request processed in 42us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.550380:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1785774864.550394:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1785774864.550399:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671330304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550421:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671330304:12345-0@lo:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.550426:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1785774864.550443:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671328896 00000100:00100000:0.0:1785774864.550446:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671328896 00000100:00100000:0.0:1785774864.550469:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1785774864.550476:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671328896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671328896:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.550505:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1785774864.550528:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329408 00000100:00100000:0.0:1785774864.550531:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329408 00000100:00100000:0.0:1785774864.550554:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329920 00000100:00100000:0.0:1785774864.550556:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329920 00000100:00100000:0.0:1785774864.550570:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1785774864.550586:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671329408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550801:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671329408:12345-0@lo:400:kworker.0 Request processed in 37us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.550810:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1785774864.550825:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1785774864.550831:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671329920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550861:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671329920:12345-0@lo:400:kworker.0 Request processed in 31us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774864.550866:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00080000:0.0:1785774864.550882:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774864.550886:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774864.550888:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774864.550921:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671328896:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550933:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671329408:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550941:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671329920:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550950:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671329792:0@lo:400:kworker.0 00000100:00100000:0.0:1785774864.550958:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671330304:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551066:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671329024:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551108:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774864.551136:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671329536:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551156:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774864.551197:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671330048:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551217:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774864.551237:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1785774864.551242:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671329152:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551263:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774864.551277:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671329664:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551296:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774864.551310:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671330176:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774864.551354:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329664 00000100:00100000:3.0:1785774864.551358:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329664 00000100:00100000:3.0:1785774864.551393:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330176 00000100:00100000:3.0:1785774864.551395:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330176 00000100:00100000:3.0:1785774864.551415:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1785774864.551420:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671329664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551456:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671329664:12345-0@lo:400:kworker.0 Request processed in 36us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.551462:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1785774864.551473:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1785774864.551478:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671330176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551502:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671330176:12345-0@lo:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.551508:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1785774864.551532:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329024 00000100:00100000:3.0:1785774864.551535:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329024 00000100:00100000:3.0:1785774864.551549:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329536 00000100:00100000:3.0:1785774864.551551:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329536 00000100:00100000:3.0:1785774864.551562:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330048 00000100:00100000:3.0:1785774864.551564:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330048 00000100:00100000:3.0:1785774864.551586:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329152 00000100:00100000:3.0:1785774864.551589:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329152 00000100:00100000:3.0:1785774864.551603:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1785774864.551608:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671329024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551846:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671329024:12345-0@lo:400:kworker.0 Request processed in 237us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.551853:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1785774864.551866:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1785774864.551872:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671329536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551901:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671329536:12345-0@lo:400:kworker.0 Request processed in 30us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.551907:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1785774864.551917:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1785774864.551922:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671330048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551942:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671330048:12345-0@lo:400:kworker.0 Request processed in 20us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.551948:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1785774864.551955:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1785774864.551961:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671329152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.551980:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671329152:12345-0@lo:400:kworker.0 Request processed in 20us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774864.551988:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1785774864.552437:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671329152:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.552452:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671329664:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.552461:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671330176:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.552470:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671329024:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.552478:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671329536:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.552486:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671330048:0@lo:400:kworker.0 00000100:00080000:0.0:1785774864.552589:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785774864.552594:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774864.552596:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774864.552810:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671328768 00000100:00100000:2.0:1785774864.552815:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671328768 00000100:00100000:2.0:1785774864.552852:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671329280 00000100:00100000:2.0:1785774864.552855:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671329280 00000100:00100000:2.0:1785774864.552881:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:2.0:1785774864.552887:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671328768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774864.552913:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:2.0:1785774864.552953:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671328768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774864.552958:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:2.0:1785774864.552968:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:2.0:1785774864.552973:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671329280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774864.553007:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671329280:12345-0@lo:400:kworker.0 Request processed in 33us (3055us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774864.553012:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:2.0:1785774864.553176:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671329280:0@lo:400:kworker.0 00000100:00100000:3.0:1785774864.553815:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671328768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774864.564279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774864.564429:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648619392 00000100:00100000:0.0:1785774864.564438:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648619392 00002000:00100000:0.0:1785774864.564479:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff9b76054b2d80 x1872519648619392/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:555/0 lens 4584/0 e 0 to 0 dl 1785774875 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774864.564489:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76054b2d80 with x1872519648619392 ext(0->4095) 00002000:00010000:0.0:1785774864.564494:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76054b2d80 00000100:00100000:0.0:1785774864.564523:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 16 00000100:00100000:0.0:1785774864.564531:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2419:x1872519648619392:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774864.565355:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2419:x1872519648619392:12345-192.168.202.31@tcp:4:dd.0 Request processed in 821us (1082us total) trans 4294969951 rc 0/0 00000100:00100000:0.0:1785774864.565367:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 16 00002000:00100000:0.0:1785774864.565375:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff9b76054b2d80 x1872519648619392/t4294969951(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:555/0 lens 4584/448 e 0 to 0 dl 1785774875 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774864.565382:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76054b2d80 with x1872519648619392 ext(0->4095) 00002000:00010000:0.0:1785774864.565386:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76054b2d80 00000100:00100000:1.0:1785774865.027759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774865.027812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774865.027916:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648619520 00000100:00100000:2.0:1785774865.027926:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648619520 00000100:00100000:2.0:1785774865.027987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 575 00000100:00100000:2.0:1785774865.027998:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648619520:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774865.028076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648619520:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774865.028083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 575 00000100:00100000:0.0:1785774865.028550:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648619648 00000100:00100000:0.0:1785774865.028556:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648619648 00000100:00100000:0.0:1785774865.028627:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1098 00000100:00100000:0.0:1785774865.028636:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648619648:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774865.028685:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648619648:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 51us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774865.028691:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1098 00000100:00080000:2.0:1785774865.028776:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1785774865.188505:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774865.573873:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671330432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774865.573945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774865.574364:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774865.574373:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671330560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774865.574416:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774865.574501:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330432 00000100:00100000:3.0:1785774865.574509:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330432 00000100:00100000:3.0:1785774865.574556:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330560 00000100:00100000:3.0:1785774865.574559:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330560 00000100:00100000:3.0:1785774865.574588:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1785774865.574596:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671330432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774865.574623:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84350656 pending 57344 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774865.574693:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671330432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774865.574700:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1785774865.574716:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1785774865.574722:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671330560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785774865.574744:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84350656 pending 57344 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774865.574772:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671330560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774865.574779:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1785774865.574820:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671330432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774865.575214:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671330560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785774866.213792:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774866.596682:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671330688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774866.596757:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774866.596915:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330688 00000100:00100000:2.0:1785774866.596923:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330688 00000100:00100000:2.0:1785774866.596979:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:2.0:1785774866.596989:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671330688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774866.597023:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774866.597073:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671330688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774866.597080:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:2.0:1785774866.597103:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774866.597111:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671330816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774866.597140:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774866.597230:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671330688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774866.599733:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330816 00000100:00100000:3.0:1785774866.599752:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330816 00000100:00100000:3.0:1785774866.599833:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1785774866.599845:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671330816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1785774866.599883:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774866.599968:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671330816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (2826us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774866.599976:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1785774866.600032:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671330816:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785774866.602967:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774867.108701:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671330944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774867.108773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774867.108851:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671330944 00000100:00100000:2.0:1785774867.108858:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671330944 00000100:00100000:2.0:1785774867.108911:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1785774867.108921:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671330944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774867.108944:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774867.108988:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671330944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774867.108995:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00080000:2.0:1785774867.109017:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774867.109055:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671330944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785774867.236844:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774868.260400:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774869.293258:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774869.669370:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774869.669395:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671331072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774869.669462:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774869.669541:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331072 00000100:00100000:2.0:1785774869.669549:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331072 00000100:00100000:2.0:1785774869.669600:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:2.0:1785774869.669609:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671331072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774869.669653:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:2.0:1785774869.669698:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671331072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774869.669704:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:2.0:1785774869.669748:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671331072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774869.676502:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671331328:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.676575:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774869.676622:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671331840:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.676645:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774869.676664:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671332352:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.676683:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774869.676704:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1785774869.676709:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671331456:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.676731:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774869.676748:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671331968:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.676770:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774869.676796:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671332480:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.676817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774869.676849:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331328 00000100:00100000:3.0:1785774869.676857:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331328 00000100:00100000:3.0:1785774869.676896:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331840 00000100:00100000:3.0:1785774869.676899:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331840 00000100:00100000:3.0:1785774869.676921:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332352 00000100:00100000:3.0:1785774869.676923:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332352 00000100:00100000:3.0:1785774869.676933:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331456 00000100:00100000:3.0:1785774869.676935:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331456 00000100:00100000:3.0:1785774869.676948:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1785774869.676955:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671331328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.676999:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671331328:12345-0@lo:400:kworker.0 Request processed in 44us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774869.677006:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1785774869.677023:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1785774869.677029:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671331840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677053:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671331840:12345-0@lo:400:kworker.0 Request processed in 25us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774869.677058:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1785774869.677068:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1785774869.677073:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671332352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677093:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671332352:12345-0@lo:400:kworker.0 Request processed in 20us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774869.677098:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1785774869.677106:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1785774869.677111:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671331456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677130:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671331456:12345-0@lo:400:kworker.0 Request processed in 20us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774869.677136:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1785774869.677153:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331968 00000100:00100000:3.0:1785774869.677156:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331968 00000100:00100000:3.0:1785774869.677205:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332480 00000100:00100000:3.0:1785774869.677208:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332480 00000100:00100000:3.0:1785774869.677224:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1785774869.677229:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671331968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677255:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671331968:12345-0@lo:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774869.677261:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1785774869.677270:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1785774869.677275:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671332480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677296:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671332480:12345-0@lo:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774869.677301:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00080000:3.0:1785774869.677313:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774869.677317:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785774869.677319:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774869.677353:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671331456:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677363:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671331968:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677371:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671332480:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677378:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671331328:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677389:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671331840:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.677397:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671332352:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.677928:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671331584:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.677968:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774869.677997:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671332096:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678015:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774869.678039:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671332608:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678058:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774869.678075:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1785774869.678081:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671331200:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678102:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774869.678122:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671331712:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678142:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774869.678155:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7734659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671332224:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678187:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774869.678214:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332096 00000100:00100000:0.0:1785774869.678219:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332096 00000100:00100000:0.0:1785774869.678251:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332608 00000100:00100000:0.0:1785774869.678254:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332608 00000100:00100000:0.0:1785774869.678272:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1785774869.678278:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671332096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678316:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671332096:12345-0@lo:400:kworker.0 Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774869.678322:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1785774869.678334:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1785774869.678339:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671332608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678362:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671332608:12345-0@lo:400:kworker.0 Request processed in 23us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774869.678368:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1785774869.678388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331200 00000100:00100000:0.0:1785774869.678391:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331200 00000100:00100000:0.0:1785774869.678415:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1785774869.678421:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671331200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678449:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671331200:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774869.678455:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1785774869.678489:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331712 00000100:00100000:0.0:1785774869.678492:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331712 00000100:00100000:0.0:1785774869.678513:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332224 00000100:00100000:0.0:1785774869.678515:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332224 00000100:00100000:0.0:1785774869.678540:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1785774869.678547:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671331712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678574:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671331712:12345-0@lo:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774869.678580:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1785774869.678590:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1785774869.678595:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678631:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671332224:12345-0@lo:400:kworker.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774869.678636:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00080000:0.0:1785774869.678654:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774869.678657:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774869.678659:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774869.678681:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671331200:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678693:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671331712:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678702:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671332224:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678710:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671332096:0@lo:400:kworker.0 00000100:00100000:0.0:1785774869.678717:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7734659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671332608:0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.679153:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671331584 00000100:00100000:3.0:1785774869.679231:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671331584 00000100:00100000:3.0:1785774869.679351:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1785774869.679360:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671331584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774869.679421:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671331584:12345-0@lo:400:kworker.0 Request processed in 63us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774869.679427:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:0.0:1785774869.679476:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671331584:0@lo:400:kworker.0 00000100:00100000:3.0:1785774870.149838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774870.149951:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648619776 00000100:00100000:0.0:1785774870.149961:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648619776 00000100:00100000:0.0:1785774870.150025:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 577 00000100:00100000:0.0:1785774870.150035:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648619776:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774870.150109:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648619776:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774870.150117:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 577 00000100:00100000:0.0:1785774870.151902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774870.151945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774870.152008:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648620288 00000100:00100000:3.0:1785774870.152015:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648620288 00000100:00100000:3.0:1785774870.152080:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 675 00000100:00100000:3.0:1785774870.152090:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648620288:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774870.152149:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648620288:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774870.152156:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 675 00000100:00100000:2.0:1785774870.152426:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648620032 00000100:00100000:2.0:1785774870.152431:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648620032 00000100:00100000:2.0:1785774870.152471:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1105 00000100:00100000:2.0:1785774870.152479:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648620032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774870.152515:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648620032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774870.152535:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1105 00000100:00080000:0.0:1785774870.152996:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785774870.153000:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774870.160948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774870.160993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774870.161057:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648620160 00000100:00100000:2.0:1785774870.161066:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648620160 00000100:00100000:2.0:1785774870.161140:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 676 00000100:00100000:2.0:1785774870.161150:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648620160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774870.161254:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648620160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774870.161262:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 676 00000100:00080000:1.0:1785774870.161366:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774870.161423:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648619904 00000100:00100000:3.0:1785774870.161428:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648619904 00000100:00100000:3.0:1785774870.161476:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1106 00000100:00100000:3.0:1785774870.161484:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648619904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774870.161517:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648619904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774870.161535:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1106 00000100:00080000:1.0:1785774870.161683:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1785774870.183691:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984131 is committed 00000001:00080000:3.0:1785774870.186305:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969951 is committed 00010000:00010000:2.0:1785774870.188329:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774870.188345:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774870.188353:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774870.188360:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774870.188365:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774870.188373:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774870.188696:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa58cf3a (ffff9b7707de8e00) 00010000:00010000:2.0:1785774870.188700:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774870.188706:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774870.188717:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a18cf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774870.308518:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774870.696788:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774870.696834:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671332736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774870.696943:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774870.697128:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332736 00000100:00100000:1.0:1785774870.697140:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332736 00000100:00100000:1.0:1785774870.697257:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1785774870.697269:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671332736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774870.697312:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774870.697369:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671332736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774870.697378:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1785774870.697541:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671332736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774870.699044:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671332864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774870.699100:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774870.699276:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332864 00000100:00100000:3.0:1785774870.699284:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332864 00000100:00100000:3.0:1785774870.699339:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1785774870.699349:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671332864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785774870.699369:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774870.699421:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671332864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774870.699429:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1785774870.699556:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671332864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785774871.334557:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774871.716404:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774871.716433:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671332992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774871.716530:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774871.716604:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671332992 00000100:00100000:2.0:1785774871.716611:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671332992 00000100:00100000:2.0:1785774871.716821:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:2.0:1785774871.716830:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671332992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774871.716873:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774871.716922:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671332992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774871.716928:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:2.0:1785774871.716974:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671332992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774871.718385:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774871.718401:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671333120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774871.718444:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774871.718522:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671333120 00000100:00100000:2.0:1785774871.718528:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671333120 00000100:00100000:2.0:1785774871.718576:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1785774871.718583:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671333120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774871.718608:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774871.718649:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671333120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774871.718660:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1785774871.718701:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671333120:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785774871.718796:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774872.228492:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774872.235338:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671333248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774872.235496:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774872.239426:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671333248 00000100:00100000:0.0:1785774872.239443:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671333248 00000100:00100000:0.0:1785774872.239593:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1785774872.239604:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671333248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774872.239637:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774872.239739:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671333248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (4241us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774872.239747:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1785774872.239880:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671333248:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1785774872.243993:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785774872.358300:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774873.380382:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774874.408054:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785774874.578685:0:22504:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61b: mmap() of unstriped file is successful ========================================================== 12:34:31 (1785774871) 00000100:00100000:3.0:1785774874.653463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774874.653550:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648620416 00000100:00100000:0.0:1785774874.653560:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648620416 00000100:00100000:0.0:1785774874.653634:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24101 00000100:00100000:0.0:1785774874.653644:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:20314:x1872519648620416:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 00010000:00010000:0.0:1785774874.653666:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774874.653686:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a191c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c527 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.653742:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.653756:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.653767:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774874.653807:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:0.0:1785774874.653811:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774874.653844:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.653867:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a191c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c527 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.653882:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c527 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.653891:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774874.653894:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774874.653898:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ca00, rc 0) 00000100:00100000:0.0:1785774874.653950:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:20314:x1872519648620416:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 Request processed in 307us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774874.653957:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24101 00000100:00080000:1.0:1785774874.654194:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774874.664284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774874.665312:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648620672 00000100:00100000:0.0:1785774874.665324:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648620672 00000100:00100000:0.0:1785774874.665399:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24102 00000100:00100000:0.0:1785774874.665410:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:20314:x1872519648620672:12345-192.168.202.31@tcp:36:mmap_mknod_test.0 00010000:00010000:0.0:1785774874.665466:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774874.665509:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c527 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.665526:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774874.665531:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774874.665602:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.665617:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.665626:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.665677:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.665684:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.665691:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666547:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666563:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666570:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666577:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774874.666581:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666588:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666598:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774874.666601:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774874.666605:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666611:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a192a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774874.666621:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f03200e2 reply state 00000000f329fac4 transno 4294984132 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666631:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.666636:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9b77131b5a00) 00010000:00010000:0.0:1785774874.666639:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774874.666641:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774874.666766:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:20314:x1872519648620672:12345-192.168.202.31@tcp:36:mmap_mknod_test.0 Request processed in 1356us (2489us total) trans 4294984132 rc 0/0 00000100:00100000:0.0:1785774874.666775:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24102 00000100:00100000:0.0:1785774874.671790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774874.671979:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648620800 00000100:00100000:3.0:1785774874.671989:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648620800 00000100:00100000:3.0:1785774874.672042:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24103 00000100:00100000:3.0:1785774874.672053:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:20314:x1872519648620800:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1785774874.672077:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774874.672096:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c52e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.672196:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a193f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.672212:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a193f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.672224:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a193f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774874.672269:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:3.0:1785774874.672274:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785774874.672298:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a193f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.672324:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c52e expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.672339:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a193f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c52e expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.672347:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774874.672350:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774874.672353:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:3.0:1785774874.672421:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:20314:x1872519648620800:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 Request processed in 368us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774874.672428:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24103 00000100:00100000:3.0:1785774874.677870:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774874.677937:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648620928 00000100:00100000:0.0:1785774874.677944:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648620928 00000100:00100000:0.0:1785774874.677989:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24104 00000100:00100000:0.0:1785774874.677997:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:20314:x1872519648620928:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 00010000:00010000:0.0:1785774874.678016:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774874.678036:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c535 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678100:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678113:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678125:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678214:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678224:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678230:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678296:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a195b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678305:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a195b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678312:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a195b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774874.678347:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a7:0x0]: returning size 0 00000004:00200000:0.0:1785774874.678351:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774874.678369:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a195b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678380:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a195b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678437:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678445:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678451:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678458:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678465:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774874.678470:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678486:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678505:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774874.678508:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774874.678513:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678520:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a194d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678530:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678536:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678541:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678546:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774874.678548:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678554:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678560:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9b77131b5a00) 00010000:00010000:0.0:1785774874.678562:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774874.678565:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678570:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1954 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678596:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c535 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678608:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a195b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c535 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.678616:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9b77131b5b00) 00010000:00010000:0.0:1785774874.678618:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774874.678621:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ce00, rc 0) 00000100:00100000:0.0:1785774874.680543:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20314:x1872519648620928:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 Request processed in 678us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774874.680558:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24104 00000100:00100000:1.0:1785774874.681452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774874.683238:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648621056 00000100:00100000:0.0:1785774874.683249:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648621056 00000100:00100000:0.0:1785774874.683310:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24105 00000100:00100000:0.0:1785774874.683322:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20314:x1872519648621056:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 00010000:00010000:0.0:1785774874.683342:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774874.683363:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1962 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c53c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.683397:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1969 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.683411:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.683424:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.683540:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1962 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c53c expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.683556:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c200/0x7b7109e1d0a1969 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c53c expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.683565:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9b77131b5b00) 00010000:00010000:0.0:1785774874.683568:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774874.683571:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c200, rc 0) 00000100:00100000:0.0:1785774874.683632:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20314:x1872519648621056:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 Request processed in 314us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774874.683639:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24105 00000100:00100000:1.0:1785774874.691714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774874.692041:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648621312 00000100:00100000:0.0:1785774874.692051:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648621312 00000100:00100000:0.0:1785774874.692140:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24106 00000100:00100000:0.0:1785774874.692151:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20314:x1872519648621312:12345-192.168.202.31@tcp:36:mmap_mknod_test.0 00010000:00010000:0.0:1785774874.692223:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774874.692248:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a195b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c535 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.692264:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9b77131b5b00) 00010000:00010000:0.0:1785774874.692269:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774874.692334:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.692348:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.692358:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774874.692462:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000680614d3 reply state 000000000fd365d2 transno 4294984133 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.692475:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774874.692494:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9b77131b5b00) 00010000:00010000:0.0:1785774874.692498:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774874.692501:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774874.692601:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20314:x1872519648621312:12345-192.168.202.31@tcp:36:mmap_mknod_test.0 Request processed in 452us (894us total) trans 4294984133 rc 0/0 00000100:00100000:0.0:1785774874.692610:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24106 00000100:00100000:0.0:1785774874.702099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774874.703239:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648621440 00000100:00100000:3.0:1785774874.703251:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648621440 00000100:00100000:3.0:1785774874.703307:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24107 00000100:00100000:3.0:1785774874.703319:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20314:x1872519648621440:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1785774874.703354:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774874.703376:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1977 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c543 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.703572:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1977 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c543 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.703589:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cec00/0x7b7109e1d0a1977 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c543 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.703601:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9b77131b5b00) 00010000:00010000:3.0:1785774874.703604:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785774874.703608:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cec00, rc 0) 00000100:00100000:3.0:1785774874.703666:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20314:x1872519648621440:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 Request processed in 350us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774874.703674:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24107 00000100:00100000:0.0:1785774874.713391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774874.713459:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648621568 00000100:00100000:2.0:1785774874.713469:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648621568 00000100:00100000:2.0:1785774874.713542:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5224 00000100:00100000:2.0:1785774874.713552:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770edef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20314:x1872519648621568:12345-192.168.202.31@tcp:49:mmap_mknod_test.0 00000100:00100000:2.0:1785774874.713683:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770edef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20314:x1872519648621568:12345-192.168.202.31@tcp:49:mmap_mknod_test.0 Request processed in 132us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.713691:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5224 00000100:00100000:1.0:1785774874.723088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774874.723230:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648621824 00000100:00100000:3.0:1785774874.723241:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648621824 00000100:00100000:3.0:1785774874.723298:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24108 00000100:00100000:3.0:1785774874.723308:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20314:x1872519648621824:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1785774874.723329:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774874.723350:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a197e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c54a expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723428:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723443:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723456:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723469:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723488:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723496:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723596:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a1993 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723607:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a1993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723615:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a1993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774874.723625:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a7:0x0]: returning size 4096 00010000:00010000:3.0:1785774874.723698:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723709:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723716:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723721:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774874.723725:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723733:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723746:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774874.723749:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774874.723754:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723760:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a1985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723770:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723776:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723782:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723787:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774874.723790:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723796:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723803:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9b77131b5a00) 00010000:00010000:3.0:1785774874.723805:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774874.723809:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723815:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a198c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723849:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a197e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c54a expref: 21 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723862:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce600/0x7b7109e1d0a1993 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c54a expref: 20 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774874.723870:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9b77131b5b00) 00010000:00010000:3.0:1785774874.723873:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774874.723875:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce600, rc 0) 00000100:00100000:3.0:1785774874.723933:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20314:x1872519648621824:12345-192.168.202.31@tcp:101:mmap_mknod_test.0 Request processed in 627us (854us total) trans 4294984134 rc 0/0 00000100:00100000:3.0:1785774874.723940:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24108 00000100:00100000:0.0:1785774874.749897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774874.750373:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622080 00000100:00100000:1.0:1785774874.750383:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622080 00000100:00100000:1.0:1785774874.750438:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5225 00000100:00100000:1.0:1785774874.750448:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20314:x1872519648622080:12345-192.168.202.31@tcp:35:mmap_mknod_test.0 00000100:00100000:1.0:1785774874.750695:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:20314:x1872519648622080:12345-192.168.202.31@tcp:35:mmap_mknod_test.0 Request processed in 248us (808us total) trans 4294984135 rc 0/0 00000100:00100000:1.0:1785774874.750704:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5225 00000100:00100000:0.0:1785774874.789343:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774874.789365:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671333376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774874.789435:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774874.789543:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671333376 00000100:00100000:2.0:1785774874.789551:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671333376 00000100:00100000:2.0:1785774874.789610:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:2.0:1785774874.789618:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671333376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774874.789650:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:2.0:1785774874.789696:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671333376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.789703:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:2.0:1785774874.789744:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671333376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774874.790041:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671333632:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790073:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774874.790093:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671334144:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790117:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774874.790152:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671334656:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790194:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774874.790213:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1785774874.790218:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671333760:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774874.790259:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671334272:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790282:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774874.790299:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671334784:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790319:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774874.790347:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671333632 00000100:00100000:2.0:1785774874.790352:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671333632 00000100:00100000:2.0:1785774874.790378:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334144 00000100:00100000:2.0:1785774874.790381:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334144 00000100:00100000:2.0:1785774874.790407:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334656 00000100:00100000:2.0:1785774874.790410:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334656 00000100:00100000:2.0:1785774874.790423:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671333760 00000100:00100000:2.0:1785774874.790425:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671333760 00000100:00100000:2.0:1785774874.790437:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1785774874.790442:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671333632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790490:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671333632:12345-0@lo:400:kworker.0 Request processed in 47us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.790497:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1785774874.790510:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1785774874.790516:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671334144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790544:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671334144:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.790553:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1785774874.790563:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1785774874.790569:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790594:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671334656:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.790600:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1785774874.790609:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1785774874.790615:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671333760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790640:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671333760:12345-0@lo:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.790647:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1785774874.790674:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334272 00000100:00100000:2.0:1785774874.790678:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334272 00000100:00100000:2.0:1785774874.790705:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334784 00000100:00100000:2.0:1785774874.790708:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334784 00000100:00100000:2.0:1785774874.790726:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1785774874.790732:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671334272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790763:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671334272:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.790769:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1785774874.790780:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1785774874.790785:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671334784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790811:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671334784:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.790816:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00080000:2.0:1785774874.790838:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774874.790842:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785774874.790844:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774874.790868:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671333760:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790878:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671334272:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790886:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671334784:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790895:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671333632:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790902:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671334144:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.790910:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671334656:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791048:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671333504:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791083:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774874.791115:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671334016:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791150:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774874.791185:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671334528:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774874.791225:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1785774874.791230:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671333888:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774874.791267:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671334400:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791286:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774874.791302:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671334912:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791320:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774874.791346:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334400 00000100:00100000:0.0:1785774874.791350:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334400 00000100:00100000:0.0:1785774874.791378:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334912 00000100:00100000:0.0:1785774874.791381:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334912 00000100:00100000:0.0:1785774874.791400:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1785774874.791406:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671334400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791440:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671334400:12345-0@lo:400:kworker.0 Request processed in 35us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774874.791445:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1785774874.791457:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1785774874.791462:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671334912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791500:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671334912:12345-0@lo:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774874.791506:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1785774874.791536:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671334400:0@lo:400:kworker.0 00000100:00100000:0.0:1785774874.791545:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671334912:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.791704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671333504 00000100:00100000:2.0:1785774874.791709:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671333504 00000100:00100000:2.0:1785774874.791744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1785774874.791751:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671333504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.793547:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671333504:12345-0@lo:400:kworker.0 Request processed in 1791us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.793558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1785774874.793601:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671333888 00000100:00100000:2.0:1785774874.793607:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671333888 00000100:00100000:2.0:1785774874.793641:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:2.0:1785774874.793647:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671333888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.793689:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671333888:12345-0@lo:400:kworker.0 Request processed in 42us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.793696:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:2.0:1785774874.793725:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334016 00000100:00100000:2.0:1785774874.793729:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334016 00000100:00100000:2.0:1785774874.793756:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671334528 00000100:00100000:2.0:1785774874.793759:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671334528 00000100:00100000:2.0:1785774874.793778:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1785774874.793784:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671334016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.793814:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671334016:12345-0@lo:400:kworker.0 Request processed in 30us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.793820:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1785774874.793832:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1785774874.793837:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671334528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.793863:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671334528:12345-0@lo:400:kworker.0 Request processed in 26us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774874.793869:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00080000:2.0:1785774874.793890:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785774874.793894:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774874.793896:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774874.795381:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671333504:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.795495:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671334016:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.795509:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671334528:0@lo:400:kworker.0 00000100:00100000:2.0:1785774874.795533:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671333888:0@lo:400:kworker.0 00000100:00100000:1.0:1785774875.275060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774875.279134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622208 00000100:00100000:2.0:1785774875.279151:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622208 00000100:00100000:2.0:1785774875.279302:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 579 00000100:00100000:2.0:1785774875.279313:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648622208:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774875.279563:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648622208:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 250us (4512us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774875.279571:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 579 00000100:00100000:1.0:1785774875.284267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774875.284374:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622336 00000100:00100000:3.0:1785774875.284382:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622336 00000100:00100000:3.0:1785774875.284439:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1113 00000100:00100000:3.0:1785774875.284450:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:2417:x1872519648622336:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774875.284554:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:2417:x1872519648622336:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774875.284562:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1113 00000100:00100000:1.0:1785774875.285624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774875.285662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774875.285691:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622464 00000100:00100000:1.0:1785774875.285696:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622464 00000100:00100000:1.0:1785774875.285743:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1114 00000100:00100000:1.0:1785774875.285750:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648622464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774875.285793:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648622464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774875.285799:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1114 00000100:00080000:1.0:1785774875.285818:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774875.286154:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622592 00000100:00100000:3.0:1785774875.286195:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622592 00000100:00100000:3.0:1785774875.286237:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 681 00000100:00100000:3.0:1785774875.286245:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648622592:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774875.286281:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648622592:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774875.286287:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 681 00000100:00080000:1.0:1785774875.286487:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774875.293857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774875.294135:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622720 00000100:00100000:3.0:1785774875.294145:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622720 00000100:00100000:3.0:1785774875.294276:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 682 00000100:00100000:3.0:1785774875.294286:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648622720:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774875.294389:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648622720:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 104us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774875.294398:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 682 00000100:00080000:1.0:1785774875.302360:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785774875.428540:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774875.814284:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774875.814308:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671335040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774875.814376:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774875.814448:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335040 00000100:00100000:2.0:1785774875.814455:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335040 00000100:00100000:2.0:1785774875.814515:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1785774875.814525:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671335040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774875.814557:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774875.814610:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671335040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774875.814617:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1785774875.814665:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671335040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774875.816655:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671335168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774875.816699:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774875.816739:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335168 00000100:00100000:2.0:1785774875.816744:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335168 00000100:00100000:2.0:1785774875.816772:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1785774875.816778:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671335168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785774875.816793:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774875.816828:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671335168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774875.816835:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1785774875.816868:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671335168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1785774876.452402:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774876.836453:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774876.836490:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671335296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774876.836568:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774876.837100:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774876.837110:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671335424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774876.837153:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774876.837319:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335424 00000100:00100000:1.0:1785774876.837328:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335424 00000100:00100000:1.0:1785774876.837378:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1785774876.837386:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671335424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774876.837422:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774876.837477:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671335424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774876.837485:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1785774876.837533:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671335424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774876.837643:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335296 00000100:00100000:2.0:1785774876.837647:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335296 00000100:00100000:2.0:1785774876.837725:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1785774876.837734:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671335296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774876.837754:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774876.837796:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671335296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774876.837802:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1785774876.837834:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671335296:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785774876.838342:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774877.348442:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774877.348491:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671335552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774877.348568:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774877.350548:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335552 00000100:00100000:2.0:1785774877.350559:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335552 00000100:00100000:2.0:1785774877.350639:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1785774877.350649:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671335552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774877.350677:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774877.350754:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671335552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774877.350761:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:1.0:1785774877.350924:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774877.351964:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671335552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774877.476344:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774878.505184:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774879.524889:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774879.908500:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774879.908522:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671335680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774879.908597:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774879.908681:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335680 00000100:00100000:0.0:1785774879.908689:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335680 00000100:00100000:0.0:1785774879.908739:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1785774879.908748:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671335680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785774879.908781:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:0.0:1785774879.908881:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671335680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774879.908888:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:2.0:1785774879.909043:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671335680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774879.909328:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774879.909337:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671335936:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909368:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774879.909406:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671336064:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774879.909483:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774879.909489:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671336448:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909509:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774879.909544:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671336576:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909571:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774879.909616:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774879.909622:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671336960:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909643:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774879.909667:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335936 00000100:00100000:1.0:1785774879.909671:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335936 00000100:00100000:1.0:1785774879.909703:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336064 00000100:00100000:1.0:1785774879.909706:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336064 00000100:00100000:1.0:1785774879.909722:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336448 00000100:00100000:1.0:1785774879.909725:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336448 00000100:00100000:1.0:1785774879.909743:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336960 00000100:00100000:1.0:1785774879.909746:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336960 00000100:00100000:1.0:1785774879.909762:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1785774879.909767:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671335936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909808:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671335936:12345-0@lo:400:kworker.0 Request processed in 40us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774879.909814:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1785774879.909828:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1785774879.909834:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671336064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909863:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671336064:12345-0@lo:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774879.909869:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1785774879.909881:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1785774879.909886:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671336448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909909:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671336448:12345-0@lo:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774879.909922:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1785774879.909933:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1785774879.909938:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671336960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.909960:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671336960:12345-0@lo:400:kworker.0 Request processed in 22us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774879.909966:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00080000:1.0:1785774879.909989:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774879.910009:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671336960:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.910019:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671336448:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.910026:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671336064:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.910035:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671335936:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.910078:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671337088:0@lo:400:kworker.0 00000100:00100000:1.0:1785774879.910099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774879.910245:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671336192:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910277:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774879.910298:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671336704:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910318:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774879.910338:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671337216:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910357:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774879.910373:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1785774879.910379:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671335808:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910402:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774879.910418:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671336320:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774879.910464:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671336832:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910483:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774879.910504:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336192 00000100:00100000:3.0:1785774879.910507:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336192 00000100:00100000:3.0:1785774879.910532:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1785774879.910538:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671336192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910568:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671336192:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774879.910574:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1785774879.910590:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336576 00000100:00100000:3.0:1785774879.910594:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336576 00000100:00100000:3.0:1785774879.910619:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337088 00000100:00100000:3.0:1785774879.910623:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337088 00000100:00100000:3.0:1785774879.910639:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336704 00000100:00100000:3.0:1785774879.910642:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336704 00000100:00100000:3.0:1785774879.910659:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337216 00000100:00100000:3.0:1785774879.910662:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337216 00000100:00100000:3.0:1785774879.910679:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1785774879.910685:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671336576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910717:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671336576:12345-0@lo:400:kworker.0 Request processed in 33us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774879.910723:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1785774879.910734:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1785774879.910739:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671337088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910766:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671337088:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774879.910771:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1785774879.910780:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1785774879.910785:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671336704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910807:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671336704:12345-0@lo:400:kworker.0 Request processed in 23us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774879.910812:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1785774879.910822:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1785774879.910828:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671337216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910848:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671337216:12345-0@lo:400:kworker.0 Request processed in 21us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774879.910853:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1785774879.910876:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336320 00000100:00100000:3.0:1785774879.910879:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336320 00000100:00100000:3.0:1785774879.910898:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671336832 00000100:00100000:3.0:1785774879.910901:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671336832 00000100:00100000:3.0:1785774879.910913:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1785774879.910918:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671336320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910947:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671336320:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774879.910952:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1785774879.910963:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1785774879.910969:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671336832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.910992:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671336832:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774879.910997:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00080000:3.0:1785774879.911013:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774879.911016:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774879.911018:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774879.911035:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671336320:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.911043:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671336832:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.911051:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671336192:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.911058:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671336704:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.911065:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671337216:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.911098:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671337088:0@lo:400:kworker.0 00000100:00100000:3.0:1785774879.911106:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671336576:0@lo:400:kworker.0 00000100:00100000:2.0:1785774879.911378:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671335808 00000100:00100000:2.0:1785774879.911382:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671335808 00000100:00100000:2.0:1785774879.911421:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1785774879.911457:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671335808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774879.911500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671335808:12345-0@lo:400:kworker.0 Request processed in 72us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774879.911506:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1785774879.911544:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671335808:0@lo:400:kworker.0 00000001:00080000:0.0:1785774879.912589:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984135 is committed 00010000:00010000:3.0:1785774879.912653:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912665:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912679:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912686:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774879.912690:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912697:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912713:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9b77131b5a00) 00010000:00010000:3.0:1785774879.912716:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774879.912720:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912726:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1931 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912748:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912754:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912760:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912765:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774879.912768:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912777:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912783:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9b77131b5b00) 00010000:00010000:3.0:1785774879.912785:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774879.912788:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774879.912793:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1970 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774880.390782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774880.390823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774880.390899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774880.390925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774880.390974:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648623360 00000100:00100000:0.0:1785774880.390984:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648623360 00000100:00100000:0.0:1785774880.391049:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 687 00000100:00100000:0.0:1785774880.391059:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648623360:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774880.391145:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648623360:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774880.391152:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 687 00000100:00080000:0.0:1785774880.391210:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774880.391279:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622848 00000100:00100000:2.0:1785774880.391284:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622848 00000100:00100000:2.0:1785774880.391332:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 581 00000100:00100000:2.0:1785774880.391339:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648622848:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774880.391368:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648622848:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774880.391375:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 581 00000100:00100000:1.0:1785774880.401668:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648623104 00000100:00100000:1.0:1785774880.401683:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648623104 00000100:00100000:1.0:1785774880.401746:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648622976 00000100:00100000:1.0:1785774880.401749:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648622976 00000100:00100000:1.0:1785774880.401785:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1121 00000100:00100000:1.0:1785774880.401795:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648623104:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774880.401866:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648623104:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (11042us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774880.401874:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1121 00000100:00100000:1.0:1785774880.401888:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1122 00000100:00100000:1.0:1785774880.401893:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648622976:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774880.401913:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648622976:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (10989us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774880.401919:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1122 00000100:00080000:0.0:1785774880.402247:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774880.402251:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774880.402598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774880.402877:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648623232 00000100:00100000:0.0:1785774880.402883:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648623232 00000100:00100000:0.0:1785774880.402927:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 688 00000100:00100000:0.0:1785774880.402934:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648623232:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774880.402982:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648623232:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 49us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774880.402989:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 688 00000100:00080000:0.0:1785774880.403008:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785774880.548515:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774880.943568:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671337344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774880.943650:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774880.943741:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337344 00000100:00100000:0.0:1785774880.943751:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337344 00000100:00100000:3.0:1785774880.943787:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774880.943806:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1785774880.943818:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671337344:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774880.943826:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1785774880.943855:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774880.948367:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337472 00000100:00100000:1.0:1785774880.948381:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337472 00000100:00100000:1.0:1785774880.948435:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1785774880.948445:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671337472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774880.948470:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774880.948548:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671337472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (4725us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774880.948555:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1785774880.948610:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774880.957234:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671337344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13410us (13576us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774880.957249:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1785774880.976976:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671337344:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1785774881.572492:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774881.958052:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671337600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774881.958130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774881.958284:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774881.958304:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671337728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774881.958347:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774881.958380:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337728 00000100:00100000:1.0:1785774881.958388:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337728 00000100:00100000:1.0:1785774881.958450:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1785774881.958458:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671337728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774881.958497:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774881.958543:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671337728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774881.958550:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1785774881.958591:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671337728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774881.959061:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337600 00000100:00100000:0.0:1785774881.959066:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337600 00000100:00100000:0.0:1785774881.959101:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:0.0:1785774881.959107:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a991850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671337600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774881.959128:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774881.959202:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a991850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671337600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774881.959207:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00080000:0.0:1785774881.959453:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774881.959679:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671337600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774882.471322:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671337856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774882.471396:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774882.471481:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337856 00000100:00100000:0.0:1785774882.471488:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337856 00000100:00100000:0.0:1785774882.471545:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1785774882.471555:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671337856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774882.471575:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774882.471617:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671337856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774882.471625:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00080000:0.0:1785774882.471648:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774882.471679:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671337856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785774882.599011:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774883.620889:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785774884.292144:0:22700:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 12:34:41 (1785774881) 00000100:00100000:3.0:1785774884.530297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774884.530347:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648623616 00000100:00100000:3.0:1785774884.530358:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648623616 00000100:00100000:3.0:1785774884.530443:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24109 00000100:00100000:3.0:1785774884.530453:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20906:x1872519648623616:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774884.530481:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774884.530485:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785774884.530521:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a193f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c52e expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.530542:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774884.530548:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774884.530562:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a19a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c551 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.530704:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.530720:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.530732:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1785774884.530996:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785774884.531934:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.531957:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.531969:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774884.532329:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa00:0x0], index 1: 0 00010000:00010000:3.0:1785774884.533236:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a19b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533247:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a19b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533260:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a19b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533297:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533304:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533310:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533316:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533322:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774884.533325:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533332:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533343:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774884.533346:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774884.533349:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533356:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a19a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774884.533367:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008a529508 reply state 0000000031673ee6 transno 4294984136 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533377:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533394:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7711ae8400) 00010000:00010000:3.0:1785774884.533397:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774884.533400:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774884.533448:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a19a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c551 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533463:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a19b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c551 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774884.533471:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774884.533473:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774884.533475:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce800, rc 0) 00000100:00100000:3.0:1785774884.533705:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20906:x1872519648623616:12345-192.168.202.31@tcp:101:dd.0 Request processed in 3251us (3421us total) trans 4294984136 rc 0/0 00000100:00100000:3.0:1785774884.533715:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24109 00000100:00100000:1.0:1785774884.560832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774884.560966:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648623744 00000100:00100000:2.0:1785774884.560979:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648623744 00000100:00100000:2.0:1785774884.561072:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5344 00000100:00100000:2.0:1785774884.561085:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:20906:x1872519648623744:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774884.561109:0:14729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774884.561135:0:14729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c558 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774884.561189:0:14729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774884.561218:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=1126s v=(0 0) 00010000:00010000:2.0:1785774884.561223:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774884.561233:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 6 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774884.561254:0:14729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 6 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774884.561267:0:14729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744a00, rc 0) 00000100:00100000:2.0:1785774884.561333:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:20906:x1872519648623744:12345-192.168.202.31@tcp:101:dd.0 Request processed in 252us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774884.561340:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5344 00000100:00080000:1.0:1785774884.561532:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785774884.649443:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774885.029251:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671338368:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.029351:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774885.029435:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671338880:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.029468:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774885.029488:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671339392:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.029510:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774885.029535:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1785774885.029543:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671338240:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.029570:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774885.029593:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671338752:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.029616:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774885.029637:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671339264:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.029659:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774885.029702:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671338240 00000100:00100000:0.0:1785774885.029713:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671338240 00000100:00100000:0.0:1785774885.029785:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1785774885.029797:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.029871:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671338240:12345-0@lo:400:kworker.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.029879:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1785774885.029909:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671338368 00000100:00100000:0.0:1785774885.029913:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671338368 00000100:00100000:0.0:1785774885.029941:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671338752 00000100:00100000:0.0:1785774885.029943:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671338752 00000100:00100000:0.0:1785774885.029973:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339264 00000100:00100000:0.0:1785774885.029976:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339264 00000100:00100000:0.0:1785774885.029996:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1785774885.030001:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.030032:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671338368:12345-0@lo:400:kworker.0 Request processed in 31us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.030038:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1785774885.030049:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1785774885.030055:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671338752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.030082:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671338752:12345-0@lo:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.030088:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1785774885.030098:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1785774885.030103:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671339264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.030129:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671339264:12345-0@lo:400:kworker.0 Request processed in 25us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.030134:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:0.0:1785774885.030180:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774885.030233:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671338240:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.030246:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671338752:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.030254:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671339264:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.030262:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671338368:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.030670:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671338112:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.030709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774885.030736:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671338624:0@lo:400:kworker.0 00000100:00100000:2.0:1785774885.030842:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671337984:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.031112:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671338112 00000100:00100000:0.0:1785774885.031117:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671338112 00000100:00100000:0.0:1785774885.031146:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1785774885.031152:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671338112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.033905:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774885.033972:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671339136:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.034012:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774885.034376:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671338624 00000100:00100000:3.0:1785774885.034395:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671338624 00000100:00100000:3.0:1785774885.034448:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339136 00000100:00100000:3.0:1785774885.034450:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339136 00000100:00100000:3.0:1785774885.034474:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1785774885.034481:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671338624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.034545:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671338624:12345-0@lo:400:kworker.0 Request processed in 64us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.034553:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1785774885.034570:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1785774885.034577:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671339136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.034606:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671339136:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.034612:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:3.0:1785774885.034639:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774885.034681:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671338624:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.034694:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671339136:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.034771:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671339648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774885.034800:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774885.034835:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339648 00000100:00100000:3.0:1785774885.034838:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339648 00000100:00100000:3.0:1785774885.034867:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1785774885.034872:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671339648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774885.034907:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:3.0:1785774885.034947:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671339648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.034954:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1785774885.034986:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671339648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774885.036138:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671338880 00000100:00100000:3.0:1785774885.036146:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671338880 00000100:00100000:3.0:1785774885.036211:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339392 00000100:00100000:3.0:1785774885.036215:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339392 00000100:00100000:3.0:1785774885.036241:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1785774885.036248:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671338880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.036309:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671338880:12345-0@lo:400:kworker.0 Request processed in 61us (6841us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.036316:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1785774885.036328:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1785774885.036334:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671339392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.036363:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671339392:12345-0@lo:400:kworker.0 Request processed in 30us (6853us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.036369:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00080000:3.0:1785774885.036422:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774885.036426:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774885.036454:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671338880:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.036465:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671339392:0@lo:400:kworker.0 00000100:00100000:2.0:1785774885.050498:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774885.050514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774885.050587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671337984 00000100:00100000:3.0:1785774885.050598:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671337984 00000100:00100000:2.0:1785774885.050602:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671338496:0@lo:400:kworker.0 00000100:00100000:2.0:1785774885.050654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774885.050693:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671339008:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.050720:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1785774885.050735:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671337984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.050808:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671337984:12345-0@lo:400:kworker.0 Request processed in 79us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.050814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1785774885.050881:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648623872 00000100:00100000:1.0:1785774885.050886:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648623872 00002000:00100000:1.0:1785774885.050918:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->802815) req@ffff9b7603080e00 x1872519648623872/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:576/0 lens 488/0 e 0 to 0 dl 1785774896 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774885.050928:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603080e00 with x1872519648623872 ext(0->802815) 00002000:00010000:1.0:1785774885.050933:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7603080e00 00000100:00100000:1.0:1785774885.050963:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 17 00000100:00100000:1.0:1785774885.050972:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648623872:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774885.050996:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671338112:12345-0@lo:400:kworker.0 Request processed in 19839us (20281us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.051010:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1785774885.051342:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671338496 00000100:00100000:3.0:1785774885.051349:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671338496 00000100:00100000:3.0:1785774885.051483:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:3.0:1785774885.051490:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671338496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.051535:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671338496:12345-0@lo:400:kworker.0 Request processed in 43us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.051543:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:0.0:1785774885.051570:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671338112:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.051584:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774885.051622:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671339520:0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.051622:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339008 00000100:00100000:0.0:1785774885.051631:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339008 00000100:00100000:0.0:1785774885.051691:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1785774885.051699:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671339008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.051753:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671339008:12345-0@lo:400:kworker.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.051759:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00080000:0.0:1785774885.051787:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774885.051817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774885.051859:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339520 00000100:00100000:3.0:1785774885.051865:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339520 00000100:00100000:0.0:1785774885.051876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774885.052215:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648624000 00000100:00100000:0.0:1785774885.052221:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648624000 00000100:00100000:0.0:1785774885.052255:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1785774885.052261:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671339520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774885.052300:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671339520:12345-0@lo:400:kworker.0 Request processed in 38us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.052306:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1785774885.052318:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5345 00000100:00100000:0.0:1785774885.052324:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648624000:12345-192.168.202.31@tcp:16:kworker.0 00000100:00100000:0.0:1785774885.052416:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648624000:12345-192.168.202.31@tcp:16:kworker.0 Request processed in 91us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.052423:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5345 00000100:00080000:3.0:1785774885.052539:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774885.052572:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671339520:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.052599:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671337984:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.052610:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671338496:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.052621:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671339008:0@lo:400:kworker.0 00000100:00100000:3.0:1785774885.069545:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774885.069755:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648624128 00000100:00100000:2.0:1785774885.069779:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648624128 00000100:00100000:2.0:1785774885.070359:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5346 00000100:00100000:2.0:1785774885.070370:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648624128:12345-192.168.202.31@tcp:16:kworker.0 00000100:00100000:2.0:1785774885.070488:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648624128:12345-192.168.202.31@tcp:16:kworker.0 Request processed in 120us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774885.070496:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5346 00000100:00100000:3.0:1785774885.080456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774885.082097:0:8451:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1785774885.082123:0:8451:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1785774885.082716:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648624256 00000100:00100000:0.0:1785774885.082726:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648624256 00002000:00100000:0.0:1785774885.082773:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (802816->909311) req@ffff9b7605c99c00 x1872519648624256/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:576/0 lens 488/0 e 0 to 0 dl 1785774896 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774885.082785:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c99c00 with x1872519648624256 ext(802816->909311) 00002000:00010000:0.0:1785774885.082791:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c99c00 00000100:00100000:3.0:1785774885.083326:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 18 00000100:00100000:3.0:1785774885.083339:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2418:x1872519648624256:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774885.088130:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648623872:12345-192.168.202.31@tcp:4:dd.0 Request processed in 37148us (37618us total) trans 4294969951 rc 0/0 00000100:00100000:3.0:1785774885.088145:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 17 00002000:00100000:3.0:1785774885.088180:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->802815) req@ffff9b7603080e00 x1872519648623872/t4294969951(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:576/0 lens 488/448 e 0 to 0 dl 1785774896 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774885.088198:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603080e00 with x1872519648623872 ext(0->802815) 00002000:00010000:3.0:1785774885.088205:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7603080e00 00000100:00100000:3.0:1785774885.104788:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2418:x1872519648624256:12345-192.168.202.31@tcp:4:dd.0 Request processed in 21441us (24330us total) trans 4294969952 rc 0/0 00000100:00100000:3.0:1785774885.105584:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 18 00002000:00100000:3.0:1785774885.105598:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (802816->909311) req@ffff9b7605c99c00 x1872519648624256/t4294969952(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:576/0 lens 488/448 e 0 to 0 dl 1785774896 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774885.105610:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c99c00 with x1872519648624256 ext(802816->909311) 00002000:00010000:3.0:1785774885.105628:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c99c00 00000100:00100000:1.0:1785774885.506881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774885.506922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774885.506947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774885.506983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774885.507042:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648624384 00000100:00100000:0.0:1785774885.507052:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648624384 00000100:00100000:0.0:1785774885.507110:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 583 00000100:00100000:0.0:1785774885.507121:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648624384:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774885.507138:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648624640 00000100:00100000:2.0:1785774885.507144:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648624640 00000100:00100000:2.0:1785774885.507233:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648624512 00000100:00100000:2.0:1785774885.507237:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648624512 00000100:00100000:0.0:1785774885.507244:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648624384:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774885.507253:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 583 00000100:00100000:2.0:1785774885.507261:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1129 00000100:00100000:2.0:1785774885.507272:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648624640:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774885.507311:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648624640:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774885.507319:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1129 00000100:00100000:2.0:1785774885.507336:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1130 00000100:00100000:2.0:1785774885.507342:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648624512:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774885.507373:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648624512:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774885.507407:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1130 00000100:00100000:3.0:1785774885.507717:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648624768 00000100:00100000:3.0:1785774885.507722:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648624768 00000100:00080000:1.0:1785774885.507777:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774885.507782:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774885.507813:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 693 00000100:00100000:3.0:1785774885.507822:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648624768:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774885.507867:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648624768:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 47us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774885.507874:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 693 00010000:00010000:0.0:1785774885.668413:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774886.052485:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774886.052509:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671339776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774886.052588:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774886.052769:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339776 00000100:00100000:1.0:1785774886.052777:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339776 00000100:00100000:1.0:1785774886.052841:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1785774886.052850:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671339776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774886.052879:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774886.052937:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671339776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774886.052944:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1785774886.053080:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671339776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774886.053248:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774886.053261:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671339904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774886.053292:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774886.053397:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671339904 00000100:00100000:1.0:1785774886.053401:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671339904 00000100:00100000:1.0:1785774886.053444:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1785774886.053451:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671339904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774886.053463:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774886.053501:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671339904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774886.053508:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1785774886.053724:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671339904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785774886.692418:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774887.076356:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774887.076775:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671340032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774887.076841:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774887.078986:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340032 00000100:00100000:2.0:1785774887.078996:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340032 00000100:00100000:2.0:1785774887.079076:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1785774887.079088:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671340032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774887.079119:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 84383424 pending 958464 free 3922616320 avail 3691094016 00000100:00100000:2.0:1785774887.079197:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671340032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774887.079204:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1785774887.079261:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671340032:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1785774887.079609:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774887.080440:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671340160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774887.080480:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774887.081507:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340160 00000100:00100000:0.0:1785774887.081515:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340160 00000100:00100000:0.0:1785774887.081564:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:0.0:1785774887.081573:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671340160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774887.081602:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774887.081653:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671340160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774887.081660:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1785774887.082338:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671340160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774887.590522:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671340288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774887.590594:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774887.590927:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340288 00000100:00100000:2.0:1785774887.590935:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340288 00000100:00100000:2.0:1785774887.591005:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1785774887.591014:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671340288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774887.591037:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 84383424 pending 958464 free 3922616320 avail 3691094016 00000100:00100000:2.0:1785774887.591095:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671340288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774887.591102:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1785774887.591209:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671340288:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1785774887.591546:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785774887.720897:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774888.740430:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774889.525797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774889.525977:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648625024 00000100:00100000:2.0:1785774889.525988:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648625024 00000100:00100000:2.0:1785774889.526132:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5226 00000100:00100000:2.0:1785774889.526143:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20906:x1872519648625024:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:2.0:1785774889.526410:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984137 00000100:00080000:3.0:1785774889.526686:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774889.526822:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20906:x1872519648625024:12345-192.168.202.31@tcp:35:dd.0 Request processed in 681us (1033us total) trans 4294984138 rc 0/0 00000100:00100000:2.0:1785774889.526830:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5226 00000020:00080000:2.0:1785774889.526834:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785774889.765908:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774890.149017:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671340416:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149090:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774890.149178:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671340928:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149209:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774890.149227:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671341440:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149264:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774890.149283:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671341952:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149304:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774890.149327:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1785774890.149344:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671340800:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149369:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774890.149384:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671341312:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149407:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774890.149423:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671341824:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149454:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774890.149487:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341440 00000100:00100000:0.0:1785774890.149494:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341440 00000100:00100000:0.0:1785774890.149542:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341952 00000100:00100000:0.0:1785774890.149546:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341952 00000100:00100000:0.0:1785774890.149562:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341312 00000100:00100000:0.0:1785774890.149565:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341312 00000100:00100000:0.0:1785774890.149579:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341824 00000100:00100000:0.0:1785774890.149582:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341824 00000100:00100000:0.0:1785774890.149601:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1785774890.149609:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671341440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149662:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671341440:12345-0@lo:400:kworker.0 Request processed in 52us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.149669:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1785774890.149685:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1785774890.149691:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671341952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.149993:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671341952:12345-0@lo:400:kworker.0 Request processed in 300us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.150000:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1785774890.150013:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1785774890.150020:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671341312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.150049:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671341312:12345-0@lo:400:kworker.0 Request processed in 30us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.150055:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1785774890.150066:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1785774890.150073:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671341824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.150098:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671341824:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.150107:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1785774890.150156:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671341312:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.150190:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671341824:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.150200:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671341440:0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.150209:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671341952:0@lo:400:kworker.0 00000100:00100000:3.0:1785774890.150557:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340928 00000100:00100000:3.0:1785774890.150563:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340928 00000100:00100000:3.0:1785774890.150594:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:3.0:1785774890.150601:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671340928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774890.150642:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671340928:12345-0@lo:400:kworker.0 Request processed in 42us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774890.150648:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:3.0:1785774890.150664:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340800 00000100:00100000:3.0:1785774890.150668:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340800 00000100:00100000:3.0:1785774890.150688:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1785774890.150693:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671340800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774890.150735:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671340800:12345-0@lo:400:kworker.0 Request processed in 41us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774890.150741:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00080000:3.0:1785774890.150755:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774890.150759:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774890.151032:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671340800:0@lo:400:kworker.0 00000100:00100000:3.0:1785774890.151043:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671340928:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.151572:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671340544:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.151609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774890.151634:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671341056:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.151656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774890.151682:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671341568:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.151718:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774890.151735:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671342080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774890.151759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774890.151781:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1785774890.151787:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671340672:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.151807:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774890.151821:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671341184:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.151841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774890.151855:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671341696:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.151873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774890.151906:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342080 00000100:00100000:2.0:1785774890.151910:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342080 00000100:00100000:2.0:1785774890.151936:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340672 00000100:00100000:2.0:1785774890.151938:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340672 00000100:00100000:2.0:1785774890.151952:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:2.0:1785774890.151958:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671342080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774890.151994:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:2.0:1785774890.152035:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671342080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774890.152041:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:2.0:1785774890.152056:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:2.0:1785774890.152061:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671340672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.152090:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671340672:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774890.152096:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:2.0:1785774890.152135:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671340672:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.152149:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671342080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774890.152750:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340544 00000100:00100000:0.0:1785774890.152756:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340544 00000100:00100000:0.0:1785774890.152795:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341056 00000100:00100000:0.0:1785774890.152798:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341056 00000100:00100000:0.0:1785774890.152822:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341568 00000100:00100000:0.0:1785774890.152825:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341568 00000100:00100000:0.0:1785774890.152837:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341184 00000100:00100000:0.0:1785774890.152840:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341184 00000100:00100000:0.0:1785774890.152851:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671341696 00000100:00100000:0.0:1785774890.152854:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671341696 00000100:00100000:0.0:1785774890.152867:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1785774890.152873:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671340544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.152913:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671340544:12345-0@lo:400:kworker.0 Request processed in 40us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.152920:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1785774890.152933:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1785774890.152938:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671341056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.152965:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671341056:12345-0@lo:400:kworker.0 Request processed in 27us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.152971:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1785774890.152995:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1785774890.153002:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671341568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.153030:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671341568:12345-0@lo:400:kworker.0 Request processed in 29us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.153036:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1785774890.153047:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1785774890.153053:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774890.153081:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671341184:12345-0@lo:400:kworker.0 Request processed in 28us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.153087:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1785774890.153097:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1785774890.153103:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671341696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774890.153487:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671340416 00000100:00100000:1.0:1785774890.153492:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671340416 00000100:00100000:1.0:1785774890.153525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1785774890.153533:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671340416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774890.153575:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671340416:12345-0@lo:400:kworker.0 Request processed in 43us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774890.153580:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00080000:1.0:1785774890.153653:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774890.153657:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774890.154052:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671341696:12345-0@lo:400:kworker.0 Request processed in 948us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.154060:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1785774890.154265:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671340416:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.155298:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671341184:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.155311:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671341696:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.155321:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671340544:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.155343:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671341056:0@lo:400:kworker.0 00000100:00100000:2.0:1785774890.155355:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671341568:0@lo:400:kworker.0 00000001:00080000:1.0:1785774890.155858:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984138 is committed 00010000:00010000:2.0:1785774890.157063:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774890.157076:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774890.157085:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774890.157091:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774890.157096:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774890.157103:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774890.157130:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7711ae8400) 00010000:00010000:2.0:1785774890.157133:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774890.157138:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774890.157144:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a19af lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774890.576475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774890.578089:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648625152 00000100:00100000:1.0:1785774890.578100:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648625152 00000100:00100000:1.0:1785774890.578194:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24110 00000100:00100000:1.0:1785774890.578204:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20910:x1872519648625152:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774890.578226:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774890.578256:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a19cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c55f expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774890.578314:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a19d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774890.578338:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a19d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774890.578350:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a19d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774890.578394:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:1.0:1785774890.578399:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1785774890.578421:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a19d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774890.578443:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a19cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c55f expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774890.578472:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a19d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c55f expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774890.578481:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774890.578485:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774890.578488:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9400, rc 0) 00000100:00100000:1.0:1785774890.578555:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20910:x1872519648625152:12345-192.168.202.31@tcp:101:dd.0 Request processed in 352us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774890.578561:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24110 00000100:00100000:1.0:1785774890.605350:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774890.605512:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648625408 00000100:00100000:0.0:1785774890.605523:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648625408 00000100:00100000:0.0:1785774890.605587:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24111 00000100:00100000:0.0:1785774890.605598:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20910:x1872519648625408:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774890.605619:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774890.605622:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785774890.605650:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a19d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c55f expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.605677:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774890.605683:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774890.605695:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c566 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.605795:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a19e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.605808:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.605816:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774890.605825:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 7905280 00010000:00010000:0.0:1785774890.605943:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c566 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.605957:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a19e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c566 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.605965:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774890.605968:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774890.605971:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c600, rc 0) 00000100:00100000:0.0:1785774890.606044:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20910:x1872519648625408:12345-192.168.202.31@tcp:101:dd.0 Request processed in 448us (715us total) trans 4294984139 rc 0/0 00000100:00100000:0.0:1785774890.606052:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24111 00000100:00100000:0.0:1785774890.623464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774890.623564:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648625536 00000100:00100000:1.0:1785774890.623573:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648625536 00000100:00100000:1.0:1785774890.623638:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1496 00000100:00100000:1.0:1785774890.623647:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648625536:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774890.623663:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774890.623692:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a19e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c566 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774890.623709:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:1.0:1785774890.623714:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774890.623761:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648625536:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774890.623768:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1496 00000100:00100000:3.0:1785774890.624277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774890.624450:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648625664 00000100:00100000:0.0:1785774890.624455:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648625664 00000100:00100000:0.0:1785774890.624490:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24112 00000100:00100000:0.0:1785774890.624498:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20910:x1872519648625664:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774890.624517:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774890.624533:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c56d expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.624562:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a19f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.624575:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a19f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.624586:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a19f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.624687:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c56d expref: 18 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.624701:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a19f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c56d expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.624722:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774890.624725:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774890.624728:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ce00, rc 0) 00000100:00100000:0.0:1785774890.624759:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20910:x1872519648625664:12345-192.168.202.31@tcp:101:dd.0 Request processed in 263us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.624766:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24112 00000100:00100000:3.0:1785774890.629246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774890.629284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774890.629343:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774890.629376:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774890.629404:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648626176 00000100:00100000:3.0:1785774890.629414:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648626176 00000100:00100000:3.0:1785774890.629468:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648626048 00000100:00100000:3.0:1785774890.629472:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648626048 00000100:00100000:3.0:1785774890.629502:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 698 00000100:00100000:3.0:1785774890.629511:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648626176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774890.629582:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648626176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774890.629591:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 698 00000100:00100000:3.0:1785774890.629606:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 699 00000100:00100000:3.0:1785774890.629613:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648626048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774890.629633:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648626048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 21us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774890.629639:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 699 00000100:00080000:1.0:1785774890.629965:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774890.629969:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774890.629980:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648625920 00000100:00100000:1.0:1785774890.629984:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648625920 00000100:00100000:1.0:1785774890.630023:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1137 00000100:00100000:1.0:1785774890.630030:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648625920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774890.630064:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648625920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774890.630071:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1137 00000100:00080000:2.0:1785774890.630137:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774890.630210:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648625792 00000100:00100000:0.0:1785774890.630215:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648625792 00000100:00100000:0.0:1785774890.630255:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 585 00000100:00100000:0.0:1785774890.630263:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648625792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774890.630292:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648625792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.630298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 585 00000100:00100000:2.0:1785774890.647646:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774890.647756:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648626432 00000100:00100000:0.0:1785774890.647765:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648626432 00000100:00100000:0.0:1785774890.647826:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24113 00000100:00100000:0.0:1785774890.647837:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20910:x1872519648626432:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:0.0:1785774890.647894:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774890.647922:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce800/0x7b7109e1d0a19b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c551 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.647941:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774890.647945:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774890.648631:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.648646:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.648657:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774890.648697:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984140 00000004:00010000:0.0:1785774890.648733:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be76a158 reply state 000000002b2265f0 transno 4294984141 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.648749:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.648757:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774890.648760:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774890.648762:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774890.648861:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20910:x1872519648626432:12345-192.168.202.31@tcp:36:dd.0 Request processed in 1024us (1222us total) trans 4294984141 rc 0/0 00000100:00100000:0.0:1785774890.648869:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24113 00000020:00080000:0.0:1785774890.648873:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774890.660675:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774890.660855:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648626560 00000100:00100000:0.0:1785774890.660865:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648626560 00000100:00100000:0.0:1785774890.660920:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24114 00000100:00100000:0.0:1785774890.660929:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20910:x1872519648626560:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774890.660953:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774890.660972:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1a03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c574 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.661026:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1a03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c574 expref: 20 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.661041:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1a03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c574 expref: 20 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774890.661060:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774890.661063:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785774890.661291:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9cc00, rc 0) 00000100:00100000:0.0:1785774890.661368:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20910:x1872519648626560:12345-192.168.202.31@tcp:101:dd.0 Request processed in 439us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774890.661377:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24114 00010000:00010000:3.0:1785774890.790282:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774891.172649:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671342208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774891.172722:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774891.172844:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342208 00000100:00100000:0.0:1785774891.172853:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342208 00000100:00100000:0.0:1785774891.172899:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1785774891.172909:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671342208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774891.172938:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774891.172993:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671342208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774891.173000:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1785774891.173117:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671342208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774891.177029:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774891.177050:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671342336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774891.177123:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774891.177270:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342336 00000100:00100000:2.0:1785774891.177278:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342336 00000100:00100000:2.0:1785774891.177333:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1785774891.177342:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671342336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774891.177363:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774891.177419:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671342336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774891.177427:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:1.0:1785774891.177519:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671342336:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1785774891.185754:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969952 is committed 00000100:00100000:2.0:1785774891.225465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774891.225560:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648626688 00000100:00100000:1.0:1785774891.225570:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648626688 00002000:00010000:1.0:1785774891.225607:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:1.0:1785774891.225611:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471c700 with x1872519648626688 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774891.225623:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471c700. 00000100:00100000:1.0:1785774891.225656:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 19 00000100:00100000:1.0:1785774891.225665:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648626688:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:1.0:1785774891.226770:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774891.226775:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 0 -> 1785774889 00002000:00010000:1.0:1785774891.226777:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774891.226780:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 0 -> 1785774889 00002000:00010000:1.0:1785774891.226782:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774891.226848:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648626688:12345-192.168.202.31@tcp:10:dd.0 Request processed in 1183us (1391us total) trans 4294969953 rc 0/0 00000100:00100000:1.0:1785774891.226857:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 19 00002000:00010000:1.0:1785774891.226861:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:1.0:1785774891.226863:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471c700 with x1872519648626688 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774891.226869:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471c700. 00010000:00010000:1.0:1785774891.812386:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774892.196486:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774892.196486:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774892.196514:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671342464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774892.196515:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671342592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774892.199306:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774892.202502:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774892.202624:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342464 00000100:00100000:1.0:1785774892.202634:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342464 00000100:00100000:1.0:1785774892.202710:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:1.0:1785774892.202721:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671342464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774892.202753:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 83424960 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774892.202811:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671342464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774892.202818:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00080000:3.0:1785774892.204045:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774892.204096:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342592 00000100:00100000:3.0:1785774892.204098:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671342464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774892.204104:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342592 00000100:00100000:2.0:1785774892.204145:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:2.0:1785774892.204155:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671342592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774892.204631:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774892.204692:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671342592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 539us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774892.204700:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:1.0:1785774892.204911:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671342592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774892.708592:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671342720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774892.708714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774892.709130:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342720 00000100:00100000:0.0:1785774892.709137:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342720 00000100:00100000:0.0:1785774892.709232:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00080000:2.0:1785774892.709237:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774892.709243:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671342720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774892.709266:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 83424960 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774892.709329:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671342720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774892.709336:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1785774892.709502:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671342720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785774892.836531:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774893.862649:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774894.736654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774894.737156:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648626816 00000100:00100000:2.0:1785774894.737181:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648626816 00002000:00100000:2.0:1785774894.737235:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b76056d4000 x1872519648626816/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:585/0 lens 488/0 e 0 to 0 dl 1785774905 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774894.737247:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76056d4000 with x1872519648626816 ext(0->4194303) 00002000:00010000:2.0:1785774894.737253:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76056d4000 00000100:00100000:2.0:1785774894.737279:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 20 00000100:00100000:2.0:1785774894.737299:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648626816:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:3.0:1785774894.757650:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785774894.884933:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774894.950230:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648626816:12345-192.168.202.31@tcp:4:dd.0 Request processed in 212928us (213569us total) trans 4294969954 rc 0/0 00000100:00100000:0.0:1785774894.950245:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 20 00002000:00100000:0.0:1785774894.950260:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b76056d4000 x1872519648626816/t4294969954(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:585/0 lens 488/448 e 0 to 0 dl 1785774905 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774894.950271:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76056d4000 with x1872519648626816 ext(0->4194303) 00002000:00010000:0.0:1785774894.950279:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76056d4000 00000100:00100000:3.0:1785774895.278755:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671342848:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.278839:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.280632:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671343360:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.280678:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.280697:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671343872:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.280717:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.280734:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671344384:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.280750:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.280772:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1785774895.280778:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671342976:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.280797:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.280813:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671343488:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.280840:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.280864:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671344000:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.281982:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.282011:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671344512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774895.282043:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.282073:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671343104:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.282093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.282107:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671343616:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.282124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.282137:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671344128:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.282154:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.282185:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1785774895.282191:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671343232:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.282210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.282224:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671343744:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.282242:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.282256:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671344256:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.282272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774895.286652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342848 00000100:00100000:3.0:1785774895.286665:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342848 00000100:00100000:3.0:1785774895.286732:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1785774895.286740:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671342848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.286820:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671342848:12345-0@lo:400:kworker.0 Request processed in 81us (7981us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.286827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1785774895.287636:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671343360 00000100:00100000:3.0:1785774895.287643:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671343360 00000100:00100000:3.0:1785774895.287673:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344512 00000100:00100000:3.0:1785774895.287676:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344512 00000100:00100000:3.0:1785774895.287685:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671343104 00000100:00100000:3.0:1785774895.287687:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671343104 00000100:00100000:3.0:1785774895.287698:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:3.0:1785774895.287703:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671343360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.287741:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671343360:12345-0@lo:400:kworker.0 Request processed in 38us (7063us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.287747:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:3.0:1785774895.287759:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:3.0:1785774895.287764:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671344512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774895.287787:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:3.0:1785774895.287814:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671344512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (5770us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.288441:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:3.0:1785774895.288455:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:3.0:1785774895.288476:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671343104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.288515:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671343104:12345-0@lo:400:kworker.0 Request processed in 40us (6421us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.288521:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:3.0:1785774895.288541:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671343872 00000100:00100000:3.0:1785774895.288545:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671343872 00000100:00100000:3.0:1785774895.288576:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344384 00000100:00100000:3.0:1785774895.288580:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344384 00000100:00100000:3.0:1785774895.288596:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671343744 00000100:00100000:3.0:1785774895.288599:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671343744 00000100:00100000:3.0:1785774895.288614:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344256 00000100:00100000:3.0:1785774895.288617:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344256 00000100:00100000:3.0:1785774895.288633:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1785774895.288639:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671343872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.288668:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671343872:12345-0@lo:400:kworker.0 Request processed in 29us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.288673:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1785774895.288683:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1785774895.288688:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671344384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.288712:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671344384:12345-0@lo:400:kworker.0 Request processed in 24us (7960us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.288716:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1785774895.288725:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1785774895.288730:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671343744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.288756:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671343744:12345-0@lo:400:kworker.0 Request processed in 26us (6512us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.288761:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1785774895.288769:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1785774895.288774:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671344256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.288795:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671344256:12345-0@lo:400:kworker.0 Request processed in 21us (6522us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.288800:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1785774895.290524:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671342976 00000100:00100000:3.0:1785774895.290533:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671342976 00000100:00100000:3.0:1785774895.290568:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671343488 00000100:00100000:3.0:1785774895.290570:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671343488 00000100:00100000:3.0:1785774895.290583:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344000 00000100:00100000:3.0:1785774895.290586:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344000 00000100:00100000:3.0:1785774895.290597:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671343616 00000100:00100000:3.0:1785774895.290599:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671343616 00000100:00100000:3.0:1785774895.290610:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344128 00000100:00100000:3.0:1785774895.290613:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344128 00000100:00100000:3.0:1785774895.290623:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671343232 00000100:00100000:3.0:1785774895.290625:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671343232 00000100:00100000:3.0:1785774895.290637:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1785774895.290644:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671342976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.290693:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671342976:12345-0@lo:400:kworker.0 Request processed in 49us (9893us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.290700:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1785774895.290712:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1785774895.290718:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671343488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.290743:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671343488:12345-0@lo:400:kworker.0 Request processed in 25us (9902us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.290749:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1785774895.290759:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1785774895.290764:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671344000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.290787:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671344000:12345-0@lo:400:kworker.0 Request processed in 23us (9904us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.290792:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1785774895.290801:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1785774895.290807:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671343616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.292094:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671343616:12345-0@lo:400:kworker.0 Request processed in 1283us (9964us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.292105:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1785774895.292127:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1785774895.292136:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671344128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.292179:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671344128:12345-0@lo:400:kworker.0 Request processed in 46us (10024us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.292186:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1785774895.292197:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1785774895.292203:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671343232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.292228:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671343232:12345-0@lo:400:kworker.0 Request processed in 26us (10016us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.292234:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1785774895.293629:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671342976:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293644:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671343488:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293657:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671344000:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293674:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671344512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774895.293683:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671342848:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293693:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671343360:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293703:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671343872:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293713:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671344384:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293764:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671343232:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293776:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671343744:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293786:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671344256:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293794:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671343104:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293803:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671343616:0@lo:400:kworker.0 00000100:00100000:3.0:1785774895.293813:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671344128:0@lo:400:kworker.0 00000100:00080000:3.0:1785774895.294983:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1785774895.294988:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774895.294991:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774895.294994:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774895.586900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774895.586999:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648627072 00000100:00100000:0.0:1785774895.587009:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648627072 00000100:00080000:3.0:1785774895.587188:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774895.587332:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5227 00000100:00100000:0.0:1785774895.587344:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20910:x1872519648627072:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:0.0:1785774895.587572:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984142 00000100:00100000:0.0:1785774895.587672:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:20910:x1872519648627072:12345-192.168.202.31@tcp:35:dd.0 Request processed in 330us (781us total) trans 4294984143 rc 0/0 00000100:00100000:0.0:1785774895.587680:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5227 00000020:00080000:0.0:1785774895.587685:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774895.751785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774895.751833:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774895.751882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774895.751932:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774895.751992:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648627584 00000100:00100000:0.0:1785774895.752009:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648627584 00000100:00100000:3.0:1785774895.752029:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648627328 00000100:00100000:3.0:1785774895.752039:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648627328 00000100:00100000:0.0:1785774895.752077:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648627456 00000100:00100000:0.0:1785774895.752082:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648627456 00000100:00100000:3.0:1785774895.752143:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1144 00000100:00100000:0.0:1785774895.752143:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 704 00000100:00100000:3.0:1785774895.752232:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648627328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774895.752233:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648627584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774895.752348:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648627584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 187us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774895.752358:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 704 00000100:00100000:2.0:1785774895.752415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648627200 00000100:00100000:2.0:1785774895.752422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648627200 00000100:00100000:2.0:1785774895.752462:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 587 00000100:00100000:2.0:1785774895.752470:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648627200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774895.752534:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648627328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 376us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774895.752542:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1144 00000100:00100000:1.0:1785774895.757031:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 705 00000100:00100000:1.0:1785774895.757067:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648627456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774895.757156:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648627456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 110us (5223us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774895.757185:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 705 00000100:00080000:1.0:1785774895.757236:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774895.757242:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774895.762664:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648627200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 10178us (10764us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774895.762683:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 587 00010000:00010000:1.0:1785774895.910598:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774896.294523:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671344640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774896.294636:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774896.295063:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344640 00000100:00100000:0.0:1785774896.295077:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344640 00000100:00100000:0.0:1785774896.295142:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1785774896.295152:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671344640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774896.295210:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774896.295995:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671344768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774896.296044:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774896.296104:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344768 00000100:00100000:1.0:1785774896.296110:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344768 00000100:00100000:1.0:1785774896.296153:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1785774896.296182:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671344768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774896.296204:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774896.296247:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671344768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774896.296255:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1785774896.296323:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671344768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774896.302357:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671344640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7198us (7721us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774896.302372:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000001:00080000:1.0:1785774896.304206:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984143 is committed 00010000:00010000:0.0:1785774896.304393:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774896.304406:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774896.304413:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774896.304419:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774896.304423:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774896.304431:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774896.304448:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774896.304451:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774896.304455:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774896.304462:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a19fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774896.307517:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671344640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774896.617953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774896.620454:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648627712 00000100:00100000:3.0:1785774896.620468:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648627712 00000100:00100000:3.0:1785774896.620543:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24115 00000100:00100000:3.0:1785774896.620553:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20914:x1872519648627712:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774896.620577:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774896.620596:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c57b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.620660:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1a11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.620674:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.620687:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774896.620727:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:3.0:1785774896.620731:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785774896.620751:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.620780:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c57b expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.620799:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1a11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c57b expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.620807:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774896.620810:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774896.620814:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cea00, rc 0) 00000100:00100000:3.0:1785774896.620881:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20914:x1872519648627712:12345-192.168.202.31@tcp:101:dd.0 Request processed in 329us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774896.620888:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24115 00000100:00100000:1.0:1785774896.632036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774896.632117:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648627968 00000100:00100000:3.0:1785774896.632128:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648627968 00000100:00100000:3.0:1785774896.632214:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24116 00000100:00100000:3.0:1785774896.632224:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20914:x1872519648627968:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774896.632245:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774896.632248:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785774896.632298:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1a11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c57b expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632324:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774896.632329:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774896.632341:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c582 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632452:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632465:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632474:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632487:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632494:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632500:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632547:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1a2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632555:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1a2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632562:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1a2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774896.632571:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 5455872 00010000:00010000:3.0:1785774896.632655:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632667:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632674:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632680:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774896.632685:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632692:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632700:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774896.632703:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774896.632707:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632713:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1a1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632722:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632727:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632733:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632738:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774896.632741:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632747:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632753:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7711ae8a00) 00010000:00010000:3.0:1785774896.632756:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774896.632758:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632764:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1a26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632812:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c582 expref: 19 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632826:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1a2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c582 expref: 18 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.632834:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774896.632836:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774896.632839:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf800, rc 0) 00000100:00100000:3.0:1785774896.633106:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20914:x1872519648627968:12345-192.168.202.31@tcp:101:dd.0 Request processed in 883us (1078us total) trans 4294984144 rc 0/0 00000100:00100000:3.0:1785774896.633114:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24116 00000100:00100000:1.0:1785774896.646957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774896.647138:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648628224 00000100:00100000:3.0:1785774896.647149:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648628224 00000100:00100000:3.0:1785774896.647256:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24117 00000100:00100000:3.0:1785774896.647276:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20914:x1872519648628224:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:3.0:1785774896.647338:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774896.647365:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1a2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c582 expref: 18 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.647383:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774896.647389:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774896.647545:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.647559:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.647568:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774896.647603:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984145 00000004:00010000:3.0:1785774896.647624:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6b7ac44 reply state 00000000cba07078 transno 4294984146 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.647636:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774896.647642:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774896.647645:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774896.647647:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774896.647738:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20914:x1872519648628224:12345-192.168.202.31@tcp:36:dd.0 Request processed in 472us (790us total) trans 4294984146 rc 0/0 00000100:00100000:3.0:1785774896.647746:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24117 00000020:00080000:3.0:1785774896.647750:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774896.757226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774896.757481:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648628352 00000100:00100000:0.0:1785774896.757491:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648628352 00002000:00010000:0.0:1785774896.757550:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:0.0:1785774896.757555:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307f100 with x1872519648628352 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774896.757568:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307f100. 00000100:00100000:0.0:1785774896.757614:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 21 00000100:00100000:0.0:1785774896.757625:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648628352:12345-192.168.202.31@tcp:10:dd.0 00000100:00080000:1.0:1785774896.758111:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1785774896.775937:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969955 is committed 00002000:00010000:0.0:1785774896.776192:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785774896.776197:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774889 -> 1785774895 00002000:00010000:0.0:1785774896.776199:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1785774896.776202:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774889 -> 1785774895 00002000:00010000:0.0:1785774896.776204:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1785774896.776295:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648628352:12345-192.168.202.31@tcp:10:dd.0 Request processed in 18666us (19072us total) trans 4294969955 rc 0/0 00000100:00100000:0.0:1785774896.776306:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 21 00002000:00010000:0.0:1785774896.776312:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:0.0:1785774896.776315:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307f100 with x1872519648628352 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774896.776323:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307f100. 00010000:00010000:2.0:1785774896.932340:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774897.316593:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671344896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774897.316670:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774897.317837:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671344896 00000100:00100000:1.0:1785774897.317848:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671344896 00000100:00100000:1.0:1785774897.317925:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1785774897.317936:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671344896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774897.317966:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 80598720 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774897.318022:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671344896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774897.318030:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1785774897.318076:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671344896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774897.318386:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671345024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774897.318425:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774897.318513:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345024 00000100:00100000:2.0:1785774897.318519:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345024 00000100:00100000:2.0:1785774897.318562:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:2.0:1785774897.318570:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671345024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774897.318595:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774897.318648:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671345024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774897.318655:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:2.0:1785774897.318685:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671345024:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1785774897.318908:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774897.828545:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671345152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774897.828614:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774897.828861:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345152 00000100:00100000:0.0:1785774897.828869:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345152 00000100:00080000:3.0:1785774897.828997:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774897.829039:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1785774897.829050:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671345152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774897.829071:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 139264 granted 80598720 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774897.829120:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671345152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774897.829127:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1785774897.829220:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671345152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774897.956446:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774898.980700:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774900.005700:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774900.390709:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671345408:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.390780:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774900.390838:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671345920:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.390867:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774900.390888:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671346432:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.390913:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774900.390930:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671346944:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.390950:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774900.390974:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1785774900.390979:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671345536:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.391002:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774900.391019:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671346048:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.391038:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774900.391052:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671346560:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.391073:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774900.391102:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345920 00000100:00100000:3.0:1785774900.391108:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345920 00000100:00100000:3.0:1785774900.391148:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:3.0:1785774900.391157:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671345920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.391228:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671345920:12345-0@lo:400:kworker.0 Request processed in 71us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.391355:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345408 00000100:00100000:0.0:1785774900.391360:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345408 00000100:00100000:0.0:1785774900.391388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1785774900.391394:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671345408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391426:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671345408:12345-0@lo:400:kworker.0 Request processed in 33us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.391432:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1785774900.391461:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345536 00000100:00100000:0.0:1785774900.391464:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345536 00000100:00100000:0.0:1785774900.391485:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346048 00000100:00100000:0.0:1785774900.391487:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346048 00000100:00100000:0.0:1785774900.391509:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346560 00000100:00100000:0.0:1785774900.391512:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346560 00000100:00100000:0.0:1785774900.391527:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1785774900.391532:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671345536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391559:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671345536:12345-0@lo:400:kworker.0 Request processed in 26us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.391564:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1785774900.391575:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1785774900.391581:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671346048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391606:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671346048:12345-0@lo:400:kworker.0 Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.391612:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1785774900.391624:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1785774900.391629:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391655:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671346560:12345-0@lo:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.391660:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00080000:0.0:1785774900.391683:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774900.391712:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346432 00000100:00100000:0.0:1785774900.391715:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346432 00000100:00100000:0.0:1785774900.391743:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346944 00000100:00100000:0.0:1785774900.391746:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346944 00000100:00100000:0.0:1785774900.391766:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1785774900.391772:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671346432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391802:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671346432:12345-0@lo:400:kworker.0 Request processed in 30us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.391808:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1785774900.391819:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1785774900.391825:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671346944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391852:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671346944:12345-0@lo:400:kworker.0 Request processed in 27us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.391858:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00080000:0.0:1785774900.391873:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774900.391876:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774900.391919:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671345536:0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391930:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671346048:0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391939:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671346560:0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391947:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671345408:0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391955:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671345920:0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391963:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671346432:0@lo:400:kworker.0 00000100:00100000:0.0:1785774900.391970:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671346944:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.392044:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1785774900.393442:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671345664:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.393491:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774900.393526:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671346176:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.393546:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774900.393568:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671346688:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.393587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774900.393610:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1785774900.393616:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671345280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774900.393636:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774900.393653:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671345792:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.393673:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774900.393689:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671346304:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.393710:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774900.393726:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671346816:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.393745:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774900.393773:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345664 00000100:00100000:2.0:1785774900.393779:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345664 00000100:00100000:2.0:1785774900.393811:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345280 00000100:00100000:2.0:1785774900.393814:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345280 00000100:00100000:2.0:1785774900.393831:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1785774900.393837:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671345664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.393881:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671345664:12345-0@lo:400:kworker.0 Request processed in 44us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774900.393888:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1785774900.393903:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1785774900.393909:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671345280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774900.393932:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:2.0:1785774900.393961:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671345280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774900.393968:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1785774900.393985:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346176 00000100:00100000:2.0:1785774900.393989:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346176 00000100:00100000:2.0:1785774900.394020:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346688 00000100:00100000:2.0:1785774900.394023:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346688 00000100:00100000:2.0:1785774900.394038:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671345792 00000100:00100000:2.0:1785774900.394040:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671345792 00000100:00100000:2.0:1785774900.394056:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1785774900.394061:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671346176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.394091:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671346176:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774900.394097:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1785774900.394108:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1785774900.394113:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671346688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.394137:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671346688:12345-0@lo:400:kworker.0 Request processed in 23us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774900.394142:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1785774900.394153:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1785774900.394349:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671345792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.394382:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671345792:12345-0@lo:400:kworker.0 Request processed in 223us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774900.394389:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00080000:2.0:1785774900.394418:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774900.394448:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671345280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774900.394460:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671345792:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.394467:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671345664:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.394475:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671346176:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.394484:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671346688:0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.395367:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346304 00000100:00100000:3.0:1785774900.395376:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346304 00000100:00100000:3.0:1785774900.395432:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671346816 00000100:00100000:3.0:1785774900.395436:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671346816 00000100:00100000:3.0:1785774900.395464:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1785774900.395470:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671346304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.395516:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671346304:12345-0@lo:400:kworker.0 Request processed in 46us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774900.395522:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1785774900.395535:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1785774900.395540:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671346816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774900.395569:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671346816:12345-0@lo:400:kworker.0 Request processed in 29us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774900.395574:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00080000:2.0:1785774900.395757:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774900.395762:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774900.395788:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671346304:0@lo:400:kworker.0 00000100:00100000:2.0:1785774900.395797:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671346816:0@lo:400:kworker.0 00000100:00100000:1.0:1785774900.454376:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774900.454500:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648628480 00000100:00100000:0.0:1785774900.454513:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648628480 00002000:00100000:0.0:1785774900.454602:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b760307d180 x1872519648628480/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:591/0 lens 488/0 e 0 to 0 dl 1785774911 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774900.454615:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307d180 with x1872519648628480 ext(0->4194303) 00002000:00010000:0.0:1785774900.454623:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307d180 00000100:00100000:0.0:1785774900.454661:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 22 00000100:00100000:0.0:1785774900.454671:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648628480:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:2.0:1785774900.456927:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774900.578887:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2418:x1872519648628480:12345-192.168.202.31@tcp:4:dd.0 Request processed in 124200us (124509us total) trans 4294969956 rc 0/0 00000100:00100000:0.0:1785774900.578913:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 22 00002000:00100000:0.0:1785774900.578931:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b760307d180 x1872519648628480/t4294969956(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:591/0 lens 488/448 e 0 to 0 dl 1785774911 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774900.578942:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307d180 with x1872519648628480 ext(0->4194303) 00002000:00010000:0.0:1785774900.578951:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307d180 00000100:00100000:2.0:1785774900.868603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774900.868661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774900.868751:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648628608 00000100:00100000:1.0:1785774900.868764:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648628608 00000100:00100000:1.0:1785774900.868831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 589 00000100:00100000:1.0:1785774900.868841:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648628608:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774900.868933:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648628608:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774900.868941:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 589 00000100:00100000:0.0:1785774900.869476:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648628864 00000100:00100000:0.0:1785774900.869482:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648628864 00000100:00100000:0.0:1785774900.869550:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1151 00000100:00100000:0.0:1785774900.869558:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648628864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774900.869602:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648628864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.869608:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1151 00000100:00080000:2.0:1785774900.869672:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774900.871651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774900.871691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774900.871768:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648628992 00000100:00100000:1.0:1785774900.871778:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648628992 00000100:00100000:1.0:1785774900.871839:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 710 00000100:00100000:1.0:1785774900.871847:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648628992:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774900.871914:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648628992:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774900.871922:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 710 00000100:00080000:2.0:1785774900.872447:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774900.872820:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648628736 00000100:00100000:0.0:1785774900.872826:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648628736 00000100:00100000:0.0:1785774900.872886:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1152 00000100:00100000:0.0:1785774900.872895:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648628736:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774900.872965:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648628736:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 70us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774900.872974:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1152 00000100:00080000:2.0:1785774900.874109:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785774901.028401:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774901.412790:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671347200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774901.412887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774901.413107:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347200 00000100:00100000:2.0:1785774901.413118:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347200 00000100:00100000:2.0:1785774901.413214:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1785774901.413236:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671347200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774901.413283:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774901.413341:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671347200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774901.413351:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1785774901.413638:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671347200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774901.415128:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774901.415151:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671347072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774901.415288:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774901.415439:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347072 00000100:00100000:1.0:1785774901.415447:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347072 00000100:00100000:1.0:1785774901.415496:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1785774901.415504:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671347072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774901.415535:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774901.415580:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671347072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774901.415587:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1785774901.415781:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671347072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774901.640907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774901.641019:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648629248 00000100:00100000:1.0:1785774901.641032:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648629248 00000100:00100000:1.0:1785774901.641105:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5228 00000100:00100000:1.0:1785774901.641117:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20914:x1872519648629248:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:1.0:1785774901.641451:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984147 00000100:00100000:1.0:1785774901.641578:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:20914:x1872519648629248:12345-192.168.202.31@tcp:35:dd.0 Request processed in 462us (683us total) trans 4294984148 rc 0/0 00000100:00100000:1.0:1785774901.641586:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5228 00000020:00080000:1.0:1785774901.641591:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1785774901.648789:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984148 is committed 00010000:00010000:2.0:1785774901.648915:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774901.648930:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774901.648937:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774901.648943:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774901.648947:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774901.648955:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774901.648977:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774901.648980:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774901.648984:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774901.648989:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cee00/0x7b7109e1d0a1a3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774901.933890:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969956 is committed 00010000:00010000:0.0:1785774902.052381:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774902.436714:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671347328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774902.436813:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774902.436974:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347328 00000100:00100000:1.0:1785774902.436985:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347328 00000100:00100000:0.0:1785774902.437001:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774902.437013:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671347456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774902.437051:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774902.437059:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1785774902.437071:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671347328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774902.437107:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 83531456 pending 0 free 3919331328 avail 3687809024 00000100:00100000:1.0:1785774902.437188:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671347328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774902.437198:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1785774902.437249:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347456 00000100:00100000:2.0:1785774902.437254:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347456 00000100:00100000:2.0:1785774902.437300:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1785774902.437309:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671347456:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1785774902.437321:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774902.437416:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671347328:0@lo:13:osp-pre-1-1.0 00000004:00000024:2.0:1785774902.437443:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774902.437548:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671347456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 239us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774902.437554:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:0.0:1785774902.446689:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671347456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774902.674621:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774902.677052:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648629376 00000100:00100000:0.0:1785774902.677068:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648629376 00000100:00100000:0.0:1785774902.677204:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24118 00000100:00100000:0.0:1785774902.677247:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20918:x1872519648629376:12345-192.168.202.31@tcp:101:dd.0 00000100:00080000:3.0:1785774902.677266:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785774902.677281:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774902.677309:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c589 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.677407:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1a49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.677425:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.677442:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774902.677502:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:0.0:1785774902.677715:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774902.677743:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.677769:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c589 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.677791:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1a49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c589 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.677801:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774902.677804:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774902.677808:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c600, rc 0) 00000100:00100000:0.0:1785774902.678917:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20918:x1872519648629376:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1701us (4306us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774902.678925:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24118 00000100:00100000:1.0:1785774902.692767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774902.692883:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648629632 00000100:00100000:2.0:1785774902.692897:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648629632 00000100:00100000:2.0:1785774902.692971:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24119 00000100:00100000:2.0:1785774902.693041:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20918:x1872519648629632:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774902.693073:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774902.693077:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785774902.693112:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1a49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c589 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693135:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774902.693140:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774902.693156:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1a50 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c590 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693536:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693552:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693564:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693587:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693595:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693602:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693668:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1a65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693677:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693684:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774902.693693:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 5951488 00010000:00010000:2.0:1785774902.693794:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693803:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693809:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693817:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693823:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774902.693830:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693839:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693848:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774902.693851:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774902.693855:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693862:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1a57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693873:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693880:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693886:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693891:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774902.693894:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693901:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693908:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7604f39500) 00010000:00010000:2.0:1785774902.693911:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774902.693915:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.693920:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1a5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.695187:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1a50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c590 expref: 19 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.695207:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c590 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774902.695226:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774902.695229:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774902.695232:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745e00, rc 0) 00000100:00100000:2.0:1785774902.695532:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20918:x1872519648629632:12345-192.168.202.31@tcp:101:dd.0 Request processed in 2549us (2778us total) trans 4294984149 rc 0/0 00000100:00100000:2.0:1785774902.695542:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24119 00000100:00100000:1.0:1785774902.701649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774902.701809:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648629888 00000100:00100000:0.0:1785774902.701823:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648629888 00000100:00100000:0.0:1785774902.701889:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24120 00000100:00100000:0.0:1785774902.701900:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20918:x1872519648629888:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:0.0:1785774902.702346:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774902.702381:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1a65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c590 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.702465:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774902.702472:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774902.702683:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.702698:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.702709:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774902.702749:0:21784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984150 00000004:00010000:0.0:1785774902.702769:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000698d0e3a reply state 00000000f0caf2e0 transno 4294984151 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.702780:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774902.702786:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774902.702789:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774902.702792:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774902.702887:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20918:x1872519648629888:12345-192.168.202.31@tcp:36:dd.0 Request processed in 988us (1254us total) trans 4294984151 rc 0/0 00000100:00100000:0.0:1785774902.702894:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24120 00000020:00080000:0.0:1785774902.702900:0:21784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774902.815402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774902.815686:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648630016 00000100:00100000:1.0:1785774902.815700:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648630016 00002000:00010000:1.0:1785774902.815775:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:1.0:1785774902.815781:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fab0a80 with x1872519648630016 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774902.815802:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fab0a80. 00000100:00100000:1.0:1785774902.815841:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23 00000100:00100000:1.0:1785774902.815852:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648630016:12345-192.168.202.31@tcp:10:dd.0 00000100:00080000:3.0:1785774902.816398:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1785774902.842375:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774902.842387:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774895 -> 1785774901 00002000:00010000:2.0:1785774902.842390:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774902.842393:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774895 -> 1785774901 00002000:00010000:2.0:1785774902.842396:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774902.842493:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2417:x1872519648630016:12345-192.168.202.31@tcp:10:dd.0 Request processed in 26635us (27099us total) trans 4294969957 rc 0/0 00000100:00100000:2.0:1785774902.842506:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23 00002000:00010000:2.0:1785774902.842512:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1785774902.842516:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fab0a80 with x1872519648630016 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774902.843249:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fab0a80. 00000100:00100000:0.0:1785774902.949781:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671347584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774902.949884:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774902.950119:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347584 00000100:00100000:2.0:1785774902.950128:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347584 00000100:00100000:2.0:1785774902.950275:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1785774902.950285:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671347584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774902.950312:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 83531456 pending 0 free 3919331328 avail 3687809024 00000100:00100000:2.0:1785774902.950373:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671347584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774902.950381:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1785774902.950554:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671347584:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1785774902.950653:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785774903.076471:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774904.100401:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774905.124709:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774905.509437:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76057d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671347968:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.509536:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774905.509603:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671348480:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.509629:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774905.509653:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671348992:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.509675:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774905.509699:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1785774905.509705:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76057d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671348096:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.509723:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774905.509737:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671348608:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.509756:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774905.509769:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671349120:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.509785:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774905.509814:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348480 00000100:00100000:1.0:1785774905.509822:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348480 00000100:00100000:1.0:1785774905.509879:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348992 00000100:00100000:1.0:1785774905.509881:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348992 00000100:00100000:1.0:1785774905.509897:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348096 00000100:00100000:1.0:1785774905.509899:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348096 00000100:00100000:1.0:1785774905.509917:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1785774905.509924:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671348480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.509976:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671348480:12345-0@lo:400:kworker.0 Request processed in 51us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774905.509984:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1785774905.510000:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1785774905.510006:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671348992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.510033:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671348992:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774905.510038:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1785774905.510049:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1785774905.510054:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671348096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.510079:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671348096:12345-0@lo:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774905.510085:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00080000:1.0:1785774905.510101:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774905.510143:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76057d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671348096:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.510153:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671348480:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.510200:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671348992:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.510248:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347968 00000100:00100000:1.0:1785774905.510251:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347968 00000100:00100000:1.0:1785774905.510279:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:1.0:1785774905.510286:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671347968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.510321:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671347968:12345-0@lo:400:kworker.0 Request processed in 36us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774905.510328:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:1.0:1785774905.510348:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76057d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671347968:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510507:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671347840:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774905.510564:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671348352:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510584:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774905.510605:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671348864:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774905.510641:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1785774905.510647:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671347712:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510677:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774905.510700:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671348224:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510722:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774905.510739:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671348736:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774905.510778:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671349248:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510799:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774905.510827:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347840 00000100:00100000:0.0:1785774905.510831:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347840 00000100:00100000:0.0:1785774905.510852:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348352 00000100:00100000:0.0:1785774905.510855:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348352 00000100:00100000:0.0:1785774905.510873:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348864 00000100:00100000:0.0:1785774905.510876:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348864 00000100:00100000:0.0:1785774905.510891:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1785774905.510896:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671347840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510930:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671347840:12345-0@lo:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.510936:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1785774905.510948:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1785774905.510954:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671348352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.510977:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671348352:12345-0@lo:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.510986:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1785774905.510996:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1785774905.511002:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671348864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511028:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671348864:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.511034:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1785774905.511052:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348608 00000100:00100000:0.0:1785774905.511055:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348608 00000100:00100000:0.0:1785774905.511081:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671349120 00000100:00100000:0.0:1785774905.511084:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671349120 00000100:00100000:0.0:1785774905.511103:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348736 00000100:00100000:0.0:1785774905.511106:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348736 00000100:00100000:0.0:1785774905.511122:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671349248 00000100:00100000:0.0:1785774905.511124:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671349248 00000100:00100000:0.0:1785774905.511140:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1785774905.511146:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671348608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511206:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671348608:12345-0@lo:400:kworker.0 Request processed in 60us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.511214:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1785774905.511226:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1785774905.511232:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671349120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511257:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671349120:12345-0@lo:400:kworker.0 Request processed in 26us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.511263:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1785774905.511274:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1785774905.511279:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773c2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671348736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511306:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773c2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671348736:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.511311:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1785774905.511499:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1785774905.511505:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671349248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511527:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671349248:12345-0@lo:400:kworker.0 Request processed in 24us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.511532:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1785774905.511557:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671347712 00000100:00100000:0.0:1785774905.511560:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671347712 00000100:00100000:0.0:1785774905.511582:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1785774905.511588:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671347712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511612:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671347712:12345-0@lo:400:kworker.0 Request processed in 24us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.511617:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00080000:0.0:1785774905.511647:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774905.511650:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774905.511652:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774905.511662:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671348224 00000100:00100000:0.0:1785774905.511665:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671348224 00000100:00100000:0.0:1785774905.511689:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1785774905.511696:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671348224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511722:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671348224:12345-0@lo:400:kworker.0 Request processed in 27us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.511727:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1785774905.511751:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671347712:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511762:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671348224:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511770:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671348736:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511777:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671349248:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511784:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671347840:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511791:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671348352:0@lo:400:kworker.0 00000100:00100000:0.0:1785774905.511798:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671348864:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.515415:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671348608:0@lo:400:kworker.0 00000100:00100000:1.0:1785774905.515431:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671349120:0@lo:400:kworker.0 00000100:00100000:2.0:1785774905.517308:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774905.517328:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671349376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774905.517403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774905.519320:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671349376 00000100:00100000:1.0:1785774905.519331:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671349376 00000100:00100000:1.0:1785774905.519400:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:1.0:1785774905.519409:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671349376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774905.519452:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774905.519517:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671349376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774905.519525:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:2.0:1785774905.520088:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671349376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774905.986894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774905.986953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774905.986995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774905.987034:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774905.987040:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648630528 00000100:00100000:3.0:1785774905.987054:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648630528 00000100:00100000:1.0:1785774905.987061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774905.987086:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648630656 00000100:00100000:1.0:1785774905.987090:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648630656 00000100:00100000:2.0:1785774905.987241:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648630144 00000100:00100000:2.0:1785774905.987245:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648630144 00000100:00100000:2.0:1785774905.987294:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 591 00000100:00100000:2.0:1785774905.987303:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648630144:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774905.987387:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648630144:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774905.987394:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 591 00000100:00100000:0.0:1785774905.987943:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648630272 00000100:00100000:0.0:1785774905.987948:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648630272 00000100:00100000:0.0:1785774905.987992:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648630400 00000100:00100000:0.0:1785774905.987996:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648630400 00000100:00100000:0.0:1785774905.988023:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1159 00000100:00100000:0.0:1785774905.988030:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648630272:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774905.988080:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648630272:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 50us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.988087:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1159 00000100:00100000:0.0:1785774905.988101:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1160 00000100:00100000:0.0:1785774905.988107:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648630400:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774905.988129:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648630400:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774905.988135:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1160 00000100:00080000:0.0:1785774905.988154:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785774905.988188:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774905.988191:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774905.988194:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774905.992412:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 715 00000100:00100000:2.0:1785774905.992433:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648630656:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774905.992451:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 716 00000100:00100000:3.0:1785774905.992467:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648630528:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774905.992544:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648630656:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 120us (5481us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774905.992554:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 715 00000100:00100000:3.0:1785774905.995380:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648630528:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2584us (8091us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774905.995397:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 716 00010000:00010000:0.0:1785774906.148375:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774906.256494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774906.256637:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648630784 00000100:00100000:1.0:1785774906.256650:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648630784 00002000:00100000:1.0:1785774906.256711:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b773fb49880 x1872519648630784/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:597/0 lens 488/0 e 0 to 0 dl 1785774917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774906.256722:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb49880 with x1872519648630784 ext(0->4194303) 00002000:00010000:1.0:1785774906.256728:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fb49880 00000100:00100000:1.0:1785774906.256765:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24 00000100:00100000:1.0:1785774906.256775:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648630784:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:1.0:1785774906.362625:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648630784:12345-192.168.202.31@tcp:4:dd.0 Request processed in 105836us (106129us total) trans 4294969958 rc 0/0 00000100:00100000:1.0:1785774906.362642:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24 00002000:00100000:1.0:1785774906.362657:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b773fb49880 x1872519648630784/t4294969958(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:597/0 lens 488/448 e 0 to 0 dl 1785774917 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774906.362668:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb49880 with x1872519648630784 ext(0->4194303) 00002000:00010000:1.0:1785774906.362675:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fb49880 00000100:00100000:1.0:1785774906.532468:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671349504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774906.532563:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774906.533155:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671349504 00000100:00100000:0.0:1785774906.533189:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671349504 00000100:00100000:0.0:1785774906.533254:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1785774906.533264:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671349504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774906.533300:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774906.533355:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671349504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774906.533363:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1785774906.533506:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671349504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774906.533526:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774906.533531:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671349632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774906.533558:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774906.533624:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671349632 00000100:00100000:1.0:1785774906.533628:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671349632 00000100:00100000:1.0:1785774906.533660:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1785774906.533666:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671349632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774906.533676:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774906.533717:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671349632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774906.533722:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1785774906.533747:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671349632:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1785774907.177497:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774907.557547:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785774907.557580:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671349760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774907.557667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774907.557844:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671349760 00000100:00100000:2.0:1785774907.557854:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671349760 00000100:00080000:0.0:1785774907.557997:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774907.558033:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1785774907.558044:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671349760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774907.558073:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 90187456 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774907.558130:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671349760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774907.558138:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1785774907.558228:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671349760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774907.558373:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774907.558383:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671349888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774907.558418:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774907.558506:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671349888 00000100:00100000:1.0:1785774907.558511:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671349888 00000100:00100000:1.0:1785774907.558555:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:1.0:1785774907.558564:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671349888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774907.558597:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774907.558639:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671349888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774907.558646:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1785774907.558732:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671349888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774907.696577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774907.696688:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648631040 00000100:00100000:0.0:1785774907.696701:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648631040 00000100:00100000:0.0:1785774907.696797:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5229 00000100:00100000:0.0:1785774907.696810:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20918:x1872519648631040:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:0.0:1785774907.697270:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984152 00000100:00100000:0.0:1785774907.697399:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:20918:x1872519648631040:12345-192.168.202.31@tcp:35:dd.0 Request processed in 593us (835us total) trans 4294984153 rc 0/0 00000100:00100000:0.0:1785774907.697408:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5229 00000020:00080000:0.0:1785774907.697413:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1785774907.698555:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1785774907.700439:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984153 is committed 00010000:00010000:0.0:1785774907.700515:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774907.700530:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774907.700537:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774907.700545:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774907.700550:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774907.700558:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774907.700579:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774907.700583:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774907.700589:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774907.700596:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a73 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774908.068452:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671350016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774908.068554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774908.069009:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350016 00000100:00100000:2.0:1785774908.069019:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350016 00000100:00100000:2.0:1785774908.069098:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1785774908.069110:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671350016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774908.069139:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 90187456 pending 4218880 free 3923525632 avail 3692003328 00000100:00080000:0.0:1785774908.069279:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774908.070337:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671350016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1228us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774908.070347:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000001:00080000:0.0:1785774908.071504:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969958 is committed 00000100:00100000:1.0:1785774908.077377:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671350016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785774908.196446:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774908.721293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774908.721407:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648631168 00000100:00100000:2.0:1785774908.721420:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648631168 00000100:00100000:2.0:1785774908.721499:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24121 00000100:00100000:2.0:1785774908.721511:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20922:x1872519648631168:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774908.721543:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774908.721567:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1a7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c597 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774908.721657:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1a81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774908.721675:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774908.721688:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774908.721749:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774908.721753:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774908.721780:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774908.721806:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1a7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c597 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774908.721826:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1a81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c597 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774908.721836:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774908.721839:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774908.721843:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744000, rc 0) 00000100:00100000:2.0:1785774908.721921:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20922:x1872519648631168:12345-192.168.202.31@tcp:101:dd.0 Request processed in 413us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774908.721930:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24121 00000100:00100000:0.0:1785774908.737924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774908.740603:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648631424 00000100:00100000:2.0:1785774908.740624:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648631424 00000100:00100000:0.0:1785774908.740840:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24122 00000100:00100000:0.0:1785774908.740855:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20922:x1872519648631424:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774908.740882:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774908.740886:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785774908.740921:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1a81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c597 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.740944:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774908.740950:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774908.740966:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c59e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741116:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741132:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741144:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741239:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741248:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741256:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741325:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1a9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741335:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741344:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774908.741355:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 7438336 00010000:00010000:0.0:1785774908.741465:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741473:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741480:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741487:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741493:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9de00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774908.741498:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741506:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741516:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774908.741519:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774908.741524:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741529:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1a8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741539:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741545:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741552:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741557:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774908.741560:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741565:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741572:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b77131b5400) 00010000:00010000:0.0:1785774908.741574:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774908.741577:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741582:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1a96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741627:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1a88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c59e expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741641:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1a9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c59e expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.741649:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774908.741651:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774908.741654:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9da00, rc 0) 00000100:00100000:0.0:1785774908.741748:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20922:x1872519648631424:12345-192.168.202.31@tcp:101:dd.0 Request processed in 896us (3839us total) trans 4294984154 rc 0/0 00000100:00100000:0.0:1785774908.741761:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24122 00000100:00100000:3.0:1785774908.751053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774908.751231:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648631680 00000100:00100000:0.0:1785774908.751245:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648631680 00000100:00100000:0.0:1785774908.751323:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24123 00000100:00100000:0.0:1785774908.751335:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20922:x1872519648631680:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:0.0:1785774908.751414:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774908.751452:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1a9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c59e expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.751475:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774908.751481:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774908.751707:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.751726:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.751738:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774908.751783:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984155 00000004:00010000:0.0:1785774908.751815:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000602759ed reply state 000000008308550d transno 4294984156 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.751829:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774908.751836:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774908.751839:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774908.751843:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774908.751942:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20922:x1872519648631680:12345-192.168.202.31@tcp:36:dd.0 Request processed in 608us (901us total) trans 4294984156 rc 0/0 00000100:00100000:0.0:1785774908.751950:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24123 00000020:00080000:0.0:1785774908.751956:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774908.969647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774908.969754:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648631808 00000100:00100000:0.0:1785774908.969766:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648631808 00002000:00010000:0.0:1785774908.969848:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:0.0:1785774908.969854:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fab3b80 with x1872519648631808 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774908.969870:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fab3b80. 00000100:00100000:0.0:1785774908.969907:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 25 00000100:00100000:0.0:1785774908.969917:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648631808:12345-192.168.202.31@tcp:10:dd.0 00000100:00080000:2.0:1785774908.970178:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1785774908.988675:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785774908.988686:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774901 -> 1785774907 00002000:00010000:0.0:1785774908.988689:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1785774908.988691:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774901 -> 1785774907 00002000:00010000:0.0:1785774908.988693:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1785774908.988796:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648631808:12345-192.168.202.31@tcp:10:dd.0 Request processed in 18873us (19156us total) trans 4294969959 rc 0/0 00000100:00100000:0.0:1785774908.989471:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 25 00002000:00010000:0.0:1785774908.989478:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:0.0:1785774908.989481:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fab3b80 with x1872519648631808 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774908.989490:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fab3b80. 00010000:00010000:2.0:1785774909.220753:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774910.245010:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774910.632579:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671350144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774910.632681:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774910.633012:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671350400:0@lo:400:kworker.0 00000100:00100000:2.0:1785774910.633050:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774910.633071:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671350912:0@lo:400:kworker.0 00000100:00100000:2.0:1785774910.633090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.633181:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350144 00000100:00100000:3.0:1785774910.633190:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350144 00000100:00100000:3.0:1785774910.633244:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:3.0:1785774910.633254:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671350144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774910.633298:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:3.0:1785774910.633350:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671350144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.633357:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:3.0:1785774910.633396:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350400 00000100:00100000:3.0:1785774910.633400:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350400 00000100:00100000:3.0:1785774910.633428:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350912 00000100:00100000:3.0:1785774910.633430:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350912 00000100:00100000:3.0:1785774910.633461:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1785774910.633467:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.633502:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671350400:12345-0@lo:400:kworker.0 Request processed in 35us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.633509:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1785774910.633520:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1785774910.633526:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671350912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.633553:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671350912:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.633559:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00080000:3.0:1785774910.633576:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774910.633652:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671350272:0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.633694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.633749:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350272 00000100:00100000:3.0:1785774910.633753:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350272 00000100:00100000:3.0:1785774910.633779:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1785774910.633795:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671350272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.633827:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671350272:12345-0@lo:400:kworker.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.633833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1785774910.648774:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671350912:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.649355:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671350528:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.649444:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.649503:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671351040:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.649534:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.649864:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671351552:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.649889:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.649919:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1785774910.649927:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671350656:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.649954:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.649980:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671351168:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650005:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.650029:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671351680:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650050:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774910.650096:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351040 00000100:00100000:3.0:1785774910.650103:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351040 00000100:00100000:3.0:1785774910.650239:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1785774910.650249:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671351040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650303:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671351040:12345-0@lo:400:kworker.0 Request processed in 56us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.650313:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1785774910.650329:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351552 00000100:00100000:3.0:1785774910.650331:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351552 00000100:00100000:3.0:1785774910.650354:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351168 00000100:00100000:3.0:1785774910.650356:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351168 00000100:00100000:3.0:1785774910.650371:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351680 00000100:00100000:3.0:1785774910.650373:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351680 00000100:00100000:3.0:1785774910.650389:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1785774910.650394:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671351552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650420:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671351552:12345-0@lo:400:kworker.0 Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.650425:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1785774910.650436:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1785774910.650442:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671351168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650468:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671351168:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.650473:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1785774910.650483:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1785774910.650489:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650512:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671351680:12345-0@lo:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.650517:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1785774910.650539:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350528 00000100:00100000:3.0:1785774910.650542:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350528 00000100:00100000:3.0:1785774910.650568:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1785774910.650573:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650602:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671350528:12345-0@lo:400:kworker.0 Request processed in 29us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.650607:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00080000:3.0:1785774910.650625:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774910.650629:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774910.650652:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671351168:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650662:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671351680:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650670:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671350528:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650678:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671351040:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650685:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671351552:0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650770:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350656 00000100:00100000:3.0:1785774910.650775:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350656 00000100:00100000:3.0:1785774910.650815:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1785774910.650823:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774910.650863:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671350656:12345-0@lo:400:kworker.0 Request processed in 41us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774910.650869:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1785774910.650893:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671350656:0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.651490:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671350272:0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.651501:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671350784:0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.651533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774910.651563:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671351296:0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.651586:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774910.651610:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671350784 00000100:00100000:1.0:1785774910.651614:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671350784 00000100:00100000:1.0:1785774910.651644:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351296 00000100:00100000:1.0:1785774910.651647:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351296 00000100:00100000:1.0:1785774910.651669:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1785774910.651675:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671350784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.651707:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671350784:12345-0@lo:400:kworker.0 Request processed in 32us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774910.651713:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1785774910.651725:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1785774910.651731:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671351296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.651761:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671351296:12345-0@lo:400:kworker.0 Request processed in 30us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774910.651767:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:1.0:1785774910.651795:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774910.651817:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671351296:0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.651836:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671350784:0@lo:400:kworker.0 00000100:00100000:2.0:1785774910.651952:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671351424:0@lo:400:kworker.0 00000100:00100000:2.0:1785774910.651983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774910.652026:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76056d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671350400:0@lo:400:kworker.0 00000100:00100000:0.0:1785774910.654984:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671350144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774910.655104:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351424 00000100:00100000:1.0:1785774910.655112:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351424 00000100:00100000:1.0:1785774910.655227:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1785774910.655237:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671351424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.655322:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671351424:12345-0@lo:400:kworker.0 Request processed in 86us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774910.655330:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00080000:0.0:1785774910.655392:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774910.657956:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671351424:0@lo:400:kworker.0 00000100:00100000:1.0:1785774910.700253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774910.700363:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648631936 00000100:00100000:0.0:1785774910.700376:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648631936 00002000:00100000:0.0:1785774910.700464:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b7605c94700 x1872519648631936/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:601/0 lens 488/0 e 0 to 0 dl 1785774921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774910.700476:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c94700 with x1872519648631936 ext(0->4194303) 00002000:00010000:0.0:1785774910.700483:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c94700 00000100:00100000:0.0:1785774910.700523:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 26 00000100:00100000:0.0:1785774910.700533:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648631936:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:1.0:1785774910.710232:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774910.811043:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648631936:12345-192.168.202.31@tcp:4:dd.0 Request processed in 110496us (110790us total) trans 4294969960 rc 0/0 00000100:00100000:3.0:1785774910.811062:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 26 00002000:00100000:3.0:1785774910.811079:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b7605c94700 x1872519648631936/t4294969960(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:601/0 lens 488/448 e 0 to 0 dl 1785774921 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774910.811091:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c94700 with x1872519648631936 ext(0->4194303) 00002000:00010000:3.0:1785774910.811100:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c94700 00000100:00100000:2.0:1785774911.110569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774911.110617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774911.110667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774911.110696:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774911.110724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774911.110756:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648632192 00000100:00100000:2.0:1785774911.110769:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648632192 00000100:00100000:0.0:1785774911.110783:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648632064 00000100:00100000:0.0:1785774911.110788:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648632064 00000100:00100000:0.0:1785774911.110851:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 593 00000100:00100000:0.0:1785774911.110862:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648632064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774911.110929:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648632320 00000100:00100000:1.0:1785774911.110933:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648632320 00000100:00100000:0.0:1785774911.110952:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648632064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774911.110959:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 593 00000100:00100000:1.0:1785774911.110975:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1167 00000100:00100000:1.0:1785774911.110981:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648632320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774911.111028:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648632320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774911.111034:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1167 00000100:00080000:1.0:1785774911.111053:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774911.111192:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648632448 00000100:00100000:3.0:1785774911.111200:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648632448 00000100:00100000:3.0:1785774911.111324:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648632576 00000100:00100000:3.0:1785774911.111328:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648632576 00000100:00100000:3.0:1785774911.111354:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 721 00000100:00100000:3.0:1785774911.111360:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648632448:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774911.111394:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648632448:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774911.111400:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 721 00000100:00100000:3.0:1785774911.111411:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 722 00000100:00100000:3.0:1785774911.111416:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648632576:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774911.111443:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648632576:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774911.111449:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 722 00000100:00080000:1.0:1785774911.111570:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774911.111849:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1168 00000100:00100000:2.0:1785774911.111857:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648632192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774911.111898:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648632192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 42us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774911.111905:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1168 00000100:00080000:1.0:1785774911.112093:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785774911.268780:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774911.653959:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671351808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774911.654053:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774911.654333:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351808 00000100:00100000:3.0:1785774911.654344:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351808 00000100:00100000:3.0:1785774911.654406:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1785774911.654417:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671351808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774911.654454:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774911.654517:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671351808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774911.654526:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1785774911.654734:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671351808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774911.654756:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774911.654763:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671351936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774911.654795:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774911.654887:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671351936 00000100:00100000:2.0:1785774911.654893:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671351936 00000100:00100000:2.0:1785774911.654935:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1785774911.654944:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671351936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774911.654959:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774911.655011:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671351936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774911.655017:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1785774911.655080:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671351936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774912.236703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774912.236798:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648632704 00000100:00100000:3.0:1785774912.236812:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648632704 00002000:00100000:3.0:1785774912.236901:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff9b760307f480 x1872519648632704/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:603/0 lens 488/0 e 0 to 0 dl 1785774923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774912.236915:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307f480 with x1872519648632704 ext(4194304->8388607) 00002000:00010000:3.0:1785774912.236923:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307f480 00000100:00100000:3.0:1785774912.236963:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00100000:3.0:1785774912.236975:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648632704:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:1.0:1785774912.238259:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785774912.294473:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774912.353683:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648632704:12345-192.168.202.31@tcp:4:dd.0 Request processed in 116695us (116978us total) trans 4294969961 rc 0/0 00000100:00100000:2.0:1785774912.353702:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 27 00002000:00100000:2.0:1785774912.353718:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff9b760307f480 x1872519648632704/t4294969961(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:603/0 lens 488/448 e 0 to 0 dl 1785774923 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774912.353730:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307f480 with x1872519648632704 ext(4194304->8388607) 00002000:00010000:2.0:1785774912.353739:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307f480 00000100:00100000:3.0:1785774912.677416:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671352064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774912.677516:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774912.677918:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352064 00000100:00100000:1.0:1785774912.677929:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352064 00000100:00100000:1.0:1785774912.677994:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1785774912.678004:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671352064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774912.678050:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774912.678127:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671352064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774912.678136:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:0.0:1785774912.678344:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671352064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774912.678572:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774912.678581:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671352192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774912.678613:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774912.678769:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352192 00000100:00100000:2.0:1785774912.678775:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352192 00000100:00100000:2.0:1785774912.678829:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1785774912.678836:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671352192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774912.678853:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 99575488 pending 8437760 free 3919331328 avail 3687809024 00000100:00100000:2.0:1785774912.678909:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671352192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774912.678916:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1785774912.679154:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671352192:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785774912.680327:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774913.188964:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671352320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774913.189063:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774913.194451:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352320 00000100:00100000:3.0:1785774913.194472:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352320 00000100:00100000:3.0:1785774913.194581:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1785774913.194593:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671352320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774913.194628:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 99575488 pending 8437760 free 3919331328 avail 3687809024 00000100:00100000:3.0:1785774913.194753:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671352320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (5689us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774913.194761:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00080000:1.0:1785774913.194938:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774913.195051:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671352320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785774913.316577:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774913.729403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774913.729555:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648632960 00000100:00100000:3.0:1785774913.729569:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648632960 00000100:00080000:1.0:1785774913.729707:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774913.729916:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5230 00000100:00100000:3.0:1785774913.729930:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20922:x1872519648632960:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:3.0:1785774913.731001:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984157 00000100:00100000:3.0:1785774913.731472:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:20922:x1872519648632960:12345-192.168.202.31@tcp:35:dd.0 Request processed in 1542us (2080us total) trans 4294984158 rc 0/0 00000100:00100000:3.0:1785774913.731485:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5230 00000020:00080000:3.0:1785774913.731492:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1785774914.228642:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984158 is committed 00010000:00010000:2.0:1785774914.229034:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.229051:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.229059:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.229066:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774914.229071:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.229079:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.229109:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774914.229113:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774914.229119:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.229126:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1aab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774914.340710:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774914.767923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774914.768006:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648633088 00000100:00100000:3.0:1785774914.768019:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648633088 00000100:00100000:3.0:1785774914.768088:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24124 00000100:00100000:3.0:1785774914.768106:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20926:x1872519648633088:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774914.768139:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774914.768142:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785774914.768218:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7731f80c00/0x7b7109e1d011966 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02257e036 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774914.768249:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b773c10c800) 00010000:00010000:3.0:1785774914.768264:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774914.768281:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5a5 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774914.768358:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1ab9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774914.768374:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774914.768386:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774914.768441:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:3.0:1785774914.768446:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785774914.768471:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774914.768492:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5a5 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774914.768505:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5a5 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774914.768512:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774914.768514:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774914.768517:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:3.0:1785774914.768594:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20926:x1872519648633088:12345-192.168.202.31@tcp:101:dd.0 Request processed in 497us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774914.768601:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24124 00000100:00100000:1.0:1785774914.791157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774914.791751:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648633344 00000100:00100000:3.0:1785774914.791764:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648633344 00000100:00100000:1.0:1785774914.792052:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24125 00000100:00100000:1.0:1785774914.792067:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20926:x1872519648633344:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774914.792108:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774914.792113:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785774914.792150:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a1ab9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5a5 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792194:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774914.792200:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774914.792216:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1ac0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792370:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792386:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792398:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792414:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792421:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792427:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792499:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1ad5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792509:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792521:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774914.792532:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 11403264 00010000:00010000:1.0:1785774914.792651:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792659:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792666:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792673:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792680:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774914.792685:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792693:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792703:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774914.792706:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774914.792710:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792716:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1ac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792735:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792742:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792762:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792768:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774914.792771:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792777:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792784:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7605fd8700) 00010000:00010000:1.0:1785774914.792787:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774914.792790:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792795:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a1ace lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792853:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1ac0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5ac expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792870:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5ac expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774914.792879:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:1.0:1785774914.792882:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774914.792885:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8c00, rc 0) 00000100:00100000:1.0:1785774914.792966:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20926:x1872519648633344:12345-192.168.202.31@tcp:101:dd.0 Request processed in 903us (1823us total) trans 4294984159 rc 0/0 00000100:00100000:1.0:1785774914.792974:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24125 00000100:00100000:0.0:1785774914.817465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774914.817590:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648633600 00000100:00100000:2.0:1785774914.817603:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648633600 00000100:00100000:2.0:1785774914.817676:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24126 00000100:00100000:2.0:1785774914.817686:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20926:x1872519648633600:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:2.0:1785774914.817779:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774914.817816:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1ad5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5ac expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.817849:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774914.817855:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774914.818117:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.818135:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.818147:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774914.818256:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984160 00000004:00010000:2.0:1785774914.818281:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b31ed90b reply state 00000000a46ff7cf transno 4294984161 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.818296:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774914.818303:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774914.818306:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774914.818309:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774914.818436:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20926:x1872519648633600:12345-192.168.202.31@tcp:36:dd.0 Request processed in 751us (985us total) trans 4294984161 rc 0/0 00000100:00100000:2.0:1785774914.818444:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24126 00000020:00080000:2.0:1785774914.818451:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774914.964628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774914.964789:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648633728 00000100:00100000:1.0:1785774914.964804:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648633728 00002000:00010000:1.0:1785774914.964873:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:1.0:1785774914.964880:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c17800 with x1872519648633728 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774914.964895:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c17800. 00000100:00100000:1.0:1785774914.964936:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 28 00000100:00100000:1.0:1785774914.964949:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648633728:12345-192.168.202.31@tcp:10:dd.0 00000100:00080000:2.0:1785774914.968501:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1785774914.992867:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969962 is committed 00002000:00010000:3.0:1785774914.993157:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785774914.993180:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774907 -> 1785774913 00002000:00010000:3.0:1785774914.993183:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785774914.993184:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774907 -> 1785774913 00002000:00010000:3.0:1785774914.993187:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1785774914.993286:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648633728:12345-192.168.202.31@tcp:10:dd.0 Request processed in 28334us (28664us total) trans 4294969962 rc 0/0 00000100:00100000:3.0:1785774914.993298:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 28 00002000:00010000:3.0:1785774914.993304:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:3.0:1785774914.993306:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c17800 with x1872519648633728 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774914.993314:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c17800. 00010000:00010000:3.0:1785774915.366986:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774915.744442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774915.746651:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648633856 00000100:00100000:0.0:1785774915.746668:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648633856 00002000:00100000:0.0:1785774915.746743:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->442367) req@ffff9b76057d2680 x1872519648633856/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:606/0 lens 488/0 e 0 to 0 dl 1785774926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774915.746756:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76057d2680 with x1872519648633856 ext(0->442367) 00002000:00010000:0.0:1785774915.746764:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76057d2680 00000100:00100000:0.0:1785774915.746813:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 29 00000100:00100000:0.0:1785774915.746825:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648633856:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774915.748908:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671352704:0@lo:400:kworker.0 00000100:00100000:0.0:1785774915.748977:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774915.749038:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671353216:0@lo:400:kworker.0 00000100:00100000:0.0:1785774915.749068:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774915.749101:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671353728:0@lo:400:kworker.0 00000100:00100000:0.0:1785774915.749123:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774915.749185:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1785774915.749193:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671352576:0@lo:400:kworker.0 00000100:00100000:0.0:1785774915.749219:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774915.749237:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671353088:0@lo:400:kworker.0 00000100:00100000:0.0:1785774915.749258:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774915.749278:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671353600:0@lo:400:kworker.0 00000100:00100000:0.0:1785774915.749299:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.749659:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353216 00000100:00100000:2.0:1785774915.749668:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353216 00000100:00100000:2.0:1785774915.749743:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353728 00000100:00100000:2.0:1785774915.749746:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353728 00000100:00100000:2.0:1785774915.749761:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352576 00000100:00100000:2.0:1785774915.749764:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352576 00000100:00100000:2.0:1785774915.749776:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353088 00000100:00100000:2.0:1785774915.749778:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353088 00000100:00100000:2.0:1785774915.749789:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353600 00000100:00100000:2.0:1785774915.749791:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353600 00000100:00100000:2.0:1785774915.749806:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1785774915.749815:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671353216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.749885:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671353216:12345-0@lo:400:kworker.0 Request processed in 71us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.749893:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1785774915.749913:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1785774915.749920:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671353728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.749952:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671353728:12345-0@lo:400:kworker.0 Request processed in 34us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.749958:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1785774915.749970:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1785774915.749975:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671352576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750002:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671352576:12345-0@lo:400:kworker.0 Request processed in 27us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.750008:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1785774915.750019:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1785774915.750025:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671353088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750052:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671353088:12345-0@lo:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.750057:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1785774915.750067:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1785774915.750073:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671353600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750115:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671353600:12345-0@lo:400:kworker.0 Request processed in 42us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.750121:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1785774915.750240:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671352448:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750280:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.750310:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671352960:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750334:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.750354:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671353472:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.750466:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671353984:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.750510:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1785774915.750516:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671352832:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750537:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.750553:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671353344:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.750591:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671353856:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750612:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774915.750642:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352448 00000100:00100000:2.0:1785774915.750646:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352448 00000100:00100000:2.0:1785774915.750675:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1785774915.750682:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671352448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750719:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671352448:12345-0@lo:400:kworker.0 Request processed in 37us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.750729:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1785774915.750759:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352704 00000100:00100000:2.0:1785774915.750763:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352704 00000100:00100000:2.0:1785774915.750788:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352960 00000100:00100000:2.0:1785774915.750791:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352960 00000100:00100000:2.0:1785774915.750809:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:2.0:1785774915.750815:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671352704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750849:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671352704:12345-0@lo:400:kworker.0 Request processed in 34us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.750856:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:2.0:1785774915.750867:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:2.0:1785774915.750872:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671352960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.750900:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671352960:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.750906:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00100000:2.0:1785774915.750925:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353472 00000100:00100000:2.0:1785774915.750928:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353472 00000100:00100000:2.0:1785774915.750955:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353984 00000100:00100000:2.0:1785774915.750957:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353984 00000100:00100000:2.0:1785774915.750974:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353344 00000100:00100000:2.0:1785774915.750976:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353344 00000100:00100000:2.0:1785774915.750990:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671353856 00000100:00100000:2.0:1785774915.750992:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671353856 00000100:00100000:2.0:1785774915.751006:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1785774915.751012:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671353472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.751041:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671353472:12345-0@lo:400:kworker.0 Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.751046:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1785774915.751056:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1785774915.751061:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671353984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.751081:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671353984:12345-0@lo:400:kworker.0 Request processed in 21us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.751097:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1785774915.751107:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1785774915.751112:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671353344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757471:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671352832 00000100:00100000:1.0:1785774915.757493:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671352832 00000100:00100000:1.0:1785774915.757589:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1785774915.757609:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671352832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757732:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671352832:12345-0@lo:400:kworker.0 Request processed in 126us (7192us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774915.757740:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1785774915.757839:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671352576:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757856:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671353088:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757870:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671353600:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757885:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671352704:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757898:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671353216:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757914:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671353728:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757981:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671352832:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.757995:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671352448:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.758009:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671352960:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.758022:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671353472:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.758034:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671353984:0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.758551:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671353344:12345-0@lo:400:kworker.0 Request processed in 7435us (7970us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.758562:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1785774915.758586:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1785774915.758595:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671353856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774915.758629:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671353856:12345-0@lo:400:kworker.0 Request processed in 36us (8016us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774915.758634:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00080000:0.0:1785774915.758721:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774915.758727:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774915.758731:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774915.758734:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774915.759190:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671354112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774915.759239:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774915.759286:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671354112 00000100:00100000:3.0:1785774915.759292:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671354112 00000100:00100000:3.0:1785774915.759331:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:3.0:1785774915.759338:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671354112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774915.759371:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:3.0:1785774915.759427:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671354112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774915.759435:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00100000:3.0:1785774915.759517:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671354112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774915.763802:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671353344:0@lo:400:kworker.0 00000100:00100000:1.0:1785774915.763829:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773465b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671353856:0@lo:400:kworker.0 00000100:00100000:0.0:1785774915.770508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774915.772316:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648633984 00000100:00100000:3.0:1785774915.772333:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648633984 00002000:00100000:3.0:1785774915.772388:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (442368->450559) req@ffff9b773465b480 x1872519648633984/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:606/0 lens 8680/0 e 0 to 0 dl 1785774926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774915.772401:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773465b480 with x1872519648633984 ext(442368->450559) 00002000:00010000:3.0:1785774915.772419:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773465b480 00000100:00100000:3.0:1785774915.772465:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 30 00000100:00100000:3.0:1785774915.772476:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648633984:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774915.782097:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648633856:12345-192.168.202.31@tcp:4:dd.0 Request processed in 35238us (37688us total) trans 4294969963 rc 0/0 00000100:00100000:2.0:1785774915.782118:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 29 00002000:00100000:2.0:1785774915.782137:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->442367) req@ffff9b76057d2680 x1872519648633856/t4294969963(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:606/0 lens 488/448 e 0 to 0 dl 1785774926 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774915.782148:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76057d2680 with x1872519648633856 ext(0->442367) 00002000:00010000:2.0:1785774915.782157:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76057d2680 00000100:00100000:1.0:1785774915.783198:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648633984:12345-192.168.202.31@tcp:4:dd.0 Request processed in 10719us (12818us total) trans 4294969964 rc 0/0 00000100:00100000:1.0:1785774915.783209:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 30 00002000:00100000:1.0:1785774915.783218:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (442368->450559) req@ffff9b773465b480 x1872519648633984/t4294969964(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:606/0 lens 8680/448 e 0 to 0 dl 1785774926 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774915.783227:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773465b480 with x1872519648633984 ext(442368->450559) 00002000:00010000:1.0:1785774915.783232:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773465b480 00000100:00100000:2.0:1785774915.794481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774915.795410:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648634112 00000100:00100000:3.0:1785774915.795426:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648634112 00002000:00100000:3.0:1785774915.795494:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (450560->475135) req@ffff9b76068d2a00 x1872519648634112/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:606/0 lens 488/0 e 0 to 0 dl 1785774926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774915.795508:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76068d2a00 with x1872519648634112 ext(450560->475135) 00002000:00010000:3.0:1785774915.795516:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76068d2a00 00000100:00100000:3.0:1785774915.795561:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00100000:3.0:1785774915.795572:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648634112:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774915.804606:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648634112:12345-192.168.202.31@tcp:4:dd.0 Request processed in 9019us (10124us total) trans 4294969965 rc 0/0 00000100:00100000:3.0:1785774915.804623:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 31 00002000:00100000:3.0:1785774915.804638:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (450560->475135) req@ffff9b76068d2a00 x1872519648634112/t4294969965(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:606/0 lens 488/448 e 0 to 0 dl 1785774926 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774915.804651:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76068d2a00 with x1872519648634112 ext(450560->475135) 00002000:00010000:3.0:1785774915.804658:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76068d2a00 00000100:00100000:0.0:1785774916.229114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774916.229212:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774916.229238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774916.229262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774916.229284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774916.229539:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648634752 00000100:00100000:1.0:1785774916.229539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648634240 00000100:00100000:3.0:1785774916.229552:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648634752 00000100:00100000:1.0:1785774916.229552:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648634240 00000100:00100000:3.0:1785774916.229606:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648634624 00000100:00100000:3.0:1785774916.229609:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648634624 00000100:00100000:1.0:1785774916.229610:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 595 00000100:00100000:1.0:1785774916.229620:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648634240:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774916.229630:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 727 00000100:00100000:3.0:1785774916.229636:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2419:x1872519648634752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774916.229729:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648634496 00000100:00100000:2.0:1785774916.229734:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648634496 00000100:00080000:0.0:1785774916.229857:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785774916.229863:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774916.229865:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774916.229890:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648634368 00000100:00100000:0.0:1785774916.229894:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648634368 00000100:00100000:1.0:1785774916.231142:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648634240:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1517us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774916.231156:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 595 00000100:00080000:1.0:1785774916.231232:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774916.238752:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2419:x1872519648634752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 9096us (9492us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774916.238773:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 727 00000100:00100000:3.0:1785774916.238824:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 728 00000100:00100000:3.0:1785774916.238843:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648634624:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774916.238912:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648634624:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (9625us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774916.238918:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 728 00000100:00100000:0.0:1785774916.239228:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1175 00000100:00100000:0.0:1785774916.239242:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648634496:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774916.239279:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648634496:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 42us (10066us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774916.239286:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1175 00000100:00100000:0.0:1785774916.239302:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1176 00000100:00100000:0.0:1785774916.239310:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648634368:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774916.239343:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648634368:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (10080us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774916.239350:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1176 00010000:00010000:1.0:1785774916.388857:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774916.772756:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671354240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774916.772850:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774916.773471:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671354240 00000100:00100000:2.0:1785774916.773482:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671354240 00000100:00100000:2.0:1785774916.773549:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1785774916.773559:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671354240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774916.773598:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774916.773649:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671354240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774916.773656:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1785774916.773755:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671354240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774916.775394:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671354368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774916.775459:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774916.775535:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671354368 00000100:00100000:3.0:1785774916.775544:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671354368 00000100:00100000:3.0:1785774916.775592:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:3.0:1785774916.775600:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671354368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774916.775622:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774916.775679:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671354368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774916.775686:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1785774916.775767:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671354368:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1785774917.413766:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774917.798014:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774917.798047:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671354496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774917.798202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774917.798396:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671354496 00000100:00100000:1.0:1785774917.798405:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671354496 00000100:00100000:1.0:1785774917.798468:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1785774917.798479:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671354496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774917.798520:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774917.798575:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671354496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774917.798583:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1785774917.798635:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671354496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774917.801628:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671354624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774917.801703:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774917.801813:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671354624 00000100:00100000:1.0:1785774917.801822:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671354624 00000100:00100000:1.0:1785774917.801905:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1785774917.801917:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671354624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774917.801960:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 499712 granted 113411776 pending 548864 free 3923050496 avail 3691528192 00000100:00080000:3.0:1785774917.803654:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774917.817619:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671354624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 15688us (15899us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774917.817640:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1785774917.820140:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671354624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774918.310379:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671354752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774918.310468:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774918.310573:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671354752 00000100:00100000:3.0:1785774918.310582:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671354752 00000100:00080000:1.0:1785774918.310765:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774918.311018:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1785774918.311038:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671354752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774918.311076:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 499712 granted 113411776 pending 548864 free 3923050496 avail 3691528192 00000100:00100000:3.0:1785774918.311359:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671354752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 328us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774918.311367:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1785774918.311427:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671354752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774918.437328:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774918.982732:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774918.982859:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648634880 00000100:00100000:2.0:1785774918.982872:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648634880 00002000:00100000:2.0:1785774918.982960:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff9b7604d6ad80 x1872519648634880/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:609/0 lens 488/0 e 0 to 0 dl 1785774929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774918.982973:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604d6ad80 with x1872519648634880 ext(4194304->8388607) 00002000:00010000:2.0:1785774918.982981:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604d6ad80 00000100:00100000:2.0:1785774918.983026:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 32 00000100:00100000:2.0:1785774918.983037:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648634880:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:1.0:1785774918.986213:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774919.104821:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648634880:12345-192.168.202.31@tcp:4:dd.0 Request processed in 121768us (122086us total) trans 4294969966 rc 0/0 00000100:00100000:2.0:1785774919.104839:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 32 00002000:00100000:2.0:1785774919.104856:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff9b7604d6ad80 x1872519648634880/t4294969966(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:609/0 lens 488/448 e 0 to 0 dl 1785774929 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774919.104868:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604d6ad80 with x1872519648634880 ext(4194304->8388607) 00002000:00010000:2.0:1785774919.104877:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604d6ad80 00010000:00010000:3.0:1785774919.460467:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774919.762003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774919.762908:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648635136 00000100:00100000:2.0:1785774919.762922:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648635136 00000100:00100000:2.0:1785774919.763086:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5231 00000100:00100000:2.0:1785774919.763100:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20926:x1872519648635136:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:2.0:1785774919.763401:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984162 00000100:00100000:2.0:1785774919.763539:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:20926:x1872519648635136:12345-192.168.202.31@tcp:35:dd.0 Request processed in 442us (1550us total) trans 4294984163 rc 0/0 00000100:00100000:2.0:1785774919.763548:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5231 00000020:00080000:2.0:1785774919.763554:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1785774919.763666:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1785774920.358639:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984163 is committed 00010000:00010000:0.0:1785774920.358730:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774920.358743:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774920.358750:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774920.358757:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774920.358762:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774920.358769:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774920.358787:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774920.358790:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774920.358795:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774920.358894:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ae3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.484519:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774920.770529:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774920.770596:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648635264 00000100:00100000:3.0:1785774920.770606:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648635264 00000100:00100000:3.0:1785774920.770679:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24127 00000100:00100000:3.0:1785774920.770698:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20930:x1872519648635264:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774920.770725:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774920.770745:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1aea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5b3 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.770809:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1af1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.770823:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.770834:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774920.770892:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:3.0:1785774920.770896:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1785774920.770924:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.770946:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1aea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5b3 expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.770963:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1af1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5b3 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.770972:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774920.770974:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785774920.770978:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:3.0:1785774920.771066:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20930:x1872519648635264:12345-192.168.202.31@tcp:101:dd.0 Request processed in 351us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774920.771074:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24127 00000100:00100000:0.0:1785774920.776685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774920.779110:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648635520 00000100:00100000:1.0:1785774920.779123:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648635520 00000100:00100000:1.0:1785774920.779268:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24128 00000100:00100000:1.0:1785774920.779280:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20930:x1872519648635520:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774920.779318:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774920.779321:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785774920.779350:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf600/0x7b7109e1d0a1af1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5b3 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779373:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774920.779378:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774920.779393:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1af8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779508:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779520:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779535:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779552:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779559:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779567:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779638:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a1b0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779648:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a1b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779656:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a1b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774920.779665:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 10788864 00010000:00010000:1.0:1785774920.779760:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779769:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779776:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779784:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779791:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774920.779795:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779801:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779810:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774920.779813:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774920.779816:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779822:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1aff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779838:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779845:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779851:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779855:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774920.779858:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779876:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.779887:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7605fd8c00) 00010000:00010000:1.0:1785774920.779890:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774920.779893:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.781354:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1b06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.781421:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1af8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5ba expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.781443:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a1b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5ba expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774920.781454:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:1.0:1785774920.781458:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774920.781461:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9400, rc 0) 00000100:00100000:1.0:1785774920.781535:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20930:x1872519648635520:12345-192.168.202.31@tcp:101:dd.0 Request processed in 2258us (4858us total) trans 4294984164 rc 0/0 00000100:00100000:1.0:1785774920.781545:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24128 00000100:00100000:2.0:1785774920.787631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774920.787733:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648635776 00000100:00100000:3.0:1785774920.787746:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648635776 00000100:00100000:3.0:1785774920.787817:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24129 00000100:00100000:3.0:1785774920.787828:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20930:x1872519648635776:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:3.0:1785774920.787901:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774920.787936:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9400/0x7b7109e1d0a1b0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5ba expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.787983:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774920.787989:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774920.788424:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.788443:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.788455:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774920.788503:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984165 00000004:00010000:3.0:1785774920.788525:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e1a6e61 reply state 0000000055e05db9 transno 4294984166 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.788539:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774920.788545:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774920.788548:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774920.788551:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774920.790544:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20930:x1872519648635776:12345-192.168.202.31@tcp:36:dd.0 Request processed in 2650us (2858us total) trans 4294984166 rc 0/0 00000100:00100000:3.0:1785774920.790557:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24129 00000020:00080000:3.0:1785774920.790566:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774920.868476:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671355008:0@lo:400:kworker.0 00000100:00100000:2.0:1785774920.868575:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774920.868713:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355008 00000100:00100000:3.0:1785774920.868723:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355008 00000100:00100000:3.0:1785774920.868783:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1785774920.868793:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671355008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.869011:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671354880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774920.869060:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774920.869121:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671354880 00000100:00100000:1.0:1785774920.869125:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671354880 00000100:00100000:1.0:1785774920.869156:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:1.0:1785774920.869177:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671354880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774920.869212:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774920.869257:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671354880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.869264:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:1.0:1785774920.869315:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671354880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774920.877554:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671355136:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.878447:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774920.878488:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671355648:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.878515:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774920.878532:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671356160:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.878552:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774920.878576:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1785774920.878583:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671355264:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.878604:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774920.878706:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671355776:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.878738:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774920.878758:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671355392:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.878761:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671356288:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.878810:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774920.878856:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774920.878858:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355776 00000100:00100000:0.0:1785774920.878868:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355776 00000100:00100000:1.0:1785774920.878913:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671355904:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.878940:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774920.878971:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671356416:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.878990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774920.879013:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1785774920.879019:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671355520:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879075:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774920.879093:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671356032:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774920.879152:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355392 00000100:00100000:1.0:1785774920.879174:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355392 00000100:00100000:1.0:1785774920.879231:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:1.0:1785774920.879242:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671355392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879305:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671355392:12345-0@lo:400:kworker.0 Request processed in 64us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879312:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00080000:1.0:1785774920.879335:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774920.879350:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356288 00000100:00100000:1.0:1785774920.879353:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356288 00000100:00100000:1.0:1785774920.879386:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355904 00000100:00100000:1.0:1785774920.879389:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355904 00000100:00100000:1.0:1785774920.879408:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356416 00000100:00100000:1.0:1785774920.879411:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356416 00000100:00100000:1.0:1785774920.879432:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1785774920.879438:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671356288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879477:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671356288:12345-0@lo:400:kworker.0 Request processed in 39us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879483:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1785774920.879494:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1785774920.879500:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671355904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879523:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671355904:12345-0@lo:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879528:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1785774920.879536:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1785774920.879541:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671356416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879562:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671356416:12345-0@lo:400:kworker.0 Request processed in 21us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879567:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1785774920.879624:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671356288:0@lo:400:kworker.0 00000100:00080000:1.0:1785774920.879645:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774920.879648:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774920.879660:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671355392:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879669:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671355904:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879677:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671356416:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879696:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355136 00000100:00100000:1.0:1785774920.879700:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355136 00000100:00100000:1.0:1785774920.879719:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355648 00000100:00100000:1.0:1785774920.879722:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355648 00000100:00100000:1.0:1785774920.879737:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356160 00000100:00100000:1.0:1785774920.879740:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356160 00000100:00100000:1.0:1785774920.879749:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355264 00000100:00100000:1.0:1785774920.879751:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355264 00000100:00100000:1.0:1785774920.879760:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671355520 00000100:00100000:1.0:1785774920.879762:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671355520 00000100:00100000:1.0:1785774920.879772:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356032 00000100:00100000:1.0:1785774920.879775:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356032 00000100:00100000:1.0:1785774920.879786:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1785774920.879792:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671355136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879825:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671355136:12345-0@lo:400:kworker.0 Request processed in 32us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879830:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1785774920.879841:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:1.0:1785774920.879847:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671355648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879873:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671355648:12345-0@lo:400:kworker.0 Request processed in 27us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879878:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:1.0:1785774920.879887:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1785774920.879892:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671356160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879913:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671356160:12345-0@lo:400:kworker.0 Request processed in 21us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879917:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1785774920.879926:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1785774920.879930:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671355264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879954:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671355264:12345-0@lo:400:kworker.0 Request processed in 23us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.879959:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1785774920.879967:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1785774920.879972:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671355520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.879996:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671355520:12345-0@lo:400:kworker.0 Request processed in 24us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.880001:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1785774920.880010:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1785774920.880014:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671356032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.880050:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671356032:12345-0@lo:400:kworker.0 Request processed in 22us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774920.880057:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:1.0:1785774920.880069:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774920.880072:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774920.880088:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671355264:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.880100:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671355136:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.880109:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671355648:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.880119:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671356160:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.880142:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671355520:0@lo:400:kworker.0 00000100:00100000:1.0:1785774920.880150:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b774183ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671356032:0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.882427:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1785774920.882445:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671355776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774920.882530:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671355776:12345-0@lo:400:kworker.0 Request processed in 91us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774920.882537:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1785774920.882585:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671355776:0@lo:400:kworker.0 00000100:00100000:3.0:1785774920.884154:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671355008:12345-0@lo:400:kworker.0 Request processed in 15350us (15567us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774920.884258:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000001:00080000:0.0:1785774920.892678:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969966 is committed 00000100:00100000:2.0:1785774920.897793:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671355008:0@lo:400:kworker.0 00000100:00100000:2.0:1785774921.124724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774921.124827:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648635904 00000100:00100000:3.0:1785774921.124841:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648635904 00002000:00010000:3.0:1785774921.124917:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:3.0:1785774921.124923:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76068d0e00 with x1872519648635904 ext(0->18446744073709551615) 00000100:00080000:1.0:1785774921.124924:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1785774921.124939:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76068d0e00. 00000100:00100000:3.0:1785774921.124978:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 33 00000100:00100000:3.0:1785774921.124990:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648635904:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:3.0:1785774921.132063:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785774921.132075:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774913 -> 1785774919 00002000:00010000:3.0:1785774921.132079:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785774921.132081:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774913 -> 1785774919 00002000:00010000:3.0:1785774921.132083:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1785774921.133282:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648635904:12345-192.168.202.31@tcp:10:dd.0 Request processed in 8285us (8561us total) trans 4294969967 rc 0/0 00000100:00100000:3.0:1785774921.133297:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 33 00002000:00010000:3.0:1785774921.133303:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:3.0:1785774921.133307:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76068d0e00 with x1872519648635904 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774921.133317:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76068d0e00. 00000100:00100000:0.0:1785774921.347537:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774921.347591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774921.347625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774921.347667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774921.347801:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648636416 00000100:00100000:3.0:1785774921.347822:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648636416 00000100:00100000:3.0:1785774921.347926:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 733 00000100:00100000:3.0:1785774921.347937:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648636416:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774921.348027:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648636416:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774921.348065:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 733 00000100:00100000:3.0:1785774921.348096:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648636288 00000100:00100000:3.0:1785774921.348100:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648636288 00000100:00100000:3.0:1785774921.348128:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648636160 00000100:00100000:3.0:1785774921.348131:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648636160 00000100:00100000:3.0:1785774921.348154:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1183 00000100:00100000:3.0:1785774921.348206:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648636288:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774921.348237:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648636288:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774921.348244:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1183 00000100:00100000:3.0:1785774921.348257:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1184 00000100:00100000:3.0:1785774921.348263:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648636160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774921.348288:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648636160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774921.348293:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1184 00000100:00100000:1.0:1785774921.348585:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648636032 00000100:00100000:1.0:1785774921.348591:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648636032 00000100:00100000:1.0:1785774921.348630:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 597 00000100:00100000:1.0:1785774921.348637:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648636032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774921.348665:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648636032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774921.348672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 597 00000100:00080000:0.0:1785774921.348813:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774921.348818:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785774921.348821:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785774921.508837:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774921.892559:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671356544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774921.892650:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774921.892792:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356544 00000100:00100000:2.0:1785774921.892803:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356544 00000100:00100000:2.0:1785774921.892874:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1785774921.892894:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671356544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774921.892933:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774921.893003:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671356544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774921.893012:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1785774921.893380:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671356544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774921.893688:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774921.893701:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671356672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774921.893737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774921.893897:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356672 00000100:00100000:3.0:1785774921.893903:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356672 00000100:00100000:3.0:1785774921.893942:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1785774921.893950:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671356672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774921.894226:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774921.894271:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671356672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 322us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774921.894277:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1785774921.894349:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671356672:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1785774922.533305:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774922.916741:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774922.916773:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671356800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774922.916862:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774922.917057:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356800 00000100:00100000:1.0:1785774922.917067:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356800 00000100:00100000:1.0:1785774922.917129:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:1.0:1785774922.917140:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671356800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774922.917202:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774922.917261:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671356800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774922.917268:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:2.0:1785774922.917415:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671356800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774922.920848:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774922.920886:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671356928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774922.920970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774922.921191:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671356928 00000100:00100000:2.0:1785774922.921202:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671356928 00000100:00100000:2.0:1785774922.921276:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1785774922.921287:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671356928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774922.921326:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3801088 granted 117081792 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774922.921373:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671356928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774922.921379:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00080000:0.0:1785774922.922477:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774922.922532:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671356928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774923.439037:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671357056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774923.439137:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774923.439341:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357056 00000100:00100000:1.0:1785774923.439354:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357056 00000100:00100000:1.0:1785774923.439442:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1785774923.439453:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671357056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785774923.439484:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3801088 granted 117081792 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774923.439540:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671357056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774923.439549:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1785774923.439602:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76068d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671357056:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785774923.439721:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785774923.560235:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774924.219721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774924.219991:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648636544 00000100:00100000:3.0:1785774924.220017:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648636544 00002000:00100000:3.0:1785774924.220123:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b76068d0380 x1872519648636544/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:615/0 lens 488/0 e 0 to 0 dl 1785774935 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774924.220137:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76068d0380 with x1872519648636544 ext(0->4194303) 00002000:00010000:3.0:1785774924.220147:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76068d0380 00000100:00100000:3.0:1785774924.220286:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 34 00000100:00100000:3.0:1785774924.220299:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2419:x1872519648636544:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:1.0:1785774924.223091:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774924.349121:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76068d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648636544:12345-192.168.202.31@tcp:4:dd.0 Request processed in 128813us (129404us total) trans 4294969968 rc 0/0 00000100:00100000:2.0:1785774924.349136:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 34 00002000:00100000:2.0:1785774924.349147:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b76068d0380 x1872519648636544/t4294969968(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:615/0 lens 488/448 e 0 to 0 dl 1785774935 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774924.349182:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76068d0380 with x1872519648636544 ext(0->4194303) 00002000:00010000:2.0:1785774924.349189:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76068d0380 00010000:00010000:1.0:1785774924.583305:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774925.604411:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774925.808240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774925.808385:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648636800 00000100:00100000:3.0:1785774925.808402:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648636800 00000100:00100000:3.0:1785774925.808504:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5232 00000100:00100000:3.0:1785774925.808515:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20930:x1872519648636800:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:3.0:1785774925.808828:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984167 00000100:00100000:3.0:1785774925.809000:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:20930:x1872519648636800:12345-192.168.202.31@tcp:35:dd.0 Request processed in 476us (757us total) trans 4294984168 rc 0/0 00000100:00100000:3.0:1785774925.809010:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5232 00000020:00080000:3.0:1785774925.809016:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1785774925.810432:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1785774925.811272:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984168 is committed 00010000:00010000:2.0:1785774925.811369:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774925.811382:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774925.811390:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774925.811396:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774925.811401:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774925.811409:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774925.811425:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774925.811429:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774925.811434:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774925.811440:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf800/0x7b7109e1d0a1b1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774925.989220:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671357184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774925.989292:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774925.989847:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671357696:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.989886:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774925.989902:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671358208:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990198:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671357440:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990232:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774925.990257:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671357952:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990278:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774925.990296:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671358464:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990316:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774925.990334:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1785774925.990339:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671357568:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774925.990370:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671358080:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990400:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774925.990413:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671358592:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774925.990454:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357440 00000100:00100000:3.0:1785774925.990460:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357440 00000100:00100000:3.0:1785774925.990496:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357952 00000100:00100000:3.0:1785774925.990498:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357952 00000100:00100000:3.0:1785774925.990522:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358464 00000100:00100000:3.0:1785774925.990524:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358464 00000100:00100000:3.0:1785774925.990535:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357568 00000100:00100000:3.0:1785774925.990537:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357568 00000100:00100000:3.0:1785774925.990549:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1785774925.990556:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671357440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990599:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671357440:12345-0@lo:400:kworker.0 Request processed in 43us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774925.990606:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1785774925.990620:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1785774925.990626:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671357952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990662:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671357952:12345-0@lo:400:kworker.0 Request processed in 37us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774925.990669:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1785774925.990678:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1785774925.990683:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671358464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990706:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671358464:12345-0@lo:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774925.990711:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1785774925.990721:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1785774925.990726:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671357568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990748:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671357568:12345-0@lo:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774925.990753:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1785774925.990791:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671357568:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990801:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671357440:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990808:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671357952:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.990816:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671358464:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.991126:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774925.991174:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671358720:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.991197:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774925.991218:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1785774925.991224:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671357312:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.991250:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774925.991269:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671357824:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.991290:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774925.991304:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671358336:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.991324:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774925.991490:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358080 00000100:00100000:0.0:1785774925.991495:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358080 00000100:00100000:0.0:1785774925.991533:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358592 00000100:00100000:0.0:1785774925.991536:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358592 00000100:00100000:0.0:1785774925.991552:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358208 00000100:00100000:0.0:1785774925.991555:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358208 00000100:00100000:0.0:1785774925.991569:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358720 00000100:00100000:0.0:1785774925.991572:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358720 00000100:00100000:0.0:1785774925.991591:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1785774925.991598:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671358080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774925.991635:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671358080:12345-0@lo:400:kworker.0 Request processed in 39us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774925.991652:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1785774925.991667:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1785774925.991672:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671358592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774925.991697:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671358592:12345-0@lo:400:kworker.0 Request processed in 25us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774925.991705:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1785774925.991715:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1785774925.991720:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671358208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774925.991749:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671358208:12345-0@lo:400:kworker.0 Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774925.991755:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1785774925.991765:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1785774925.991771:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671358720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774925.991795:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671358720:12345-0@lo:400:kworker.0 Request processed in 25us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774925.991801:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1785774925.992025:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357824 00000100:00100000:3.0:1785774925.992030:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357824 00000100:00100000:3.0:1785774925.992050:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358336 00000100:00100000:3.0:1785774925.992053:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358336 00000100:00100000:3.0:1785774925.992067:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1785774925.992082:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671357824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.992114:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671357824:12345-0@lo:400:kworker.0 Request processed in 42us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774925.992120:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1785774925.992131:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1785774925.992137:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671358336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.992194:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671358336:12345-0@lo:400:kworker.0 Request processed in 57us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774925.992201:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1785774925.992232:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671358080:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.992242:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671358592:0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.992263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357312 00000100:00100000:3.0:1785774925.992266:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357312 00000100:00100000:3.0:1785774925.992290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1785774925.992296:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671357312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774925.992326:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671357312:12345-0@lo:400:kworker.0 Request processed in 30us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774925.992333:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1785774925.992517:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357184 00000100:00100000:1.0:1785774925.992522:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357184 00000100:00100000:1.0:1785774925.992553:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671357696 00000100:00100000:1.0:1785774925.992556:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671357696 00000100:00100000:1.0:1785774925.992577:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:1.0:1785774925.992583:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671357184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774925.992609:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774925.992656:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671357184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774925.992662:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00100000:1.0:1785774925.992675:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:1.0:1785774925.992681:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671357696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774925.992706:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671357696:12345-0@lo:400:kworker.0 Request processed in 26us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774925.992712:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00080000:1.0:1785774925.992762:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774925.992766:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774925.992768:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774925.992770:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774925.994002:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671357312:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.994018:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671357824:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.994028:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671358336:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.994037:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671357696:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.994046:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671358208:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.994056:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671358720:0@lo:400:kworker.0 00000100:00100000:2.0:1785774925.994198:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671357184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774926.080255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774926.080341:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648636928 00000100:00100000:2.0:1785774926.080350:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648636928 00002000:00100000:2.0:1785774926.080411:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->7659519) req@ffff9b76045a9c00 x1872519648636928/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:617/0 lens 488/0 e 0 to 0 dl 1785774937 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774926.080422:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76045a9c00 with x1872519648636928 ext(4194304->7659519) 00002000:00010000:2.0:1785774926.080428:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76045a9c00 00000100:00100000:2.0:1785774926.080456:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 35 00000100:00100000:2.0:1785774926.080464:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648636928:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:1.0:1785774926.082428:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774926.192056:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648636928:12345-192.168.202.31@tcp:4:dd.0 Request processed in 111581us (111798us total) trans 4294969969 rc 0/0 00000100:00100000:3.0:1785774926.192082:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 35 00002000:00100000:3.0:1785774926.192259:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->7659519) req@ffff9b76045a9c00 x1872519648636928/t4294969969(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:617/0 lens 488/448 e 0 to 0 dl 1785774937 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774926.192270:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76045a9c00 with x1872519648636928 ext(4194304->7659519) 00002000:00010000:3.0:1785774926.192277:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76045a9c00 00000001:00080000:2.0:1785774926.195455:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969969 is committed 00000100:00100000:1.0:1785774926.475553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774926.475603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774926.475656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774926.475696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774926.475828:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648637056 00000100:00100000:0.0:1785774926.475838:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648637056 00000100:00100000:0.0:1785774926.475898:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 599 00000100:00100000:0.0:1785774926.475908:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648637056:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774926.475977:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648637056:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 70us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774926.475998:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 599 00000100:00100000:3.0:1785774926.478224:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648637184 00000100:00100000:3.0:1785774926.478237:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648637184 00000100:00100000:3.0:1785774926.478289:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648637312 00000100:00100000:3.0:1785774926.478293:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648637312 00000100:00100000:3.0:1785774926.478332:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1191 00000100:00100000:3.0:1785774926.478342:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2419:x1872519648637184:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774926.478405:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2419:x1872519648637184:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 64us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774926.478413:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1191 00000100:00100000:3.0:1785774926.478429:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1192 00000100:00100000:3.0:1785774926.478435:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648637312:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774926.478462:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648637312:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774926.478467:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1192 00000100:00080000:3.0:1785774926.478488:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774926.478614:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648637440 00000100:00100000:2.0:1785774926.478619:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648637440 00000100:00100000:2.0:1785774926.478678:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 738 00000100:00100000:2.0:1785774926.478685:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648637440:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774926.478712:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648637440:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774926.478719:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 738 00000100:00080000:3.0:1785774926.483561:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785774926.628453:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774926.808650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774926.808792:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648637568 00000100:00100000:2.0:1785774926.808803:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648637568 00000100:00100000:2.0:1785774926.808883:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24130 00000100:00100000:2.0:1785774926.808892:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20934:x1872519648637568:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774926.808916:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774926.808937:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5c1 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774926.809020:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1b29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774926.809038:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774926.809052:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774926.809105:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774926.809110:0:21784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774926.809135:0:21784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774926.809200:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5c1 expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774926.809223:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1b29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5c1 expref: 16 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774926.809244:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774926.809247:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774926.809251:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745000, rc 0) 00000100:00100000:2.0:1785774926.809469:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20934:x1872519648637568:12345-192.168.202.31@tcp:101:dd.0 Request processed in 576us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774926.809477:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24130 00000100:00100000:1.0:1785774926.822302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774926.822527:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648637824 00000100:00100000:3.0:1785774926.822540:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648637824 00000100:00100000:3.0:1785774926.822616:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24131 00000100:00100000:3.0:1785774926.822628:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20934:x1872519648637824:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774926.822664:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774926.822667:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785774926.822700:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1b29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5c1 expref: 16 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.822722:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774926.822727:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774926.822742:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1b30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.822898:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.822914:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.822924:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.822939:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.822946:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.822952:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823030:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1b45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823039:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823046:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774926.823056:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 7659520 00010000:00010000:3.0:1785774926.823232:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823240:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823247:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823254:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823261:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774926.823265:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823273:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823283:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774926.823286:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774926.823291:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823298:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823309:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823315:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823321:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823325:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774926.823328:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823334:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823341:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7711ae8f00) 00010000:00010000:3.0:1785774926.823344:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774926.823346:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823352:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823407:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1b30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5c8 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823425:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1b45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5c8 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774926.823433:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774926.823435:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774926.823438:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfe00, rc 0) 00000100:00100000:3.0:1785774926.823517:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20934:x1872519648637824:12345-192.168.202.31@tcp:101:dd.0 Request processed in 892us (1230us total) trans 4294984169 rc 0/0 00000100:00100000:3.0:1785774926.823525:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24131 00000100:00100000:0.0:1785774926.840668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774926.841113:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648638080 00000100:00100000:1.0:1785774926.841127:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648638080 00000100:00100000:1.0:1785774926.841247:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24132 00000100:00100000:1.0:1785774926.841260:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20934:x1872519648638080:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:1.0:1785774926.841336:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774926.841372:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a1b45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5c8 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774926.841395:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:1.0:1785774926.841401:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774926.841607:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774926.841622:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774926.841785:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774926.841847:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984170 00000004:00010000:1.0:1785774926.841870:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000545ded4b reply state 00000000ea2133fa transno 4294984171 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774926.841882:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774926.841889:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:1.0:1785774926.841893:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774926.841896:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774926.842014:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20934:x1872519648638080:12345-192.168.202.31@tcp:36:dd.0 Request processed in 758us (1360us total) trans 4294984171 rc 0/0 00000100:00100000:1.0:1785774926.842023:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24132 00000020:00080000:1.0:1785774926.842028:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774926.846045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774926.847458:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648638208 00000100:00100000:0.0:1785774926.847471:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648638208 00002000:00010000:0.0:1785774926.847525:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:0.0:1785774926.847530:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c99500 with x1872519648638208 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774926.847544:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c99500. 00000100:00100000:0.0:1785774926.847588:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 36 00000100:00100000:0.0:1785774926.847599:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648638208:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:0.0:1785774926.875031:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785774926.875046:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774919 -> 1785774925 00002000:00010000:0.0:1785774926.875049:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1785774926.875051:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774919 -> 1785774925 00002000:00010000:0.0:1785774926.875054:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1785774926.876437:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648638208:12345-192.168.202.31@tcp:10:dd.0 Request processed in 28828us (30394us total) trans 4294969970 rc 0/0 00000100:00100000:0.0:1785774926.876468:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 36 00002000:00010000:0.0:1785774926.876475:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:0.0:1785774926.876479:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c99500 with x1872519648638208 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774926.876489:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c99500. 00000100:00100000:2.0:1785774927.012956:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774927.012998:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671358848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774927.013088:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774927.013437:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358848 00000100:00100000:3.0:1785774927.013447:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358848 00000100:00100000:3.0:1785774927.013523:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1785774927.013535:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671358848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774927.013577:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774927.013638:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671358848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774927.013645:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00080000:1.0:1785774927.013707:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774927.013866:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774927.013870:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671358848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774927.013881:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671358976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774927.013915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774927.014033:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671358976 00000100:00100000:2.0:1785774927.014038:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671358976 00000100:00100000:2.0:1785774927.014076:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1785774927.014083:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671358976:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785774927.014183:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1785774927.014337:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774927.014379:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671358976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774927.014386:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1785774927.014450:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671358976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785774927.654035:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774928.037179:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774928.037210:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671359104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774928.037319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774928.037585:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671359104 00000100:00100000:2.0:1785774928.037596:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671359104 00000100:00100000:2.0:1785774928.037686:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1785774928.037697:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671359104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774928.037731:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 120080064 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774928.037786:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671359104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774928.037798:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1785774928.037846:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671359104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774928.038106:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774928.038117:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671359232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774928.038152:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774928.038216:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671359232 00000100:00100000:1.0:1785774928.038219:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671359232 00000100:00100000:1.0:1785774928.038267:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:1.0:1785774928.038273:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671359232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774928.038414:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774928.038449:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671359232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774928.038455:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:1.0:1785774928.038484:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671359232:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1785774928.039530:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774928.554624:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774928.554657:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671359360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774928.554891:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774928.555087:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671359360 00000100:00100000:2.0:1785774928.555098:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671359360 00000100:00100000:2.0:1785774928.555490:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1785774928.555501:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671359360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774928.555528:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 120080064 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774928.555584:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671359360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (693us total) trans 0 rc 0/0 00000100:00080000:0.0:1785774928.555891:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774928.556392:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1785774928.568526:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671359360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785774928.686768:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774929.705637:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774930.725606:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774931.018797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774931.018970:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648638336 00000100:00100000:3.0:1785774931.018989:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648638336 00002000:00100000:3.0:1785774931.019108:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b7605c98000 x1872519648638336/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1785774942 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774931.019123:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c98000 with x1872519648638336 ext(0->4194303) 00002000:00010000:3.0:1785774931.019133:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c98000 00000100:00100000:3.0:1785774931.019244:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 37 00000100:00100000:3.0:1785774931.019259:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648638336:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:0.0:1785774931.019778:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774931.110042:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671359616:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.110133:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671359872:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.110140:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774931.110272:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671359488:0@lo:400:kworker.0 00000100:00100000:3.0:1785774931.110373:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671359744:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.120368:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774931.120472:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671360384:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.120523:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774931.120554:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671360896:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.120574:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774931.120637:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671359616 00000100:00100000:2.0:1785774931.120647:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671359616 00000100:00100000:2.0:1785774931.120710:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671359872 00000100:00100000:2.0:1785774931.120713:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671359872 00000100:00100000:2.0:1785774931.120734:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1785774931.120743:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671359616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.120803:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671359616:12345-0@lo:400:kworker.0 Request processed in 61us (10667us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.121803:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671359616:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.121835:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671360128:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.121872:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774931.121915:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671360640:0@lo:400:kworker.0 00000100:00100000:0.0:1785774931.121937:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360384 00000100:00100000:0.0:1785774931.121952:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360384 00000100:00100000:1.0:1785774931.121957:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774931.121979:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671361152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774931.122009:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360896 00000100:00100000:0.0:1785774931.122013:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360896 00000100:00100000:1.0:1785774931.122014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774931.122050:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1785774931.122060:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360128 00000100:00100000:0.0:1785774931.122061:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671360384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122067:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360128 00000100:00100000:1.0:1785774931.122094:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360640 00000100:00100000:1.0:1785774931.122097:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360640 00000100:00100000:1.0:1785774931.122120:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1785774931.122125:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671360384:12345-0@lo:400:kworker.0 Request processed in 65us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122133:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671359872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774931.122139:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1785774931.122181:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1785774931.122188:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671360896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122199:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671359872:12345-0@lo:400:kworker.0 Request processed in 68us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122207:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1785774931.122224:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671360896:12345-0@lo:400:kworker.0 Request processed in 36us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122228:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1785774931.122236:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1785774931.122241:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671360128:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785774931.122257:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774931.122264:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774931.122267:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774931.122284:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671360128:12345-0@lo:400:kworker.0 Request processed in 45us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122292:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1785774931.122305:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1785774931.122311:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671360640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122341:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671360640:12345-0@lo:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122350:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1785774931.122369:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361152 00000100:00100000:1.0:1785774931.122372:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361152 00000100:00100000:1.0:1785774931.122400:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1785774931.122405:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671361152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774931.122434:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774931.122465:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671361152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122471:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1785774931.122506:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671360128:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122516:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671360640:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122530:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671361152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774931.122586:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774931.122618:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671360000:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122640:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774931.122676:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360000 00000100:00100000:1.0:1785774931.122680:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360000 00000100:00100000:1.0:1785774931.122705:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1785774931.122711:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671360000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122743:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671360000:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122750:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1785774931.122777:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671360000:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122785:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671360512:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122810:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774931.122832:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360512 00000100:00100000:1.0:1785774931.122835:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360512 00000100:00100000:1.0:1785774931.122865:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1785774931.122871:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671360512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122900:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671360512:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.122907:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1785774931.122934:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671360512:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122954:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671361024:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.122978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774931.123000:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361024 00000100:00100000:1.0:1785774931.123004:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361024 00000100:00100000:1.0:1785774931.123031:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1785774931.123037:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671361024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.123067:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671361024:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.123073:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1785774931.123100:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671361024:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.123149:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671359488 00000100:00100000:1.0:1785774931.123152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671359488 00000100:00100000:1.0:1785774931.123204:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1785774931.123210:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671359488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.123246:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671359488:12345-0@lo:400:kworker.0 Request processed in 36us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.123256:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1785774931.123288:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671359488:0@lo:400:kworker.0 00000100:00080000:1.0:1785774931.123309:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774931.123312:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774931.123362:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671359872:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.123376:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671360384:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.123390:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671360896:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.124667:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1785774931.124738:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774931.124782:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671360256:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.130191:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774931.130279:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360256 00000100:00100000:2.0:1785774931.130348:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360256 00000100:00100000:2.0:1785774931.130431:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1785774931.130444:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671360256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.130511:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671360256:12345-0@lo:400:kworker.0 Request processed in 71us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774931.130518:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00080000:2.0:1785774931.130547:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774931.130590:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671360256:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.130605:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671360768:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.130637:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774931.130662:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671360768 00000100:00100000:2.0:1785774931.130666:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671360768 00000100:00100000:2.0:1785774931.130699:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1785774931.130705:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671360768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.130737:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671360768:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774931.130743:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00080000:2.0:1785774931.130760:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774931.130775:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671360768:0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.133302:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671359744 00000100:00100000:1.0:1785774931.133315:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671359744 00000100:00100000:1.0:1785774931.133391:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:1.0:1785774931.133405:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671359744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774931.133497:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671359744:12345-0@lo:400:kworker.0 Request processed in 96us (8757us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774931.133505:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:2.0:1785774931.140319:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671359744:0@lo:400:kworker.0 00000100:00100000:2.0:1785774931.201045:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648638336:12345-192.168.202.31@tcp:4:dd.0 Request processed in 181779us (182257us total) trans 4294969971 rc 0/0 00000100:00100000:2.0:1785774931.201061:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 37 00002000:00100000:2.0:1785774931.201075:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b7605c98000 x1872519648638336/t4294969971(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:622/0 lens 488/448 e 0 to 0 dl 1785774942 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774931.201084:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c98000 with x1872519648638336 ext(0->4194303) 00002000:00010000:2.0:1785774931.201091:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c98000 00000100:00100000:1.0:1785774931.591613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774931.591765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774931.591874:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648638592 00000100:00100000:3.0:1785774931.591885:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648638592 00000100:00100000:3.0:1785774931.591986:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1199 00000100:00100000:3.0:1785774931.591998:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648638592:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774931.592097:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648638592:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 101us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774931.592106:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1199 00000100:00080000:0.0:1785774931.592359:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774931.594863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774931.594907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774931.595073:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648638720 00000100:00100000:0.0:1785774931.595084:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648638720 00000100:00100000:0.0:1785774931.595194:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1200 00000100:00100000:0.0:1785774931.595205:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648638720:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774931.595285:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648638720:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 82us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774931.595294:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1200 00000100:00100000:3.0:1785774931.597251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648638464 00000100:00100000:3.0:1785774931.597263:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648638464 00000100:00080000:1.0:1785774931.597328:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774931.597779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 601 00000100:00100000:3.0:1785774931.597789:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648638464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774931.597957:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648638464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 169us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774931.597966:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 601 00000100:00100000:2.0:1785774931.601821:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648638848 00000100:00100000:2.0:1785774931.601839:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648638848 00000100:00100000:2.0:1785774931.601953:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 743 00000100:00100000:2.0:1785774931.601965:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648638848:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774931.602049:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648638848:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (10284us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774931.602057:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 743 00000100:00080000:1.0:1785774931.602209:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785774931.751736:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774931.850848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774931.851199:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648639104 00000100:00100000:2.0:1785774931.851212:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648639104 00000100:00100000:2.0:1785774931.851285:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5233 00000100:00100000:2.0:1785774931.851297:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20934:x1872519648639104:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:2.0:1785774931.851612:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984172 00000100:00100000:2.0:1785774931.852340:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:20934:x1872519648639104:12345-192.168.202.31@tcp:35:dd.0 Request processed in 1041us (1502us total) trans 4294984173 rc 0/0 00000100:00100000:2.0:1785774931.852351:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5233 00000020:00080000:2.0:1785774931.852357:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1785774931.859364:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984173 is committed 00010000:00010000:0.0:1785774931.859451:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774931.859467:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774931.859476:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774931.859483:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774931.859489:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774931.859499:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774931.859519:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774931.859523:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774931.859529:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774931.859536:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1b53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774932.132941:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774932.132974:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671361280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774932.133078:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774932.133575:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361280 00000100:00100000:3.0:1785774932.133587:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361280 00000100:00100000:3.0:1785774932.133713:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1785774932.133722:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774932.133724:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671361280:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774932.133732:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671361408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774932.133767:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774932.133792:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361408 00000100:00100000:2.0:1785774932.133796:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361408 00000100:00100000:2.0:1785774932.133817:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1785774932.133824:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671361408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785774932.133847:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00002000:00000024:2.0:1785774932.133847:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774932.133890:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671361408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774932.133897:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1785774932.133961:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671361408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774932.142414:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671361280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8677us (9321us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774932.142441:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1785774932.164726:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671361280:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1785774932.772989:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774932.869419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774932.869543:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648639232 00000100:00100000:1.0:1785774932.869554:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648639232 00000100:00100000:1.0:1785774932.869863:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24133 00000100:00100000:1.0:1785774932.869879:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20938:x1872519648639232:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774932.869908:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774932.869939:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a1b5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5cf expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774932.870070:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1b61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774932.870084:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774932.870095:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774932.870143:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:1.0:1785774932.870146:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1785774932.870197:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774932.870222:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8400/0x7b7109e1d0a1b5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5cf expref: 17 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774932.870244:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1b61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5cf expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774932.870257:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774932.870261:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774932.870264:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9800, rc 0) 00000100:00100000:1.0:1785774932.870389:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20938:x1872519648639232:12345-192.168.202.31@tcp:101:dd.0 Request processed in 516us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774932.870397:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24133 00000100:00100000:0.0:1785774932.903507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774932.903661:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648639488 00000100:00100000:3.0:1785774932.903675:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648639488 00000100:00100000:3.0:1785774932.903854:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24134 00000100:00100000:3.0:1785774932.903867:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20938:x1872519648639488:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774932.903895:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774932.903898:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785774932.903945:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1b61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5cf expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.903977:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774932.903983:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774932.903999:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1b68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904140:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904156:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904350:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904366:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904373:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904378:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904816:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1b7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904828:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904836:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774932.904847:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 5144576 00010000:00010000:3.0:1785774932.904963:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904973:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904981:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904989:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.904995:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774932.905000:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905008:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905017:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774932.905021:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774932.905025:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905032:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1b6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905043:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905050:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905056:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905062:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774932.905065:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905071:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905078:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7711ae8d00) 00010000:00010000:3.0:1785774932.905080:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774932.905083:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905089:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1b76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905144:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1b68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5d6 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905197:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1b7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5d6 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774932.905212:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:3.0:1785774932.905214:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774932.905217:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:3.0:1785774932.905860:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20938:x1872519648639488:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1994us (2364us total) trans 4294984174 rc 0/0 00000100:00100000:3.0:1785774932.905870:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24134 00000100:00100000:2.0:1785774932.931343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774932.931469:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648639744 00000100:00100000:0.0:1785774932.931480:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648639744 00000100:00100000:0.0:1785774932.931553:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24135 00000100:00100000:0.0:1785774932.931564:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20938:x1872519648639744:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:0.0:1785774932.931647:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774932.931682:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf200/0x7b7109e1d0a1b7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5d6 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774932.931713:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774932.931719:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774932.931940:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774932.931957:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774932.931969:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774932.932014:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984175 00000004:00010000:0.0:1785774932.932035:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fb15af1 reply state 000000008da03e8a transno 4294984176 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774932.932049:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774932.932056:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774932.932059:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774932.932062:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774932.932245:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20938:x1872519648639744:12345-192.168.202.31@tcp:36:dd.0 Request processed in 681us (913us total) trans 4294984176 rc 0/0 00000100:00100000:0.0:1785774932.932254:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24135 00000020:00080000:0.0:1785774932.932260:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774933.008054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774933.008467:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648639872 00000100:00100000:2.0:1785774933.008483:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648639872 00002000:00010000:2.0:1785774933.008555:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1785774933.008562:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712680 with x1872519648639872 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774933.008577:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b771f712680. 00000100:00100000:2.0:1785774933.008615:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 38 00000100:00100000:2.0:1785774933.008636:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648639872:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:2.0:1785774933.011710:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774933.011719:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774925 -> 1785774931 00002000:00010000:2.0:1785774933.011723:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774933.011726:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774925 -> 1785774931 00002000:00010000:2.0:1785774933.011728:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774933.011821:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2418:x1872519648639872:12345-192.168.202.31@tcp:10:dd.0 Request processed in 3192us (3771us total) trans 4294969972 rc 0/0 00000100:00100000:2.0:1785774933.011834:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 38 00002000:00010000:2.0:1785774933.011840:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1785774933.011844:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712680 with x1872519648639872 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774933.011865:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b771f712680. 00000100:00080000:1.0:1785774933.013353:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1785774933.019555:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969972 is committed 00000100:00100000:3.0:1785774933.156443:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671361536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774933.156522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774933.156660:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361536 00000100:00100000:1.0:1785774933.156669:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361536 00000100:00100000:1.0:1785774933.156723:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1785774933.156733:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671361536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774933.156768:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774933.156840:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671361536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774933.156848:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1785774933.156892:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671361536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774933.159240:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671361664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774933.159329:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774933.162294:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361664 00000100:00100000:3.0:1785774933.162308:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361664 00000100:00100000:3.0:1785774933.162374:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1785774933.162383:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671361664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1785774933.162415:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 147456 granted 124298944 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774933.162484:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671361664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (3156us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774933.162491:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1785774933.162543:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671361664:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1785774933.162771:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774933.669378:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774933.669479:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774933.670054:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361792 00000100:00100000:2.0:1785774933.670066:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361792 00000100:00100000:2.0:1785774933.670158:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1785774933.670197:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671361792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774933.670228:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 147456 granted 124298944 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774933.670291:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671361792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774933.670299:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1785774933.670489:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671361792:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1785774933.670550:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785774933.796546:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774934.821386:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774935.844536:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774936.228591:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671362176:0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.228670:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774936.228723:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671362688:0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.228746:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774936.228770:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671363200:0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.228792:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774936.228812:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1785774936.228817:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671362048:0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.228835:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774936.228850:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671362560:0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.228869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774936.228884:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671363072:0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.228916:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774936.229077:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362688 00000100:00100000:3.0:1785774936.229084:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362688 00000100:00100000:3.0:1785774936.229133:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363200 00000100:00100000:3.0:1785774936.229135:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363200 00000100:00100000:3.0:1785774936.229148:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362048 00000100:00100000:3.0:1785774936.229150:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362048 00000100:00100000:3.0:1785774936.229182:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362560 00000100:00100000:3.0:1785774936.229185:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362560 00000100:00100000:3.0:1785774936.229198:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363072 00000100:00100000:3.0:1785774936.229200:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363072 00000100:00100000:3.0:1785774936.229215:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1785774936.229223:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671362688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.229275:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671362688:12345-0@lo:400:kworker.0 Request processed in 52us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774936.229282:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1785774936.229299:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1785774936.229305:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671363200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.229331:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671363200:12345-0@lo:400:kworker.0 Request processed in 27us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774936.229340:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1785774936.229351:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1785774936.229356:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671362048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.229379:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671362048:12345-0@lo:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774936.229385:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1785774936.229395:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1785774936.229400:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671362560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.229490:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362176 00000100:00100000:2.0:1785774936.229495:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362176 00000100:00100000:2.0:1785774936.229525:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:2.0:1785774936.229532:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671362176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.229563:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671362176:12345-0@lo:400:kworker.0 Request processed in 32us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774936.229568:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00100000:2.0:1785774936.229603:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1785774936.229609:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671363072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.229633:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671363072:12345-0@lo:400:kworker.0 Request processed in 25us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774936.229639:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00080000:2.0:1785774936.229687:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785774936.229691:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774936.229721:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671362048:0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.229732:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671363072:0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.229740:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671362176:0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.229748:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671362688:0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.229756:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671363200:0@lo:400:kworker.0 00000100:00100000:3.0:1785774936.229898:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671362560:12345-0@lo:400:kworker.0 Request processed in 488us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774936.229906:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1785774936.230068:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671362304:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230099:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774936.230123:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671362816:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774936.230181:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671363328:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230202:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774936.230222:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1785774936.230227:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671361920:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230252:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774936.230271:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671362432:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230291:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774936.230305:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671362944:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230324:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774936.230340:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671363456:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230357:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774936.230380:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362816 00000100:00100000:0.0:1785774936.230384:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362816 00000100:00100000:0.0:1785774936.230424:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363328 00000100:00100000:0.0:1785774936.230427:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363328 00000100:00100000:0.0:1785774936.230442:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362944 00000100:00100000:0.0:1785774936.230444:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362944 00000100:00100000:0.0:1785774936.230456:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363456 00000100:00100000:0.0:1785774936.230459:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363456 00000100:00100000:0.0:1785774936.230473:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1785774936.230478:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671362816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230512:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671362816:12345-0@lo:400:kworker.0 Request processed in 33us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774936.230518:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1785774936.230531:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1785774936.230537:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671363328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230558:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671363328:12345-0@lo:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774936.230564:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1785774936.230574:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1785774936.230579:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671362944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230601:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671362944:12345-0@lo:400:kworker.0 Request processed in 22us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774936.230606:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1785774936.230615:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1785774936.230620:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671363456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230641:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671363456:12345-0@lo:400:kworker.0 Request processed in 21us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774936.230658:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00080000:0.0:1785774936.230680:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774936.230683:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774936.230689:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362304 00000100:00100000:0.0:1785774936.230692:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362304 00000100:00100000:0.0:1785774936.230713:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1785774936.230718:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671362304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230746:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671362304:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774936.230755:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1785774936.230779:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671362944:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230787:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671363456:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230794:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671362304:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230802:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671362816:0@lo:400:kworker.0 00000100:00100000:0.0:1785774936.230809:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671363328:0@lo:400:kworker.0 00000100:00100000:1.0:1785774936.230974:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671361920 00000100:00100000:1.0:1785774936.230979:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671361920 00000100:00100000:1.0:1785774936.231006:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1785774936.231013:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671361920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774936.231050:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3655:x1872519671361920:12345-0@lo:400:kworker.0 Request processed in 38us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774936.231057:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1785774936.231087:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671362432 00000100:00100000:2.0:1785774936.231091:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671362560:0@lo:400:kworker.0 00000100:00100000:1.0:1785774936.231092:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671362432 00000100:00100000:1.0:1785774936.231118:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:1.0:1785774936.231124:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671362432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774936.231155:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671362432:12345-0@lo:400:kworker.0 Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774936.231180:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1785774936.231187:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed609441-cebf-42ae-a19c-5d7643dc37b0:3655:1872519671361920:0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.231200:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671362432:0@lo:400:kworker.0 00000100:00100000:2.0:1785774936.237511:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671363584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774936.237852:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774936.238121:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363584 00000100:00100000:1.0:1785774936.238131:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363584 00000100:00100000:1.0:1785774936.238209:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:1.0:1785774936.238217:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671363584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774936.238254:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774936.238300:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671363584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774936.238306:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:2.0:1785774936.239066:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671363584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774936.396040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774936.396151:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648640000 00000100:00100000:2.0:1785774936.396193:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648640000 00002000:00100000:2.0:1785774936.396264:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b76044bce00 x1872519648640000/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:627/0 lens 488/0 e 0 to 0 dl 1785774947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774936.396275:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bce00 with x1872519648640000 ext(0->4194303) 00002000:00010000:2.0:1785774936.396280:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76044bce00 00000100:00100000:2.0:1785774936.396321:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 39 00000100:00100000:2.0:1785774936.396331:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648640000:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:0.0:1785774936.397252:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774936.530994:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648640000:12345-192.168.202.31@tcp:4:dd.0 Request processed in 134644us (134943us total) trans 4294969973 rc 0/0 00000100:00100000:1.0:1785774936.531013:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 39 00002000:00100000:1.0:1785774936.531030:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b76044bce00 x1872519648640000/t4294969973(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:627/0 lens 488/448 e 0 to 0 dl 1785774947 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774936.531041:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bce00 with x1872519648640000 ext(0->4194303) 00002000:00010000:1.0:1785774936.531049:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76044bce00 00000100:00100000:0.0:1785774936.714497:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774936.714554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774936.714583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774936.714655:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648640128 00000100:00100000:1.0:1785774936.714669:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648640128 00000100:00100000:0.0:1785774936.714708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774936.714728:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 603 00000100:00100000:1.0:1785774936.714738:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648640128:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774936.714739:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648640512 00000100:00100000:0.0:1785774936.714742:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648640512 00000100:00100000:0.0:1785774936.714787:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 748 00000100:00100000:0.0:1785774936.714793:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648640512:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774936.714829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648640128:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774936.714833:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648640512:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774936.714838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 603 00000100:00100000:0.0:1785774936.714839:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 748 00000100:00080000:0.0:1785774936.714862:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774936.714913:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648640384 00000100:00100000:1.0:1785774936.714918:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648640384 00000100:00100000:1.0:1785774936.714957:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648640256 00000100:00100000:1.0:1785774936.714961:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648640256 00000100:00100000:1.0:1785774936.714984:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1207 00000100:00100000:1.0:1785774936.714991:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648640384:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774936.715023:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648640384:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774936.715028:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1208 00000100:00100000:1.0:1785774936.715038:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1207 00000100:00100000:3.0:1785774936.715044:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648640256:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774936.715089:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648640256:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 51us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774936.715095:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1208 00000100:00080000:0.0:1785774936.731139:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774936.731154:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1785774936.868641:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774937.254088:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671363712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774937.254195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774937.254997:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363712 00000100:00100000:2.0:1785774937.255006:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363712 00000100:00100000:2.0:1785774937.255065:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1785774937.255075:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671363712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774937.255106:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774937.255184:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671363712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774937.255191:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1785774937.255330:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671363712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774937.255476:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774937.255486:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671363840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774937.255518:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774937.255817:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363840 00000100:00100000:3.0:1785774937.255822:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363840 00000100:00100000:3.0:1785774937.255860:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1785774937.255867:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671363840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774937.255878:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774937.255948:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671363840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774937.255966:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1785774937.255997:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671363840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774937.886014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774937.886100:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648640768 00000100:00100000:3.0:1785774937.886111:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648640768 00000100:00100000:3.0:1785774937.886208:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5234 00000100:00100000:3.0:1785774937.886219:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:20938:x1872519648640768:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:3.0:1785774937.886417:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984177 00000100:00100000:3.0:1785774937.886741:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:20938:x1872519648640768:12345-192.168.202.31@tcp:35:dd.0 Request processed in 523us (736us total) trans 4294984178 rc 0/0 00000100:00100000:3.0:1785774937.886749:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5234 00000020:00080000:3.0:1785774937.886754:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785774937.893046:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774937.983263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774937.984122:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648640896 00000100:00100000:0.0:1785774937.984133:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648640896 00002000:00100000:0.0:1785774937.984210:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff9b76044bd180 x1872519648640896/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:628/0 lens 488/0 e 0 to 0 dl 1785774948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774937.984220:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bd180 with x1872519648640896 ext(4194304->8388607) 00002000:00010000:0.0:1785774937.984226:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76044bd180 00000100:00100000:0.0:1785774937.984263:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 40 00000100:00100000:0.0:1785774937.984272:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648640896:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774938.146221:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648640896:12345-192.168.202.31@tcp:4:dd.0 Request processed in 161939us (162957us total) trans 4294969974 rc 0/0 00000100:00100000:0.0:1785774938.146236:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 40 00002000:00100000:0.0:1785774938.146250:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff9b76044bd180 x1872519648640896/t4294969974(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:628/0 lens 488/448 e 0 to 0 dl 1785774948 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774938.146261:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bd180 with x1872519648640896 ext(4194304->8388607) 00002000:00010000:0.0:1785774938.146268:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76044bd180 00000100:00100000:0.0:1785774938.276748:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774938.276773:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671363968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774938.276848:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774938.277106:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671363968 00000100:00100000:1.0:1785774938.277114:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671363968 00000100:00100000:1.0:1785774938.277183:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1785774938.277194:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671363968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774938.277222:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 327680 granted 140199616 pending 8437760 free 3915137024 avail 3683614720 00000100:00100000:1.0:1785774938.277270:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671363968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774938.277278:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1785774938.277332:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671363968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774938.277426:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774938.277436:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671364096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774938.277468:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774938.277502:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364096 00000100:00100000:2.0:1785774938.277506:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364096 00000100:00100000:2.0:1785774938.277548:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1785774938.277556:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671364096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774938.277579:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774938.277615:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671364096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774938.277621:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1785774938.277653:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671364096:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1785774938.278097:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774938.788780:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785774938.788805:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671364224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774938.788888:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774938.789356:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364224 00000100:00100000:2.0:1785774938.789365:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364224 00000100:00100000:2.0:1785774938.789435:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1785774938.789444:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671364224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774938.789469:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 327680 granted 140199616 pending 8437760 free 3915137024 avail 3683614720 00000100:00100000:3.0:1785774938.789728:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671364224:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785774938.789786:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774938.789813:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671364224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774938.789822:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00010000:00010000:2.0:1785774938.917033:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774938.920816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774938.921368:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648641024 00000100:00100000:0.0:1785774938.921378:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648641024 00000100:00100000:0.0:1785774938.921466:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24136 00000100:00100000:0.0:1785774938.921477:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:20942:x1872519648641024:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774938.921504:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774938.921534:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1b92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5dd expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774938.921604:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1b99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774938.921619:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774938.921630:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774938.921673:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:0.0:1785774938.921676:0:21784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774938.921696:0:21784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774938.921719:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5dd expref: 23 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774938.921737:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1b99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5dd expref: 22 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774938.921747:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774938.921750:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774938.921753:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c400, rc 0) 00000100:00100000:0.0:1785774938.921817:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:20942:x1872519648641024:12345-192.168.202.31@tcp:101:dd.0 Request processed in 342us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774938.921824:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24136 00000100:00080000:2.0:1785774938.922556:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774938.929273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774938.929484:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648641280 00000100:00100000:2.0:1785774938.929494:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648641280 00000100:00100000:2.0:1785774938.929558:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24137 00000100:00100000:2.0:1785774938.929568:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:20942:x1872519648641280:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774938.929590:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774938.929593:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785774938.929620:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1b99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5dd expref: 22 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929639:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774938.929645:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774938.929657:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1ba0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5e4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929782:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929795:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929805:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929823:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929831:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929837:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929901:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929910:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.929918:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774938.929927:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 8691712 00010000:00010000:2.0:1785774938.930016:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930023:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930028:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930034:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930039:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774938.930044:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930051:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930059:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774938.930062:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774938.930065:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930071:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930080:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930085:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930091:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930096:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774938.930099:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930105:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930113:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7604f39800) 00010000:00010000:2.0:1785774938.930115:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774938.930119:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930124:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930194:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1ba0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5e4 expref: 24 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930208:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5e4 expref: 23 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.930216:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774938.930218:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774938.930220:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745000, rc 0) 00000100:00100000:2.0:1785774938.930282:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:20942:x1872519648641280:12345-192.168.202.31@tcp:101:dd.0 Request processed in 715us (1017us total) trans 4294984179 rc 0/0 00000100:00100000:2.0:1785774938.930289:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24137 00000001:00080000:0.0:1785774938.939711:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984179 is committed 00010000:00010000:2.0:1785774938.939908:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.939933:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.939942:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.939949:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774938.939956:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.939970:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.940002:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774938.940006:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774938.940013:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.940019:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1b8b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774938.951365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774938.951430:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648641536 00000100:00100000:2.0:1785774938.951446:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648641536 00000100:00100000:2.0:1785774938.951534:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24138 00000100:00100000:2.0:1785774938.951546:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20942:x1872519648641536:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:2.0:1785774938.951617:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774938.951908:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5e4 expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.951932:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774938.951937:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774938.952234:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.952252:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.952263:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774938.952311:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984180 00000004:00010000:2.0:1785774938.952333:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003337a5f reply state 00000000fd84c410 transno 4294984181 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.952346:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774938.952353:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774938.952356:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774938.952359:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774938.952463:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20942:x1872519648641536:12345-192.168.202.31@tcp:36:dd.0 Request processed in 920us (1106us total) trans 4294984181 rc 0/0 00000100:00100000:2.0:1785774938.952471:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24138 00000020:00080000:2.0:1785774938.952476:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774938.992470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774938.992574:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648641664 00000100:00100000:2.0:1785774938.992587:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648641664 00002000:00010000:2.0:1785774938.992670:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1785774938.992675:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76054b3480 with x1872519648641664 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774938.992690:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76054b3480. 00000100:00100000:2.0:1785774938.992730:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 41 00000100:00100000:2.0:1785774938.992741:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648641664:12345-192.168.202.31@tcp:10:dd.0 00000100:00080000:0.0:1785774938.994949:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1785774939.014026:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774939.014037:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1785774931 -> 1785774937 00002000:00010000:2.0:1785774939.014041:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774939.014043:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1785774931 -> 1785774937 00002000:00010000:2.0:1785774939.014046:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774939.014316:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648641664:12345-192.168.202.31@tcp:10:dd.0 Request processed in 21568us (21851us total) trans 4294969975 rc 0/0 00000100:00100000:2.0:1785774939.014331:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 41 00002000:00010000:2.0:1785774939.014338:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1785774939.014342:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76054b3480 with x1872519648641664 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774939.014350:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b76054b3480. 00010000:00010000:3.0:1785774939.943032:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785774940.964405:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774941.349836:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671364608:0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.349918:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774941.349976:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671365120:0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.350003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774941.350024:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671365632:0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.350044:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774941.350067:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1785774941.350072:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671364736:0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.350093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774941.350109:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671365248:0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.350130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774941.350145:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671365760:0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.350177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774941.350203:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364608 00000100:00100000:2.0:1785774941.350209:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364608 00000100:00100000:2.0:1785774941.350252:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:2.0:1785774941.350261:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671364608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.350310:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671364608:12345-0@lo:400:kworker.0 Request processed in 51us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774941.350318:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:2.0:1785774941.350338:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671365120 00000100:00100000:2.0:1785774941.350342:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671365120 00000100:00100000:2.0:1785774941.350367:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671365632 00000100:00100000:2.0:1785774941.350368:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671365632 00000100:00100000:2.0:1785774941.350380:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364736 00000100:00100000:2.0:1785774941.350382:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364736 00000100:00100000:2.0:1785774941.350398:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1785774941.350403:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671365120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.350429:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671365120:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774941.350435:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1785774941.350575:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671364480:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350604:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774941.350617:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671364992:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350638:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774941.350653:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671365504:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350670:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774941.350681:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1785774941.350685:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671364352:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350707:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774941.350728:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671364864:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350748:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774941.350764:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671365376:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350784:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774941.350798:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671365888:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350817:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774941.350850:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364352 00000100:00100000:3.0:1785774941.350854:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364352 00000100:00100000:3.0:1785774941.350878:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1785774941.350884:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671364352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350916:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671364352:12345-0@lo:400:kworker.0 Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774941.350922:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1785774941.350962:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671364352:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.350999:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671365248 00000100:00100000:3.0:1785774941.351002:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671365248 00000100:00100000:3.0:1785774941.351026:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671365760 00000100:00100000:3.0:1785774941.351029:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671365760 00000100:00100000:3.0:1785774941.351046:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671365376 00000100:00100000:3.0:1785774941.351049:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671365376 00000100:00100000:3.0:1785774941.351065:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671365888 00000100:00100000:3.0:1785774941.351068:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671365888 00000100:00100000:3.0:1785774941.351086:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1785774941.351092:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671365248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.351119:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671365248:12345-0@lo:400:kworker.0 Request processed in 28us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774941.351124:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1785774941.351133:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1785774941.351137:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671365760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.351156:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671365760:12345-0@lo:400:kworker.0 Request processed in 19us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774941.351183:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1785774941.351192:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1785774941.351197:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671365376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.351223:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671365376:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774941.351228:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1785774941.351239:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1785774941.351244:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671365888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.351269:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671365888:12345-0@lo:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774941.351275:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1785774941.351299:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671365376:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.351309:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671365888:0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.351309:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364480 00000100:00100000:1.0:1785774941.351313:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364480 00000100:00100000:3.0:1785774941.351331:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671365248:0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.351332:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364992 00000100:00100000:1.0:1785774941.351334:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364992 00000100:00100000:3.0:1785774941.351339:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671365760:0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.351346:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671365504 00000100:00100000:3.0:1785774941.351348:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671364608:0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.351348:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671365504 00000100:00100000:3.0:1785774941.351357:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671365120:0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.351361:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1785774941.351366:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671365632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.351391:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671364864 00000100:00100000:3.0:1785774941.351394:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671364864 00000100:00100000:3.0:1785774941.351417:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1785774941.351418:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671365632:12345-0@lo:400:kworker.0 Request processed in 51us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774941.351423:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671364864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.351424:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1785774941.351434:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1785774941.351439:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671364736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774941.351542:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:0.0:1785774941.351550:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671364480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.351656:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1785774941.351663:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671364992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.366724:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671364736:12345-0@lo:400:kworker.0 Request processed in 15264us (16609us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774941.366739:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1785774941.367289:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1785774941.367304:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671365504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.367360:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671365504:12345-0@lo:400:kworker.0 Request processed in 63us (16688us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774941.367370:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1785774941.367445:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671364736:0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.367459:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671365632:0@lo:400:kworker.0 00000100:00080000:1.0:1785774941.369882:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774941.369891:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774941.369894:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774941.369896:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774941.370623:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671366016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774941.370692:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774941.370757:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671365504:0@lo:400:kworker.0 00000100:00100000:1.0:1785774941.372417:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366016 00000100:00100000:1.0:1785774941.372427:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366016 00000100:00100000:1.0:1785774941.372488:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:1.0:1785774941.376628:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671366016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774941.376674:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774941.378335:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671366016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1719us (7636us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774941.378349:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:1.0:1785774941.379192:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671366016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774941.383219:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671364480:12345-0@lo:400:kworker.0 Request processed in 31660us (32604us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774941.383233:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1785774941.384066:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671364480:0@lo:400:kworker.0 00000100:00100000:3.0:1785774941.398820:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671364864:12345-0@lo:400:kworker.0 Request processed in 47387us (48061us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774941.398836:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1785774941.399134:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671364864:0@lo:400:kworker.0 00000100:00100000:2.0:1785774941.416071:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671364992:12345-0@lo:400:kworker.0 Request processed in 64398us (65421us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774941.416088:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1785774941.416579:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671364992:0@lo:400:kworker.0 00000100:00100000:0.0:1785774941.841752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774941.841804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774941.841886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774941.841959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774941.841998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774941.842066:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648642304 00000100:00100000:0.0:1785774941.842092:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648642304 00000100:00100000:0.0:1785774941.842239:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648642176 00000100:00100000:0.0:1785774941.842243:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648642176 00000100:00100000:0.0:1785774941.842337:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 753 00000100:00100000:0.0:1785774941.842346:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648642304:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774941.842497:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648642304:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 152us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774941.842504:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 753 00000100:00100000:0.0:1785774941.842518:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 754 00000100:00100000:0.0:1785774941.842524:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648642176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774941.842543:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648642176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774941.842548:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 754 00000100:00100000:1.0:1785774941.842781:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648641792 00000100:00100000:1.0:1785774941.842786:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648641792 00000100:00100000:1.0:1785774941.842824:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 605 00000100:00100000:1.0:1785774941.842831:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648641792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774941.842872:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2419:x1872519648641792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774941.842878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 605 00000100:00100000:1.0:1785774941.842919:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648642048 00000100:00100000:1.0:1785774941.842923:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648642048 00000100:00100000:1.0:1785774941.842953:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648641920 00000100:00100000:1.0:1785774941.842956:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648641920 00000100:00100000:1.0:1785774941.842978:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1215 00000100:00100000:1.0:1785774941.842985:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648642048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774941.843013:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648642048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774941.843019:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1215 00000100:00100000:1.0:1785774941.843032:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1216 00000100:00100000:1.0:1785774941.843038:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2419:x1872519648641920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774941.843067:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2419:x1872519648641920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774941.843074:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1216 00000100:00080000:1.0:1785774941.843090:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774941.843094:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774941.843096:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774941.843098:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1785774941.877806:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969975 is committed 00010000:00010000:2.0:1785774941.990140:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774942.373873:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774942.373907:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671366144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774942.374002:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774942.374468:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366144 00000100:00100000:3.0:1785774942.374479:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366144 00000100:00100000:3.0:1785774942.374558:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1785774942.374569:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671366144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774942.374616:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774942.374696:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671366144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774942.374704:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1785774942.374829:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671366144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774942.379504:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671366272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774942.379614:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774942.380286:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366272 00000100:00100000:2.0:1785774942.380297:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366272 00000100:00100000:2.0:1785774942.380358:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1785774942.380367:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671366272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774942.380395:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774942.380469:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671366272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774942.380477:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1785774942.380720:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671366272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785774943.012984:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774943.232699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774943.232889:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648642432 00000100:00100000:2.0:1785774943.232901:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648642432 00002000:00100000:2.0:1785774943.232986:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b760605f800 x1872519648642432/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:634/0 lens 488/0 e 0 to 0 dl 1785774954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774943.232998:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760605f800 with x1872519648642432 ext(0->4194303) 00002000:00010000:2.0:1785774943.233005:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760605f800 00000100:00100000:2.0:1785774943.233043:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 42 00000100:00100000:2.0:1785774943.233054:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648642432:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:1.0:1785774943.233064:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774943.333489:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648642432:12345-192.168.202.31@tcp:4:dd.0 Request processed in 100417us (100792us total) trans 4294969976 rc 0/0 00000100:00100000:2.0:1785774943.333506:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 42 00002000:00100000:2.0:1785774943.333520:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff9b760605f800 x1872519648642432/t4294969976(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:634/0 lens 488/448 e 0 to 0 dl 1785774954 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774943.333531:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760605f800 with x1872519648642432 ext(0->4194303) 00002000:00010000:2.0:1785774943.333538:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760605f800 00000100:00100000:3.0:1785774943.397633:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774943.397659:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671366400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774943.397731:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774943.398083:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366400 00000100:00100000:2.0:1785774943.398091:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366400 00000100:00100000:2.0:1785774943.398152:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:2.0:1785774943.398179:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671366400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774943.398219:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774943.398281:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671366400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774943.398289:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:1.0:1785774943.398994:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774943.399006:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671366528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774943.399044:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774943.400243:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671366400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774943.400971:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366528 00000100:00100000:2.0:1785774943.400980:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366528 00000100:00100000:2.0:1785774943.401054:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1785774943.401074:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671366528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774943.401100:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 139871936 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774943.401191:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671366528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774943.401199:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00080000:1.0:1785774943.401361:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774943.401446:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671366528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774943.911844:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671366656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774943.911926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774943.912110:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366656 00000100:00100000:0.0:1785774943.912119:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366656 00000100:00100000:0.0:1785774943.912230:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1785774943.912239:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671366656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774943.912264:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 139871936 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774943.912311:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671366656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774943.912318:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00080000:2.0:1785774943.912851:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774943.913099:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671366656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785774943.928321:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774943.929553:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648642688 00000100:00100000:3.0:1785774943.929563:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648642688 00000100:00100000:3.0:1785774943.929631:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5235 00000100:00100000:3.0:1785774943.929641:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:20942:x1872519648642688:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:3.0:1785774943.929852:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984182 00000100:00100000:3.0:1785774943.929972:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:20942:x1872519648642688:12345-192.168.202.31@tcp:35:dd.0 Request processed in 332us (1660us total) trans 4294984183 rc 0/0 00000100:00100000:3.0:1785774943.929984:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5235 00000020:00080000:3.0:1785774943.929988:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1785774943.930365:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785774944.036676:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785774944.936098:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984183 is committed 00010000:00010000:0.0:1785774944.936131:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774944.936142:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774944.936148:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774944.936152:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774944.936155:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774944.936177:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774944.936191:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:0.0:1785774944.936193:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774944.936197:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774944.936200:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1bc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774944.938929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774944.939008:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648642816 00000100:00100000:2.0:1785774944.939020:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648642816 00000100:00100000:2.0:1785774944.939151:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24139 00000100:00100000:2.0:1785774944.939181:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20946:x1872519648642816:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774944.939208:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774944.939229:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5eb expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.939292:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1bd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.939307:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.939319:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774944.939362:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774944.939367:0:21784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774944.939470:0:21784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.939496:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5eb expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.939515:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5eb expref: 16 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.939523:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774944.939527:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774944.939530:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:2.0:1785774944.939727:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20946:x1872519648642816:12345-192.168.202.31@tcp:101:rm.0 Request processed in 567us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774944.939735:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24139 00000100:00100000:1.0:1785774944.951606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774944.951714:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648642944 00000100:00100000:2.0:1785774944.951725:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648642944 00000100:00100000:2.0:1785774944.951830:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24140 00000100:00100000:2.0:1785774944.951840:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:20946:x1872519648642944:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774944.951861:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774944.951883:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5f2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.951941:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.951957:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.951967:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.951983:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.951991:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.951998:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952059:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1bed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952067:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952074:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774944.952112:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15a8:0x0]: returning size 5668864 00000004:00200000:2.0:1785774944.952116:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774944.952135:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952146:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952156:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952190:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952197:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952208:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952214:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774944.952233:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952925:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952940:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774944.952943:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774944.952948:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952954:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1bdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952970:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952976:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952981:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952986:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774944.952988:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.952999:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.953007:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7604f39c00) 00010000:00010000:2.0:1785774944.953009:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774944.953013:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.953019:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1be6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.953052:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5f2 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.953066:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1bed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5f2 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.953073:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774944.953075:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774944.953077:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745200, rc 0) 00000100:00100000:2.0:1785774944.953145:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20946:x1872519648642944:12345-192.168.202.31@tcp:101:rm.0 Request processed in 1306us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774944.953153:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24140 00000100:00100000:1.0:1785774944.983779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774944.985918:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648643200 00000100:00100000:2.0:1785774944.985932:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648643200 00000100:00100000:2.0:1785774944.986004:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24141 00000100:00100000:2.0:1785774944.986014:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:20946:x1872519648643200:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1785774944.986071:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1785774944.986099:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1a03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15a8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c574 expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986122:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745200/0x7b7109e1d0a1bed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5f2 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986135:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a19f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c56d expref: 15 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986145:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7711ae8c00) 00010000:00010000:2.0:1785774944.986206:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1bd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5eb expref: 14 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986386:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774944.986392:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774944.986414:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986428:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986438:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986452:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986460:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986467:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986530:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986537:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986543:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785774944.986898:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2553, 64 off171584 00000004:00080000:2.0:1785774944.986908:0:8469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1186837747389ns, next at 1187837745573ns, rc = 0 00010000:00010000:2.0:1785774944.986951:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986961:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986969:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986977:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986984:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.986991:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774944.987935:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774944.988306:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988316:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988324:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988330:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774944.988335:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988343:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988356:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7604f39500) 00010000:00010000:3.0:1785774944.988359:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774944.988363:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988370:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c02 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988392:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988398:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988404:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988410:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988415:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774944.988418:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988424:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988430:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774944.988432:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774944.988435:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988441:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1bf4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774944.988448:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4f93dd1 reply state 0000000033809bd7 transno 4294984184 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988458:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.988465:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7604f39c00) 00010000:00010000:3.0:1785774944.988467:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774944.988470:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774944.988552:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:20946:x1872519648643200:12345-192.168.202.31@tcp:36:rm.0 Request processed in 2538us (4780us total) trans 4294984184 rc 0/0 00000100:00100000:3.0:1785774944.988561:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24141 00010000:00010000:1.0:1785774944.991502:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785774944.991516:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774944.991527:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:1.0:1785774944.991530:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774944.991540:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774944.991556:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9b7604f39500) 00010000:00010000:1.0:1785774944.991559:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785774944.991563:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774944.991569:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c09 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774944.991670:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774944.991681:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774944.991683:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774945.060464:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774946.084873:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774946.468565:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671366912:0@lo:400:kworker.0 00000100:00100000:0.0:1785774946.468567:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671367040:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.468650:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671367168:0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.468733:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671366784:0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.469778:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774946.469852:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671367424:0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.469880:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774946.469984:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671367936:0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.470008:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774946.470033:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671368448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774946.470058:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774946.470094:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366912 00000100:00100000:1.0:1785774946.470101:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366912 00000100:00100000:1.0:1785774946.470144:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367424 00000100:00100000:1.0:1785774946.470147:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367424 00000100:00100000:1.0:1785774946.470191:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367936 00000100:00100000:1.0:1785774946.470194:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367936 00000100:00100000:1.0:1785774946.470216:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1785774946.470223:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671366912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.470275:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671366912:12345-0@lo:400:kworker.0 Request processed in 51us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.470281:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1785774946.470298:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1785774946.470304:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671367424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.470332:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671367424:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.470338:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1785774946.470348:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1785774946.470354:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671367936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.470380:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671367936:12345-0@lo:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.470388:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1785774946.470405:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368448 00000100:00100000:1.0:1785774946.470407:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368448 00000100:00100000:1.0:1785774946.470433:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:1.0:1785774946.470439:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671368448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774946.470466:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774946.470499:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671368448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.470505:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00080000:1.0:1785774946.470525:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774946.470562:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671368448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774946.470574:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671366912:0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.470582:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671367424:0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.470590:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671367936:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.487244:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774946.487320:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671367680:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.487354:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774946.488626:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671368192:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.488675:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774946.488746:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367168 00000100:00100000:3.0:1785774946.488754:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367168 00000100:00100000:3.0:1785774946.488816:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1785774946.488825:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671367168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.488880:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671367168:12345-0@lo:400:kworker.0 Request processed in 57us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774946.491572:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1785774946.491624:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367680 00000100:00100000:3.0:1785774946.491632:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367680 00000100:00100000:1.0:1785774946.492341:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368192 00000100:00100000:1.0:1785774946.492347:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368192 00000100:00100000:3.0:1785774946.492432:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1785774946.492442:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671367680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.493957:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671367680:12345-0@lo:400:kworker.0 Request processed in 1513us (6597us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774946.493967:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1785774946.501633:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774946.501711:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671367552:0@lo:400:kworker.0 00000100:00100000:0.0:1785774946.501754:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774946.501783:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671368064:0@lo:400:kworker.0 00000100:00100000:0.0:1785774946.501813:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774946.501866:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367552 00000100:00100000:0.0:1785774946.501873:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367552 00000100:00100000:2.0:1785774946.503020:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774946.503057:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671367296:0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.503084:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774946.503101:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671367808:0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.503123:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774946.503140:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671368320:0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.503174:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774946.503219:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367040 00000100:00100000:2.0:1785774946.503225:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367040 00000100:00100000:2.0:1785774946.503262:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367296 00000100:00100000:2.0:1785774946.503265:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367296 00000100:00100000:2.0:1785774946.503286:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1785774946.503294:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671367040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.503347:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671367040:12345-0@lo:400:kworker.0 Request processed in 54us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774946.503354:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1785774946.503370:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:2.0:1785774946.503375:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671367296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.503406:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671367296:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774946.503412:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:2.0:1785774946.503429:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671366784 00000100:00100000:2.0:1785774946.503432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671366784 00000100:00100000:2.0:1785774946.503456:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1785774946.503462:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671366784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.503490:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671366784:12345-0@lo:400:kworker.0 Request processed in 28us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774946.503496:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1785774946.503526:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671367808 00000100:00100000:2.0:1785774946.503530:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671367808 00000100:00100000:1.0:1785774946.507206:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368064 00000100:00100000:1.0:1785774946.507218:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368064 00000100:00100000:1.0:1785774946.507286:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1785774946.507310:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671368064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.507395:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671368064:12345-0@lo:400:kworker.0 Request processed in 100us (5580us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.507403:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1785774946.507428:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368320 00000100:00100000:1.0:1785774946.507432:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368320 00000100:00100000:1.0:1785774946.507470:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1785774946.507477:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671368320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.507512:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671368320:12345-0@lo:400:kworker.0 Request processed in 36us (4352us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.507519:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1785774946.507631:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1785774946.507639:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671368192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.507683:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671368192:12345-0@lo:400:kworker.0 Request processed in 45us (19008us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.507690:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1785774946.507752:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671367040:0@lo:400:kworker.0 00000100:00100000:1.0:1785774946.507765:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671368064:0@lo:400:kworker.0 00000100:00080000:3.0:1785774946.517803:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1785774946.517816:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774946.517819:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774946.517886:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671367168:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.523044:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671367680:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.523073:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671368192:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.523145:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671366784:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.523157:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671367296:0@lo:400:kworker.0 00000100:00100000:3.0:1785774946.523188:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671368320:0@lo:400:kworker.0 00000100:00100000:0.0:1785774946.526629:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1785774946.526645:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671367552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774946.526750:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671367552:12345-0@lo:400:kworker.0 Request processed in 110us (24994us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774946.526758:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1785774946.526819:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671367552:0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.527381:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1785774946.527390:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671367808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774946.527443:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671367808:12345-0@lo:400:kworker.0 Request processed in 54us (24319us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774946.527450:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1785774946.527483:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671367808:0@lo:400:kworker.0 00000100:00100000:0.0:1785774946.948572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774946.948613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774946.948647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774946.948665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774946.948754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774946.948927:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648643584 00000100:00100000:1.0:1785774946.948937:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648643584 00000100:00100000:1.0:1785774946.948999:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648643456 00000100:00100000:1.0:1785774946.949003:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648643456 00000100:00100000:1.0:1785774946.949028:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1223 00000100:00100000:1.0:1785774946.949037:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648643584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774946.949112:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648643584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.949119:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1223 00000100:00100000:1.0:1785774946.949136:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1224 00000100:00100000:1.0:1785774946.949143:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648643456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774946.949205:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648643456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 63us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774946.949215:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1224 00000100:00100000:3.0:1785774946.949560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648643328 00000100:00100000:3.0:1785774946.949566:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648643328 00000100:00100000:3.0:1785774946.949600:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 607 00000100:00100000:3.0:1785774946.949607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648643328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774946.949639:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648643328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774946.949645:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 607 00000100:00100000:3.0:1785774946.949670:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648643840 00000100:00100000:3.0:1785774946.949673:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648643840 00000100:00100000:3.0:1785774946.949696:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648643712 00000100:00100000:3.0:1785774946.949698:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648643712 00000100:00100000:3.0:1785774946.949717:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 759 00000100:00100000:3.0:1785774946.949723:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648643840:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774946.949749:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648643840:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774946.949755:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 759 00000100:00100000:3.0:1785774946.949777:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 760 00000100:00100000:3.0:1785774946.949784:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648643712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774946.949817:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648643712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774946.949823:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 760 00000100:00080000:0.0:1785774946.950092:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774946.950097:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774946.950099:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774946.950102:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1785774947.108506:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774947.493599:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785774947.493623:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671368576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774947.493733:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774947.494080:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368576 00000100:00100000:2.0:1785774947.494088:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368576 00000100:00100000:2.0:1785774947.494145:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1785774947.494154:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671368576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785774947.494205:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1785774947.494258:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671368576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774947.494265:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1785774947.494419:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671368576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774947.505581:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774947.505609:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671368704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774947.505710:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774947.505966:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368704 00000100:00100000:1.0:1785774947.505974:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368704 00000100:00100000:1.0:1785774947.506030:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1785774947.506040:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671368704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774947.506063:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774947.506107:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671368704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774947.506114:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1785774947.506314:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671368704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1785774948.138508:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774948.518464:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671368832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774948.518541:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774948.518615:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368832 00000100:00100000:0.0:1785774948.518623:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368832 00000100:00100000:0.0:1785774948.518689:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1785774948.518698:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671368832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1785774948.518725:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 139871936 pending 4218880 free 3919331328 avail 3687809024 00000100:00100000:0.0:1785774948.518764:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671368832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774948.518770:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:0.0:1785774948.518800:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774948.518830:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671368832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774948.518994:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774948.519004:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671368960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774948.519035:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774948.519070:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671368960 00000100:00100000:1.0:1785774948.519074:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671368960 00000100:00100000:1.0:1785774948.519105:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1785774948.519110:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671368960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1785774948.519134:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:1.0:1785774948.519190:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671368960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774948.519196:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1785774948.519228:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671368960:0@lo:41:osp-pre-1-0.0 00000004:00080000:0.0:1785774949.037059:0:9848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1190887896204ns, next at 1191887893812ns, rc = 0 00000100:00100000:0.0:1785774949.037099:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671369088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774949.037197:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774949.037294:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671369088 00000100:00100000:0.0:1785774949.037301:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671369088 00000100:00100000:0.0:1785774949.037353:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1785774949.037362:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671369088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774949.037396:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 139871936 pending 4218880 free 3919331328 avail 3687809024 00000100:00100000:0.0:1785774949.037440:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671369088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774949.037447:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00080000:0.0:1785774949.037468:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774949.037513:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671369088:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1785774949.090653:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969976 is committed 00010000:00010000:2.0:1785774949.156606:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774950.119597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774950.119985:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648643968 00000100:00100000:1.0:1785774950.119999:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648643968 00000100:00100000:1.0:1785774950.120094:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24142 00000100:00100000:1.0:1785774950.120107:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:21118:x1872519648643968:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774950.120135:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774950.120235:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1c10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c5f9 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774950.120321:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1c17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774950.120339:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774950.120353:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774950.120409:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:1.0:1785774950.120425:0:21784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1785774950.120453:0:21784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774950.120483:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8800/0x7b7109e1d0a1c10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5f9 expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774950.120502:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1c17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5f9 expref: 16 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774950.120512:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774950.120515:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785774950.120519:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8e00, rc 0) 00000100:00100000:1.0:1785774950.120587:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:21118:x1872519648643968:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 484us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774950.120596:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24142 00000100:00080000:0.0:1785774950.126149:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774950.150709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774950.151090:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644096 00000100:00100000:1.0:1785774950.151103:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644096 00000100:00100000:1.0:1785774950.151239:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24143 00000100:00100000:1.0:1785774950.151252:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:21118:x1872519648644096:12345-192.168.202.31@tcp:41:lfs.0 00000004:00000024:1.0:1785774950.151306:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774950.151387:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:21118:x1872519648644096:12345-192.168.202.31@tcp:41:lfs.0 Request processed in 138us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774950.151395:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24143 00000100:00100000:2.0:1785774950.170601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774950.170707:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644224 00000100:00100000:3.0:1785774950.170716:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644224 00000100:00100000:3.0:1785774950.170803:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24144 00000100:00100000:3.0:1785774950.170813:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21118:x1872519648644224:12345-192.168.202.31@tcp:41:lfs.0 00000004:00000024:3.0:1785774950.170851:0:8627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:3.0:1785774950.170929:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21118:x1872519648644224:12345-192.168.202.31@tcp:41:lfs.0 Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774950.170936:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24144 00000100:00080000:0.0:1785774950.174983:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1785774950.180413:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774950.180606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774950.187541:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644352 00000100:00100000:1.0:1785774950.187556:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644352 00000100:00100000:1.0:1785774950.187651:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 660 00000100:00100000:1.0:1785774950.187664:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21118:x1872519648644352:12345-192.168.202.31@tcp:13:lfs.0 00002000:00000024:1.0:1785774950.187698:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00080000:0.0:1785774950.187706:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774950.189811:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21118:x1872519648644352:12345-192.168.202.31@tcp:13:lfs.0 Request processed in 2142us (9208us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774950.189824:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 660 00000100:00100000:0.0:1785774950.206822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774950.206940:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644480 00000100:00100000:2.0:1785774950.206954:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644480 00000100:00100000:2.0:1785774950.207042:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 661 00000100:00100000:2.0:1785774950.207054:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21118:x1872519648644480:12345-192.168.202.31@tcp:13:lfs.0 00002000:00000024:2.0:1785774950.207096:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3919331328 avail 3687809024 00000100:00100000:2.0:1785774950.207223:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21118:x1872519648644480:12345-192.168.202.31@tcp:13:lfs.0 Request processed in 172us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774950.207232:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 661 00000100:00080000:0.0:1785774950.208295:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1785774951.078640:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000001:00080000:2.0:1785774951.078669:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984184 is committed 00000004:00080000:2.0:1785774951.078673:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00010000:00010000:2.0:1785774951.078691:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.078703:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.078711:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.078716:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774951.078721:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.078729:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.078771:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9b7604f39c00) 00010000:00010000:2.0:1785774951.078784:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774951.078789:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.078796:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1bfb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774951.081844:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774951.081866:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671369216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785774951.081933:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774951.081985:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671369216 00000100:00100000:2.0:1785774951.081993:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671369216 00000100:00080000:0.0:1785774951.082028:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774951.082071:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5347 00000100:00100000:2.0:1785774951.082081:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671369216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785774951.082107:0:14712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2560 count 1 00010000:00010000:2.0:1785774951.082129:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.082149:0:14712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 5 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.082156:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xa00:0x0].0x0 since=66s v=(0 0) 00010000:00010000:2.0:1785774951.082176:0:14712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785774951.082180:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.082205:0:14712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 5 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774951.082223:0:14712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 5 pid: 14729 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774951.082342:0:14712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14712:1872519671369344:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774951.082410:0:14712:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605ebbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1785774951.086526:0:14712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14712:1872519671369344:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774951.086556:0:14712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774951.089707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774951.091996:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644608 00000100:00100000:1.0:1785774951.092025:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644608 00010000:00010000:1.0:1785774951.092072:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 6 pid: 14729 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774951.092112:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1676 00000100:00100000:1.0:1785774951.092123:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648644608:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774951.092140:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774951.092147:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 6 pid: 14729 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774951.092180:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 6 pid: 14729 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774951.092207:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a19c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c558 expref: 6 pid: 14729 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774951.092222:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774951.092227:0:9541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774951.092232:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774951.092241:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774951.092277:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774951.092317:0:14712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092329:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092339:0:14712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092348:0:14712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092368:0:14712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785774951.092528:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2417:x1872519648644608:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 405us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774951.092536:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1676 00000100:00100000:0.0:1785774951.092567:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3654:x1872519671369216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10485us (10631us total) trans 4294969977 rc 0/0 00000100:00100000:0.0:1785774951.092576:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5347 00010000:00010000:0.0:1785774951.092596:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774951.092602:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092623:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774951.092628:0:14708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092638:0:14708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092653:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092660:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093219bea/0x7b7109e1d0a1c1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774951.092679:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774951.092682:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774951.092684:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785774951.092721:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7602758e00/2, rc 0, transno 4294969977 00000100:00100000:0.0:1785774951.092727:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671369216:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1785774951.204338:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774951.593377:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671369472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774951.594006:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671369728:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594044:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774951.594090:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671370240:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594111:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774951.594131:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671370752:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594152:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774951.594197:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1785774951.594203:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671369600:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594227:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774951.594248:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671370112:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594294:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774951.594310:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671370624:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594331:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774951.594346:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671371136:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594366:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774951.594404:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671369728 00000100:00100000:3.0:1785774951.594411:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671369728 00000100:00100000:3.0:1785774951.594451:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671370240 00000100:00100000:3.0:1785774951.594454:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671370240 00000100:00100000:3.0:1785774951.594479:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671370752 00000100:00100000:3.0:1785774951.594482:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671370752 00000100:00100000:3.0:1785774951.594500:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1785774951.594507:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671369728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594558:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671369728:12345-0@lo:400:kworker.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774951.594565:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1785774951.594580:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1785774951.594586:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671370240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594623:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671370240:12345-0@lo:400:kworker.0 Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774951.594629:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1785774951.594640:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1785774951.594646:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671370752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594674:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671370752:12345-0@lo:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774951.594680:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00080000:3.0:1785774951.594696:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774951.594727:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671369728:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594737:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671370240:0@lo:400:kworker.0 00000100:00100000:3.0:1785774951.594759:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671370752:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.594927:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671369856:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.594960:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774951.594986:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671370368:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595023:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774951.595040:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671370880:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595060:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774951.595077:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1785774951.595082:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671369984:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595103:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774951.595117:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671370496:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774951.595152:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671371008:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774951.595219:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671370624 00000100:00100000:2.0:1785774951.595223:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671370624 00000100:00100000:2.0:1785774951.595256:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371136 00000100:00100000:2.0:1785774951.595259:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371136 00000100:00100000:2.0:1785774951.595276:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671370496 00000100:00100000:2.0:1785774951.595279:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671370496 00000100:00100000:2.0:1785774951.595297:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371008 00000100:00100000:2.0:1785774951.595300:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371008 00000100:00100000:2.0:1785774951.595321:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1785774951.595327:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671370624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595364:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671370624:12345-0@lo:400:kworker.0 Request processed in 37us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.595370:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1785774951.595382:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1785774951.595387:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3656:x1872519671371136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595428:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3656:x1872519671371136:12345-0@lo:400:kworker.0 Request processed in 41us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.595434:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1785774951.595445:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1785774951.595450:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671370496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595481:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671370496:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.595487:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1785774951.595496:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1785774951.595502:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671371008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595525:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671371008:12345-0@lo:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.595534:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1785774951.595559:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671370368 00000100:00100000:2.0:1785774951.595562:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671370368 00000100:00100000:2.0:1785774951.595584:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671370880 00000100:00100000:2.0:1785774951.595586:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671370880 00000100:00100000:2.0:1785774951.595597:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671369984 00000100:00100000:2.0:1785774951.595599:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671369984 00000100:00100000:2.0:1785774951.595624:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1785774951.595631:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671370368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595660:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671370368:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.595666:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1785774951.595677:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1785774951.595682:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671370880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595707:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671370880:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.595713:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1785774951.595723:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:2.0:1785774951.595729:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671369984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595787:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671369984:12345-0@lo:400:kworker.0 Request processed in 58us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.595793:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00080000:2.0:1785774951.595812:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774951.595816:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774951.595818:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774951.595836:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671369984:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595848:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671370496:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595855:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671371008:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595864:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671370368:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595873:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671370880:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595904:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671370624:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595913:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671371136:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.595956:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671370112 00000100:00100000:2.0:1785774951.595960:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671370112 00000100:00100000:2.0:1785774951.595982:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671369856 00000100:00100000:2.0:1785774951.595984:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671369856 00000100:00100000:2.0:1785774951.595997:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:2.0:1785774951.596003:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671370112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.596034:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671370112:12345-0@lo:400:kworker.0 Request processed in 32us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.596040:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:2.0:1785774951.596049:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:2.0:1785774951.596054:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671369856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.596077:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671369856:12345-0@lo:400:kworker.0 Request processed in 23us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.596082:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:2.0:1785774951.596095:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671369600 00000100:00100000:2.0:1785774951.596099:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671369600 00000100:00100000:2.0:1785774951.596116:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1785774951.596123:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671369600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.596149:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671369600:12345-0@lo:400:kworker.0 Request processed in 27us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774951.596154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1785774951.596204:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671369856:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.596220:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671369600:0@lo:400:kworker.0 00000100:00100000:2.0:1785774951.596229:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671370112:0@lo:400:kworker.0 00000100:00100000:1.0:1785774951.600029:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774951.600123:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671369472 00000100:00100000:1.0:1785774951.600130:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671369472 00000100:00100000:1.0:1785774951.600191:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:1.0:1785774951.600201:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671369472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774951.600237:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774951.600323:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671369472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774951.600330:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:1.0:1785774951.600374:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671369472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774952.091586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774952.091626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774952.091651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774952.091686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774952.091716:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648645120 00000100:00100000:3.0:1785774952.091724:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648645120 00000100:00100000:3.0:1785774952.091816:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 765 00000100:00100000:3.0:1785774952.091825:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648645120:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774952.091889:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648645120:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774952.091896:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 765 00000100:00080000:3.0:1785774952.091916:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774952.091993:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644992 00000100:00100000:2.0:1785774952.091998:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644992 00000100:00100000:2.0:1785774952.092036:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644864 00000100:00100000:2.0:1785774952.092039:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644864 00000100:00100000:2.0:1785774952.092057:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1231 00000100:00100000:2.0:1785774952.092065:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648644992:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774952.092092:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648644992:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774952.092098:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1231 00000100:00100000:2.0:1785774952.092109:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1232 00000100:00100000:2.0:1785774952.092114:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648644864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774952.092133:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648644864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 19us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774952.092138:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1232 00000100:00100000:1.0:1785774952.092238:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648644736 00000100:00100000:1.0:1785774952.092242:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648644736 00000100:00100000:1.0:1785774952.092275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 609 00000100:00100000:1.0:1785774952.092281:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648644736:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774952.092306:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648644736:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774952.092312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 609 00000100:00080000:3.0:1785774952.092488:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774952.092492:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1785774952.232887:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774952.613969:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671371264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774952.614041:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774952.614648:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371264 00000100:00100000:1.0:1785774952.614656:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371264 00000100:00100000:1.0:1785774952.614704:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1785774952.614713:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671371264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774952.614753:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774952.614827:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671371392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774952.614856:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774952.614909:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371392 00000100:00100000:0.0:1785774952.614913:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371392 00000100:00100000:0.0:1785774952.614928:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1785774952.614933:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671371392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774952.614945:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774952.614978:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671371392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774952.614985:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1785774952.615024:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671371392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774952.620411:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671371264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5688us (6358us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774952.620430:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1785774952.630781:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671371264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785774953.252937:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774953.636322:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774953.636344:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671371520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774953.636423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774953.636482:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371520 00000100:00100000:0.0:1785774953.636489:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371520 00000100:00100000:0.0:1785774953.636696:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1785774953.636705:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671371520:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1785774953.636803:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1785774953.636841:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774953.636931:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671371520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 228us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774953.636939:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1785774953.638284:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671371648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774953.638325:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774953.638409:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371648 00000100:00100000:0.0:1785774953.638416:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371648 00000100:00100000:0.0:1785774953.638455:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:0.0:1785774953.638461:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671371648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774953.638485:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774953.638559:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671371648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774953.638566:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00100000:0.0:1785774953.640202:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671371648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774953.645712:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671371520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774954.154521:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671371776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774954.154599:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774954.154671:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371776 00000100:00100000:2.0:1785774954.154678:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371776 00000100:00100000:2.0:1785774954.154746:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1785774954.154755:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1872519671371776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785774954.154777:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774954.154819:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1872519671371776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774954.154826:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00080000:2.0:1785774954.154846:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774954.154880:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671371776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785774954.278362:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774955.306500:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774956.324504:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774956.708363:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785774956.711302:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671371904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774956.711380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774956.712124:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671372032:0@lo:400:kworker.0 00000100:00100000:1.0:1785774956.712176:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.712415:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671372160:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.712449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.712470:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774956.712476:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671372288:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.712497:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.712540:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372160 00000100:00100000:0.0:1785774956.712547:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372160 00000100:00100000:0.0:1785774956.713944:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372288 00000100:00100000:0.0:1785774956.713952:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372288 00000100:00100000:0.0:1785774956.713975:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1785774956.713997:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671372160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.714067:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671372160:12345-0@lo:400:kworker.0 Request processed in 71us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774956.714074:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1785774956.714092:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1785774956.714098:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671372288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.714125:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671372288:12345-0@lo:400:kworker.0 Request processed in 27us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774956.714131:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1785774956.714146:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774956.714156:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671372416:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.714185:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671372288:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.714196:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671372160:0@lo:400:kworker.0 00000100:00100000:1.0:1785774956.714200:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.714239:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372032 00000100:00100000:0.0:1785774956.714243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372032 00000100:00100000:0.0:1785774956.714270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1785774956.714276:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671372032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.714305:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671372032:12345-0@lo:400:kworker.0 Request processed in 30us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774956.714311:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1785774956.715806:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671372800:0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.715852:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774956.715880:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671373312:0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.715900:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774956.715920:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785774956.715926:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671372672:0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.715949:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774956.715965:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671373184:0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.715984:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774956.716024:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372800 00000100:00100000:2.0:1785774956.716030:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372800 00000100:00100000:2.0:1785774956.716072:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373312 00000100:00100000:2.0:1785774956.716075:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373312 00000100:00100000:2.0:1785774956.716099:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1785774956.716106:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671372800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.716149:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671372800:12345-0@lo:400:kworker.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774956.716155:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1785774956.716187:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1785774956.716194:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671373312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.716221:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671373312:12345-0@lo:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774956.716227:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1785774956.716246:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372672 00000100:00100000:2.0:1785774956.716249:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372672 00000100:00100000:2.0:1785774956.716272:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373184 00000100:00100000:2.0:1785774956.716275:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373184 00000100:00100000:2.0:1785774956.716294:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1785774956.716300:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671372672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.716329:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671372672:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774956.716335:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1785774956.716346:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1785774956.716352:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671373184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.716377:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671373184:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774956.716383:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00080000:2.0:1785774956.716400:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774956.716403:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774956.716405:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774956.716434:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671372672:0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.716443:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671373184:0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.716451:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671372800:0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.716458:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671373312:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.716842:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671372928:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.716873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.716895:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671373440:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.716913:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.716930:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785774956.716936:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671372544:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.716956:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.716970:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671373056:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.716998:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774956.717023:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372544 00000100:00100000:0.0:1785774956.717026:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372544 00000100:00100000:0.0:1785774956.717049:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373056 00000100:00100000:0.0:1785774956.717051:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373056 00000100:00100000:0.0:1785774956.717064:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1785774956.717070:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671372544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.717104:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671372544:12345-0@lo:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774956.717110:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1785774956.717120:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1785774956.717126:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671373056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.717199:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671373056:12345-0@lo:400:kworker.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774956.717205:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1785774956.717231:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671372544:0@lo:400:kworker.0 00000100:00100000:0.0:1785774956.717239:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671373056:0@lo:400:kworker.0 00000100:00100000:1.0:1785774956.719069:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671372032:0@lo:400:kworker.0 00000100:00100000:1.0:1785774956.719126:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372928 00000100:00100000:1.0:1785774956.719131:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372928 00000100:00080000:2.0:1785774956.719154:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774956.719198:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373440 00000100:00100000:2.0:1785774956.719202:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373440 00000100:00100000:2.0:1785774956.719253:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1785774956.719261:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3653:x1872519671373440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774956.719382:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3653:x1872519671373440:12345-0@lo:400:kworker.0 Request processed in 121us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774956.719390:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00080000:2.0:1785774956.719407:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774956.719536:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1785774956.719542:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671372928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774956.719576:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671372928:12345-0@lo:400:kworker.0 Request processed in 34us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774956.719582:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1785774956.719623:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671372928:0@lo:400:kworker.0 00000100:00100000:1.0:1785774956.719634:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671373440:0@lo:400:kworker.0 00000100:00080000:2.0:1785774956.719706:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774956.723365:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671371904 00000100:00100000:3.0:1785774956.723379:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671371904 00000100:00100000:3.0:1785774956.723455:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671372416 00000100:00100000:3.0:1785774956.723458:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671372416 00000100:00100000:3.0:1785774956.723491:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:3.0:1785774956.723500:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671371904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774956.723547:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:3.0:1785774956.723807:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671371904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 306us (12425us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774956.723815:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00100000:3.0:1785774956.723831:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1785774956.723837:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671372416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774956.723869:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671372416:12345-0@lo:400:kworker.0 Request processed in 33us (9669us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774956.723875:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1785774956.723925:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671372416:0@lo:400:kworker.0 00000100:00100000:3.0:1785774956.723942:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671371904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774957.187262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774957.187326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774957.187381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774957.187409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774957.187438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774957.187785:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648645248 00000100:00100000:0.0:1785774957.187798:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648645248 00000100:00100000:0.0:1785774957.187858:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 611 00000100:00100000:0.0:1785774957.187870:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648645248:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774957.187954:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648645248:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774957.187962:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 611 00000100:00100000:2.0:1785774957.188737:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648645376 00000100:00100000:2.0:1785774957.188743:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648645376 00000100:00100000:2.0:1785774957.188786:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648645504 00000100:00100000:2.0:1785774957.188789:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648645504 00000100:00100000:2.0:1785774957.188808:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1239 00000100:00100000:2.0:1785774957.188815:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648645376:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774957.188856:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648645376:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774957.188862:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1239 00000100:00100000:2.0:1785774957.188876:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1240 00000100:00100000:2.0:1785774957.188883:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648645504:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774957.188915:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648645504:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774957.188921:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1240 00000100:00080000:2.0:1785774957.188939:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774957.188944:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774957.190673:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648645632 00000100:00100000:1.0:1785774957.190683:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648645632 00000100:00100000:2.0:1785774957.190831:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648645760 00000100:00100000:2.0:1785774957.190835:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648645760 00000100:00100000:2.0:1785774957.190862:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 770 00000100:00100000:2.0:1785774957.190871:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648645632:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774957.190925:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648645632:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 55us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774957.190932:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 770 00000100:00100000:2.0:1785774957.190947:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 771 00000100:00100000:2.0:1785774957.190954:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648645760:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774957.190981:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2416:x1872519648645760:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774957.190987:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 771 00000100:00080000:0.0:1785774957.191093:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774957.191097:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1785774957.228273:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969977 is committed 00010000:00010000:2.0:1785774957.348574:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774957.740358:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774957.740396:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671373568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774957.740495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774957.740582:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373568 00000100:00100000:0.0:1785774957.740592:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373568 00000100:00100000:0.0:1785774957.740655:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1785774957.740664:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671373568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774957.740716:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774957.740769:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671373568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774957.740777:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1785774957.740836:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671373568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774957.746412:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785774957.746439:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671373696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774957.746523:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774957.746587:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373696 00000100:00100000:0.0:1785774957.746597:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373696 00000100:00100000:0.0:1785774957.746653:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1785774957.746663:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671373696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774957.746701:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774957.746755:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671373696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774957.746762:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1785774957.746898:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671373696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785774958.372387:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774958.756558:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671373824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774958.756662:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774958.756962:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373824 00000100:00100000:0.0:1785774958.756974:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373824 00000100:00100000:0.0:1785774958.757047:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1785774958.757059:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671373824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774958.757107:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774958.757193:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671373824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774958.757202:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:1.0:1785774958.757346:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671373824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774958.757884:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671373952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774958.757923:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774958.758045:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671373952 00000100:00100000:0.0:1785774958.758053:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671373952 00000100:00100000:0.0:1785774958.758144:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1785774958.758151:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671373952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1785774958.758194:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774958.758255:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671373952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774958.758262:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1785774958.758316:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671373952:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1785774958.758453:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774959.272413:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774959.272444:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671374080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774959.272534:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774959.272720:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374080 00000100:00100000:0.0:1785774959.272731:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374080 00000100:00100000:0.0:1785774959.272816:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1785774959.272827:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671374080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774959.272853:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774959.272902:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671374080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774959.272908:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00080000:2.0:1785774959.273050:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774959.273086:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969977 gen 2 00000004:00080000:2.0:1785774959.273093:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7602758e00, transno 4294969977 00000100:00100000:2.0:1785774959.273119:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671374080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785774959.406896:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774960.420860:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785774960.601390:0:22979:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 12:35:57 (1785774957) 00010000:00010000:3.0:1785774961.444713:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774961.828685:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671374336:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.828785:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.828847:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671374848:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.828872:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.828896:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671375360:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.828928:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.828956:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1785774961.828961:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671374208:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830170:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830212:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671374720:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830250:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830272:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671375232:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830310:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830331:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671375744:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830354:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830388:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671374464:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830413:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830434:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671374976:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830459:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830479:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671375488:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830502:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830523:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1785774961.830530:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671374592:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830571:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671375104:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830594:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830611:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671375616:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830632:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774961.830690:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374336 00000100:00100000:2.0:1785774961.830699:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374336 00000100:00100000:2.0:1785774961.830749:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374848 00000100:00100000:2.0:1785774961.830753:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374848 00000100:00100000:2.0:1785774961.830776:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671375360 00000100:00100000:2.0:1785774961.830779:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671375360 00000100:00100000:2.0:1785774961.830791:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374976 00000100:00100000:2.0:1785774961.830793:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374976 00000100:00100000:2.0:1785774961.830805:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671375488 00000100:00100000:2.0:1785774961.830807:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671375488 00000100:00100000:2.0:1785774961.830820:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374592 00000100:00100000:2.0:1785774961.830822:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374592 00000100:00100000:2.0:1785774961.830840:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1785774961.830849:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671374336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830910:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1872519671374336:12345-0@lo:400:kworker.0 Request processed in 62us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.830930:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1785774961.830951:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1785774961.830958:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671374848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.830997:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671374848:12345-0@lo:400:kworker.0 Request processed in 40us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.836575:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1785774961.836630:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1785774961.836658:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671375360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.836795:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671375360:12345-0@lo:400:kworker.0 Request processed in 157us (7865us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.836802:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1785774961.836815:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1785774961.836823:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671374976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.836863:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671374976:12345-0@lo:400:kworker.0 Request processed in 42us (6403us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.836870:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1785774961.836883:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1785774961.836905:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671375488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.839803:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671375488:12345-0@lo:400:kworker.0 Request processed in 2889us (9288us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.839820:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1785774961.839860:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1785774961.839872:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671374592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.841466:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671374592:12345-0@lo:400:kworker.0 Request processed in 1595us (10908us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.841477:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1785774961.841533:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374208 00000100:00100000:2.0:1785774961.841543:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374208 00000100:00100000:2.0:1785774961.841600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1785774961.841608:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671374208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.841656:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671374208:12345-0@lo:400:kworker.0 Request processed in 40us (12645us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.841662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1785774961.841711:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374720 00000100:00100000:2.0:1785774961.841717:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374720 00000100:00100000:2.0:1785774961.841746:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671374464 00000100:00100000:2.0:1785774961.841749:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671374464 00000100:00100000:2.0:1785774961.841771:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:2.0:1785774961.841778:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671374720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.841814:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671374720:12345-0@lo:400:kworker.0 Request processed in 37us (11563us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.841820:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00100000:2.0:1785774961.841830:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:2.0:1785774961.841836:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671374464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.841858:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3653:x1872519671374464:12345-0@lo:400:kworker.0 Request processed in 24us (11445us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.841864:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:2.0:1785774961.841882:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671375232 00000100:00100000:1.0:1785774961.843897:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774961.843934:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671375872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774961.844214:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774961.844290:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671375872 00000100:00100000:1.0:1785774961.844411:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671375872 00000100:00100000:1.0:1785774961.844466:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:1.0:1785774961.844476:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671375872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774961.844515:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774961.844566:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671375872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774961.844574:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:1.0:1785774961.844625:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671375872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774961.845200:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671375232 00000100:00100000:2.0:1785774961.845540:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671375744 00000100:00100000:2.0:1785774961.845545:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671375744 00000100:00100000:2.0:1785774961.847448:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671375104 00000100:00100000:2.0:1785774961.847461:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671375104 00000100:00100000:2.0:1785774961.847509:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671375616 00000100:00100000:2.0:1785774961.847513:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671375616 00000100:00100000:2.0:1785774961.847547:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1785774961.847558:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671375232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.847687:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671375232:12345-0@lo:400:kworker.0 Request processed in 131us (17376us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.847695:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1785774961.847713:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1785774961.847721:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671375744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.847753:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671375744:12345-0@lo:400:kworker.0 Request processed in 33us (17398us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.847759:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1785774961.847770:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1785774961.847776:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671375104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.847807:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671375104:12345-0@lo:400:kworker.0 Request processed in 31us (17212us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.847814:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1785774961.847825:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1785774961.847831:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671375616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.847862:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671375616:12345-0@lo:400:kworker.0 Request processed in 31us (17228us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774961.847868:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00080000:1.0:1785774961.856600:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774961.856615:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774961.856619:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774961.856622:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785774961.856803:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671374208:0@lo:400:kworker.0 00000100:00100000:1.0:1785774961.856826:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671374720:0@lo:400:kworker.0 00000100:00100000:1.0:1785774961.856842:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671375232:0@lo:400:kworker.0 00000100:00100000:1.0:1785774961.856855:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671375744:0@lo:400:kworker.0 00000100:00100000:1.0:1785774961.856869:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1872519671374336:0@lo:400:kworker.0 00000100:00100000:1.0:1785774961.856883:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671374848:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.857530:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671374592:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.857547:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671375104:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.857561:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671375616:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.857574:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671374464:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.857588:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671374976:0@lo:400:kworker.0 00000100:00100000:2.0:1785774961.857602:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671375488:0@lo:400:kworker.0 00000100:00100000:1.0:1785774961.857847:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671375360:0@lo:400:kworker.0 00000100:00100000:3.0:1785774962.317092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.317151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.317226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.317254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.317283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.317345:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648646400 00000100:00100000:3.0:1785774962.317360:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648646400 00000100:00100000:3.0:1785774962.317467:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648646272 00000100:00100000:3.0:1785774962.317471:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648646272 00000100:00100000:2.0:1785774962.317812:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648646144 00000100:00100000:2.0:1785774962.317818:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648646144 00000100:00100000:2.0:1785774962.317855:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648646016 00000100:00100000:2.0:1785774962.317858:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648646016 00000100:00100000:2.0:1785774962.317891:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1247 00000100:00100000:2.0:1785774962.317902:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648646144:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774962.318003:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648646144:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 103us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774962.318012:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1247 00000100:00100000:2.0:1785774962.318033:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1248 00000100:00100000:2.0:1785774962.318040:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648646016:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774962.318070:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648646016:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774962.318077:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1248 00000100:00100000:3.0:1785774962.319023:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 776 00000100:00100000:3.0:1785774962.319039:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2418:x1872519648646400:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774962.319099:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:2418:x1872519648646400:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 66us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774962.319107:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 776 00000100:00100000:3.0:1785774962.319127:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 777 00000100:00100000:3.0:1785774962.319133:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648646272:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774962.319179:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2418:x1872519648646272:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774962.319186:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 777 00000100:00100000:1.0:1785774962.328045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648645888 00000100:00100000:1.0:1785774962.328064:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648645888 00000100:00100000:1.0:1785774962.328143:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 613 00000100:00100000:1.0:1785774962.328154:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648645888:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774962.328263:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2418:x1872519648645888:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 112us (11187us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774962.328272:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 613 00000100:00080000:1.0:1785774962.328325:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774962.328331:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1785774962.328335:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785774962.328338:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774962.340242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774962.341733:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648646656 00000100:00100000:1.0:1785774962.341748:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648646656 00000100:00100000:1.0:1785774962.341842:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24145 00000100:00100000:1.0:1785774962.341854:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:21617:x1872519648646656:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774962.341882:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774962.341957:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785774962.349548:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1c17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c5f9 expref: 14 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.349576:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774962.349581:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774962.349627:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1c25 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c600 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.349767:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.349781:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.349792:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.349808:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.349815:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.349822:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774962.352954:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa01:0x0], index 0: 0 00010000:00010000:1.0:1785774962.353778:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1c3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353796:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353809:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353848:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353855:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353871:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353877:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353883:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774962.353887:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353895:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353907:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774962.353910:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774962.353914:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353924:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1c2c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774962.353937:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011aea2e0 reply state 000000005e00a43d transno 4294984185 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353948:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.353954:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9b7605dfe000) 00010000:00010000:1.0:1785774962.353957:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774962.353960:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774962.353994:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1c25 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c600 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.354011:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c600 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.354018:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b1:0x0].0x0 (ffff9b7605dfec00) 00010000:00010000:1.0:1785774962.354021:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774962.354023:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9000, rc 0) 00000100:00100000:1.0:1785774962.354102:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:21617:x1872519648646656:12345-192.168.202.31@tcp:101:dd.0 Request processed in 12250us (13873us total) trans 4294984185 rc 0/0 00000100:00100000:1.0:1785774962.354111:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24145 00000100:00100000:0.0:1785774962.372820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774962.374403:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648646784 00000100:00100000:2.0:1785774962.374418:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648646784 00000100:00100000:2.0:1785774962.374493:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5348 00000100:00100000:2.0:1785774962.374503:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21617:x1872519648646784:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774962.374522:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774962.374544:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c607 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774962.374574:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774962.374596:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=1204s v=(0 0) 00010000:00010000:2.0:1785774962.374601:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774962.374610:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 7 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.374628:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 7 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.374650:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744a00, rc 0) 00000100:00100000:2.0:1785774962.374717:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:21617:x1872519648646784:12345-192.168.202.31@tcp:101:dd.0 Request processed in 215us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774962.374723:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5348 00000100:00100000:2.0:1785774962.392388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.392604:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648647040 00000100:00100000:3.0:1785774962.392617:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648647040 00000100:00100000:3.0:1785774962.392688:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5236 00000100:00100000:3.0:1785774962.392700:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:21617:x1872519648647040:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1785774962.393071:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:21617:x1872519648647040:12345-192.168.202.31@tcp:35:dd.0 Request processed in 372us (696us total) trans 4294984186 rc 0/0 00000100:00100000:3.0:1785774962.393082:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5236 00000100:00100000:1.0:1785774962.437815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774962.437913:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648647168 00000100:00100000:2.0:1785774962.437926:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648647168 00000100:00100000:2.0:1785774962.437992:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24146 00000100:00100000:2.0:1785774962.441626:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:21618:x1872519648647168:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1785774962.441678:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774962.441706:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1c4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c60e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.441794:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1c56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.441812:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.441828:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774962.441888:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774962.441892:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774962.441918:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.441950:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1c4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c60e expref: 19 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.441968:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1c56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c60e expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.441978:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774962.441981:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774962.441986:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:2.0:1785774962.442076:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:21618:x1872519648647168:12345-192.168.202.31@tcp:101:rm.0 Request processed in 476us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774962.449774:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24146 00010000:00010000:0.0:1785774962.468777:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774962.480540:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.480602:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648647424 00000100:00100000:3.0:1785774962.480615:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648647424 00000100:00100000:3.0:1785774962.480702:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24147 00000100:00100000:3.0:1785774962.480715:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:21618:x1872519648647424:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1785774962.480800:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1785774962.480834:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1c3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c600 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.480856:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b1:0x0].0x0 (ffff9b7605dfec00) 00010000:00010000:3.0:1785774962.480878:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1c56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c60e expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.480888:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774962.480891:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774962.480928:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.480944:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.480956:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.480974:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.480982:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.480988:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481085:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481093:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481100:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785774962.481447:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].51, 64 off11456 00000004:00080000:3.0:1785774962.481459:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1204332297718ns, next at 1205332294673ns, rc = 0 00010000:00010000:3.0:1785774962.481526:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481536:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481545:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481553:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481559:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481566:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481594:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785774962.481616:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481623:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481629:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481637:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774962.481651:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481659:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481667:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b1:0x0].0x0 (ffff9b7711ae8b00) 00010000:00010000:3.0:1785774962.481670:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785774962.481673:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481679:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1c6b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481697:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481703:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481709:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481715:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481720:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774962.481723:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481728:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481735:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:3.0:1785774962.481738:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774962.481740:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481746:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1c5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774962.481755:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7fca98e reply state 0000000075db4f6b transno 4294984187 ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481766:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774962.481771:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9b7605dfe000) 00010000:00010000:3.0:1785774962.481773:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774962.481776:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774962.481871:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:21618:x1872519648647424:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1159us (1344us total) trans 4294984187 rc 0/0 00000100:00100000:3.0:1785774962.481880:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24147 00010000:00010000:0.0:1785774962.482447:0:16275:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785774962.482457:0:16275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.482465:0:16275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cea00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:0.0:1785774962.482469:0:16275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.482477:0:16275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.482488:0:16275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b1:0x0].0x0 (ffff9b7711ae8b00) 00010000:00010000:0.0:1785774962.482491:0:16275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785774962.482494:0:16275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.482500:0:16275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cea00/0x7b7109e1d0a1c72 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.482540:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774962.482543:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774962.482544:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774962.572056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774962.572105:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648647552 00000100:00100000:2.0:1785774962.572117:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648647552 00000100:00100000:2.0:1785774962.572203:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24148 00000100:00100000:2.0:1785774962.572216:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:21621:x1872519648647552:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:2.0:1785774962.572260:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774962.576003:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1c79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c615 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.576141:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.576171:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.576187:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774962.576247:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:2.0:1785774962.576251:0:21784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774962.576280:0:21784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.576327:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744200/0x7b7109e1d0a1c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c615 expref: 20 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.576350:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c615 expref: 19 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.576360:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774962.576363:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785774962.576367:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745c00, rc 0) 00000100:00100000:2.0:1785774962.578798:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:21621:x1872519648647552:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 6571us (6742us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774962.578814:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24148 00000100:00100000:0.0:1785774962.595147:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774962.595274:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648647808 00000100:00100000:2.0:1785774962.595288:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648647808 00000100:00100000:2.0:1785774962.595371:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24149 00000100:00100000:2.0:1785774962.595384:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:21621:x1872519648647808:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:2.0:1785774962.595426:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774962.595431:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785774962.595471:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1c80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c615 expref: 19 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.595503:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774962.595509:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774962.595527:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1c87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c61c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.595706:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.595723:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.595736:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.595750:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.595759:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.595766:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774962.596581:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa01:0x0], index 1: 0 00010000:00010000:2.0:1785774962.596782:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1c9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596794:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1c9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596804:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1c9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596847:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596854:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596861:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596869:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596875:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774962.596881:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596889:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.596901:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774962.596903:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774962.597017:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.597030:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745400/0x7b7109e1d0a1c8e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774962.597046:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016a8c15a reply state 00000000b4b7da2c transno 4294984188 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.597060:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.597067:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9b7605dfe000) 00010000:00010000:2.0:1785774962.597069:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774962.597073:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774962.597110:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745000/0x7b7109e1d0a1c87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c61c expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.597126:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744000/0x7b7109e1d0a1c9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c61c expref: 20 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.597134:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b2:0x0].0x0 (ffff9b7605fce000) 00010000:00010000:2.0:1785774962.597136:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774962.597139:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744000, rc 0) 00000100:00100000:2.0:1785774962.597817:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:21621:x1872519648647808:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 2432us (2684us total) trans 4294984188 rc 0/0 00000100:00100000:2.0:1785774962.597828:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24149 00000100:00100000:0.0:1785774962.604405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774962.606022:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648647936 00000100:00100000:1.0:1785774962.606040:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648647936 00000100:00100000:1.0:1785774962.606125:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5349 00000100:00100000:1.0:1785774962.606137:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773c2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+5:21621:x1872519648647936:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:1.0:1785774962.606179:0:14722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774962.606210:0:14722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1caa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c623 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774962.606256:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774962.606285:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa01:0x0].0x0 since=1204s v=(0 0) 00010000:00010000:1.0:1785774962.606291:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774962.606304:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c623 expref: 6 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.606327:0:14722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b813b2fb/0x7b7109e1d0a1caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c623 expref: 6 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.606343:0:14722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9c00, rc 0) 00000100:00100000:1.0:1785774962.606444:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773c2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21621:x1872519648647936:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 309us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774962.606452:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5349 00000100:00100000:1.0:1785774962.646525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774962.646680:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648648064 00000100:00100000:2.0:1785774962.646693:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648648064 00000100:00100000:2.0:1785774962.646774:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24150 00000100:00100000:2.0:1785774962.646786:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:21621:x1872519648648064:12345-192.168.202.31@tcp:44:multiop.0 00000001:00080000:1.0:1785774962.648706:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984188 is committed 00000004:00080000:1.0:1785774962.648727:0:6508:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000100:00100000:3.0:1785774962.648973:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:21621:x1872519648648064:12345-192.168.202.31@tcp:44:multiop.0 Request processed in 2182us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774962.648989:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24150 00010000:00010000:0.0:1785774962.649320:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649334:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649341:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649347:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774962.649352:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649360:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649379:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9b7605dfe000) 00010000:00010000:0.0:1785774962.649382:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774962.649387:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649394:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1c33 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649428:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649436:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649442:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649447:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774962.649450:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649456:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649465:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9b7605dfe000) 00010000:00010000:0.0:1785774962.649467:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774962.649470:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649476:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76057cf000/0x7b7109e1d0a1c64 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649488:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649494:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649501:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649506:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774962.649509:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649515:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649522:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9b7605dfe000) 00010000:00010000:0.0:1785774962.649524:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774962.649527:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.649532:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1c95 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774962.650782:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785774962.650808:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671376000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785774962.651363:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774962.656822:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671376000 00000100:00100000:2.0:1785774962.656842:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671376000 00000100:00100000:1.0:1785774962.658095:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5350 00000100:00100000:1.0:1785774962.658110:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671376000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785774962.658144:0:14729:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2561 count 1 00010000:00010000:1.0:1785774962.658187:0:14729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.658209:0:14729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 6 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.658216:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774962.658220:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774962.658224:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.658281:0:14729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 6 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.658294:0:14729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 6 pid: 14725 timeout: 1304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774962.658307:0:14729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14729:1872519671376128:192.168.202.31@tcp:104: 00000100:00100000:1.0:1785774962.668959:0:14729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7602246d80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774962.669533:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774962.672428:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648648192 00000100:00100000:3.0:1785774962.672448:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648648192 00000100:00100000:3.0:1785774962.672549:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5351 00000100:00100000:3.0:1785774962.672563:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648648192:12345-192.168.202.31@tcp:16:multiop.0 00000100:00100000:3.0:1785774962.672759:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2419:x1872519648648192:12345-192.168.202.31@tcp:16:multiop.0 Request processed in 200us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774962.672768:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5351 00000100:00100000:1.0:1785774962.674579:0:14729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14729:1872519671376128:192.168.202.31@tcp:104: 00010000:00010000:1.0:1785774962.674615:0:14729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774962.677117:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774962.677211:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648648320 00000100:00100000:1.0:1785774962.677225:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648648320 00010000:00010000:1.0:1785774962.677318:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 7 pid: 14725 timeout: 1304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774962.677358:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1677 00000100:00100000:1.0:1785774962.677367:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2417:x1872519648648320:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774962.677386:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774962.677392:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 7 pid: 14725 timeout: 1304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.677404:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 7 pid: 14725 timeout: 1304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.677429:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ca42b9/0x7b7109e1d0a1c48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c607 expref: 7 pid: 14725 timeout: 1304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.677456:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774962.677460:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785774962.677466:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.677477:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774962.677513:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774962.677565:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648648320:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 199us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774962.677572:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1677 00010000:00010000:0.0:1785774962.677859:0:14729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.677875:0:14729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.677890:0:14729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.677898:0:14729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774962.677934:0:14729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785774962.678215:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3654:x1872519671376000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20106us (27332us total) trans 4294969952 rc 0/0 00000100:00100000:0.0:1785774962.678224:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5350 00010000:00010000:2.0:1785774962.678435:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774962.678445:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.678454:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9a00 already unused, calling callback (ffffffffc0caa300) 00010000:00010000:2.0:1785774962.678459:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.678470:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.678489:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.678497:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91b0a01/0x7b7109e1d0a1cb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774962.678523:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774962.678525:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774962.678527:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785774962.679139:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7603d7b480/2, rc 0, transno 4294969952 00000100:00100000:1.0:1785774962.679149:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671376000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785774962.687086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774962.688009:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648648576 00000100:00100000:0.0:1785774962.688024:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648648576 00000100:00100000:0.0:1785774962.688113:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5237 00000100:00100000:0.0:1785774962.688126:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:21621:x1872519648648576:12345-192.168.202.31@tcp:35:multiop.0 00000100:00100000:1.0:1785774962.688867:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:21621:x1872519648648576:12345-192.168.202.31@tcp:35:multiop.0 Request processed in 731us (1783us total) trans 4294984189 rc 0/0 00000100:00100000:1.0:1785774962.689306:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5237 00000100:00100000:0.0:1785774962.855503:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774962.855526:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671376256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774962.855587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774962.855719:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671376256 00000100:00100000:1.0:1785774962.855726:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671376256 00000100:00100000:1.0:1785774962.855775:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1785774962.855783:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671376256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774962.855816:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1785774962.855859:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671376256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774962.855866:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1785774962.859959:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671376256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774962.860091:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671376384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774962.860147:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774962.860264:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671376384 00000100:00100000:3.0:1785774962.860271:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671376384 00000100:00100000:3.0:1785774962.860320:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1785774962.860328:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671376384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785774962.860348:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774962.860399:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671376384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774962.860406:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1785774962.860519:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671376384:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785774963.492406:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774963.876395:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774963.876419:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671376512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774963.876486:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774963.876524:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671376512 00000100:00100000:0.0:1785774963.876531:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671376512 00000100:00080000:1.0:1785774963.876558:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774963.876587:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1785774963.876598:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671376512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1785774963.876635:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774963.876689:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671376512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774963.876696:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1785774963.876760:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671376640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774963.876806:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774963.876897:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671376512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1785774963.876960:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671376640 00000100:00100000:0.0:1785774963.876964:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671376640 00000100:00100000:0.0:1785774963.877000:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:0.0:1785774963.877012:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671376640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774963.877035:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774963.877081:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671376640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774963.877087:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000100:00100000:1.0:1785774963.877236:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671376640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774964.390766:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671376768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774964.390853:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774964.391121:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671376768 00000100:00100000:0.0:1785774964.391130:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671376768 00000100:00100000:0.0:1785774964.391238:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1785774964.391248:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671376768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774964.391269:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774964.391327:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671376768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774964.391334:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1785774964.391389:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671376768:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1785774964.391618:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785774964.516568:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774965.540319:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774966.564496:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774966.949833:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671376896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774966.949899:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774966.950068:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671376896 00000100:00100000:1.0:1785774966.950076:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671376896 00000100:00100000:1.0:1785774966.950122:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:1.0:1785774966.950131:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671376896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774966.950182:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774966.950231:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671376896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774966.950238:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00100000:2.0:1785774966.950279:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671376896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774966.950555:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671377408:0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.950582:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774966.950607:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671377024:0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.950613:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671377920:0@lo:400:kworker.0 00000100:00100000:3.0:1785774966.950674:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671377280:0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.961219:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774966.961296:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671378432:0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.961344:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774966.961912:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671377152:0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.961941:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774966.962070:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671377664:0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.962092:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774966.962107:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671378176:0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.962125:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774966.962176:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377408 00000100:00100000:1.0:1785774966.962183:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377408 00000100:00100000:1.0:1785774966.962224:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:1.0:1785774966.962231:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671377408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774966.962287:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671377408:12345-0@lo:400:kworker.0 Request processed in 56us (11704us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774966.962294:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00100000:1.0:1785774966.962342:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671377408:0@lo:400:kworker.0 00000100:00100000:0.0:1785774966.962387:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377920 00000100:00100000:0.0:1785774966.962392:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377920 00000100:00100000:0.0:1785774966.962428:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378432 00000100:00100000:0.0:1785774966.962432:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378432 00000100:00100000:0.0:1785774966.962453:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1785774966.962472:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671377920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774966.962512:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3655:x1872519671377920:12345-0@lo:400:kworker.0 Request processed in 53us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774966.962520:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1785774966.962532:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1785774966.962537:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671378432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774966.962560:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671378432:12345-0@lo:400:kworker.0 Request processed in 24us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774966.962566:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1785774966.962587:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671378432:0@lo:400:kworker.0 00000100:00100000:0.0:1785774966.962608:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671377920:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.966348:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774966.967374:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671377536:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.967429:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774966.967451:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671378048:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.967485:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774966.967524:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377152 00000100:00100000:2.0:1785774966.967531:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377152 00000100:00100000:2.0:1785774966.967568:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377664 00000100:00100000:2.0:1785774966.967570:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377664 00000100:00100000:2.0:1785774966.967585:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378176 00000100:00100000:2.0:1785774966.967587:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378176 00000100:00100000:2.0:1785774966.967610:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377536 00000100:00100000:2.0:1785774966.967613:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377536 00000100:00100000:2.0:1785774966.967624:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378048 00000100:00100000:2.0:1785774966.967626:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378048 00000100:00100000:2.0:1785774966.967640:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1785774966.967647:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671377152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.967855:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671377152:12345-0@lo:400:kworker.0 Request processed in 207us (5911us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774966.967864:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1785774966.967881:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1785774966.967887:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671377664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.967918:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671377664:12345-0@lo:400:kworker.0 Request processed in 32us (5825us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774966.967925:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1785774966.967935:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1785774966.967941:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671378176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.967966:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671378176:12345-0@lo:400:kworker.0 Request processed in 26us (5839us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774966.967971:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1785774966.967982:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1785774966.967987:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671377536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.968018:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671377536:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774966.968024:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1785774966.968033:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1785774966.968038:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671378048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.968061:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671378048:12345-0@lo:400:kworker.0 Request processed in 23us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774966.968066:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00080000:2.0:1785774966.968084:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785774966.968087:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774966.968089:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774966.968092:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774966.968133:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671377152:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.968144:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671377664:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.968153:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671378176:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.968201:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671377536:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.968211:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671378048:0@lo:400:kworker.0 00000100:00100000:3.0:1785774966.970407:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774966.970435:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671377792:0@lo:400:kworker.0 00000100:00100000:3.0:1785774966.970463:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774966.970489:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377792 00000100:00100000:3.0:1785774966.970494:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377792 00000100:00100000:3.0:1785774966.970537:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1785774966.970545:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671377792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774966.970580:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671377792:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774966.970586:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1785774966.970627:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671377792:0@lo:400:kworker.0 00000100:00100000:3.0:1785774966.970635:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b771f710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671378304:0@lo:400:kworker.0 00000100:00100000:3.0:1785774966.970659:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774966.970680:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378304 00000100:00100000:3.0:1785774966.970695:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378304 00000100:00100000:3.0:1785774966.970721:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1785774966.970727:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671378304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774966.970848:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671378304:12345-0@lo:400:kworker.0 Request processed in 121us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774966.970854:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1785774966.970878:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b771f710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671378304:0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.971480:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377280 00000100:00100000:2.0:1785774966.971484:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377280 00000100:00100000:2.0:1785774966.971507:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1785774966.971512:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671377280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774966.971547:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671377280:12345-0@lo:400:kworker.0 Request processed in 36us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774966.971553:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00080000:2.0:1785774966.971580:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774966.971584:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774966.971612:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671377280:0@lo:400:kworker.0 00000100:00100000:0.0:1785774966.975565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671377024 00000100:00100000:0.0:1785774966.975578:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671377024 00000100:00100000:0.0:1785774966.975642:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1785774966.975651:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671377024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774966.976792:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671377024:12345-0@lo:400:kworker.0 Request processed in 1139us (10543us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774966.976801:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1785774966.983856:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671377024:0@lo:400:kworker.0 00000100:00100000:3.0:1785774967.437227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774967.437273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774967.437300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774967.437323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774967.437347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774967.437373:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648648960 00000100:00100000:3.0:1785774967.437382:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648648960 00000100:00100000:3.0:1785774967.437442:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648648832 00000100:00100000:3.0:1785774967.437446:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648648832 00000100:00100000:3.0:1785774967.437468:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1255 00000100:00100000:3.0:1785774967.437476:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648648960:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774967.437543:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648648960:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774967.437550:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1255 00000100:00100000:3.0:1785774967.437566:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1256 00000100:00100000:3.0:1785774967.437572:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648648832:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774967.437610:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648648832:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774967.437617:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1256 00000100:00100000:3.0:1785774967.437638:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649216 00000100:00100000:3.0:1785774967.437641:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649216 00000100:00100000:3.0:1785774967.437663:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649088 00000100:00100000:3.0:1785774967.437665:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649088 00000100:00100000:3.0:1785774967.437683:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 782 00000100:00100000:3.0:1785774967.437689:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648649216:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774967.437713:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648649216:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774967.437719:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 782 00000100:00100000:3.0:1785774967.437730:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 783 00000100:00100000:3.0:1785774967.437735:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648649088:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774967.437756:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648649088:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 21us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774967.437765:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 783 00000100:00080000:3.0:1785774967.437780:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785774967.437783:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774967.437786:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785774967.437787:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774967.438100:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648648704 00000100:00100000:0.0:1785774967.438104:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648648704 00000100:00100000:0.0:1785774967.438136:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 615 00000100:00100000:0.0:1785774967.438143:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648648704:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774967.438196:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648648704:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 54us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774967.438203:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 615 00010000:00010000:3.0:1785774967.591414:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774967.973016:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774967.973042:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671378560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774967.973313:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671378688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774967.973459:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774967.973617:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378688 00000100:00100000:0.0:1785774967.973625:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378688 00000100:00100000:0.0:1785774967.973680:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1785774967.973688:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1872519671378688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774967.973713:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774967.973774:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1872519671378688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774967.973780:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1785774967.973893:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671378688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774967.974065:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774967.974237:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378560 00000100:00100000:3.0:1785774967.974242:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378560 00000100:00100000:3.0:1785774967.974304:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1785774967.974310:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671378560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774967.974321:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774967.974356:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671378560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774967.974363:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1785774967.974413:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671378560:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1785774967.976883:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969952 is committed 00000001:00080000:1.0:1785774967.977031:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984189 is committed 00010000:00010000:1.0:1785774968.612823:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774968.996670:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671378816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774968.996760:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774968.996844:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378816 00000100:00100000:0.0:1785774968.996853:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378816 00000100:00100000:0.0:1785774968.996904:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:0.0:1785774968.996914:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671378816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774968.996955:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774968.997001:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671378816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774968.997009:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000100:00100000:0.0:1785774968.997058:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671378816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774968.997177:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774968.997188:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671378944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774968.997223:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774968.997259:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671378944 00000100:00100000:2.0:1785774968.997263:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671378944 00000100:00100000:2.0:1785774968.997303:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1785774968.997309:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671378944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774968.997332:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774968.997366:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671378944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774968.997374:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00080000:2.0:1785774968.997396:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774968.997418:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671378944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774969.511955:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671379072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774969.512050:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774969.512301:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379072 00000100:00100000:3.0:1785774969.512311:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379072 00000100:00100000:3.0:1785774969.512391:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1785774969.512403:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671379072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774969.512432:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1785774969.512501:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671379072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774969.512509:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1785774969.512568:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671379072:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1785774969.518132:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1785774969.638323:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774970.267252:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774970.267552:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649344 00000100:00100000:0.0:1785774970.267573:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649344 00000100:00100000:0.0:1785774970.267671:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24151 00000100:00100000:0.0:1785774970.267682:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:21861:x1872519648649344:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774970.267708:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774970.267733:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c62a expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774970.267818:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774970.267835:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774970.267851:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774970.267911:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:0.0:1785774970.267915:0:21784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774970.267940:0:21784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774970.267966:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 16 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774970.267986:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 15 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774970.267995:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774970.267998:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774970.268001:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ce00, rc 0) 00000100:00100000:0.0:1785774970.268061:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:21861:x1872519648649344:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 383us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774970.268068:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24151 00000100:00080000:3.0:1785774970.268303:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774970.272778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774970.272863:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649472 00000100:00100000:3.0:1785774970.272875:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649472 00000100:00100000:3.0:1785774970.272939:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24152 00000100:00100000:3.0:1785774970.272951:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:21861:x1872519648649472:12345-192.168.202.31@tcp:41:lfs.0 00000004:00000024:3.0:1785774970.272998:0:8627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:3.0:1785774970.273081:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:21861:x1872519648649472:12345-192.168.202.31@tcp:41:lfs.0 Request processed in 132us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774970.273089:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24152 00000100:00100000:3.0:1785774970.276098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774970.276206:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649600 00000100:00100000:2.0:1785774970.276225:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649600 00000100:00100000:2.0:1785774970.276314:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24153 00000100:00100000:2.0:1785774970.276325:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21861:x1872519648649600:12345-192.168.202.31@tcp:41:lfs.0 00000004:00000024:2.0:1785774970.276370:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:2.0:1785774970.276457:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21861:x1872519648649600:12345-192.168.202.31@tcp:41:lfs.0 Request processed in 133us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774970.276465:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24153 00000100:00080000:3.0:1785774970.276580:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774970.286625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774970.286812:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649728 00000100:00100000:0.0:1785774970.286824:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649728 00000100:00100000:0.0:1785774970.286953:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 678 00000100:00100000:0.0:1785774970.286964:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21861:x1872519648649728:12345-192.168.202.31@tcp:13:lfs.0 00002000:00000024:0.0:1785774970.287004:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774970.287093:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21861:x1872519648649728:12345-192.168.202.31@tcp:13:lfs.0 Request processed in 131us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774970.287100:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 678 00000100:00080000:3.0:1785774970.292206:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785774970.296311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774970.298737:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649856 00000100:00100000:3.0:1785774970.298753:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649856 00000100:00100000:2.0:1785774970.302336:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 679 00000100:00100000:2.0:1785774970.302353:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21861:x1872519648649856:12345-192.168.202.31@tcp:13:lfs.0 00002000:00000024:2.0:1785774970.302398:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1785774970.302505:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:21861:x1872519648649856:12345-192.168.202.31@tcp:13:lfs.0 Request processed in 156us (6207us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774970.302513:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 679 00000100:00080000:0.0:1785774970.308289:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785774970.662458:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774971.689998:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774972.069391:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774972.069429:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671379200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774972.069519:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774972.069720:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379200 00000100:00100000:1.0:1785774972.069729:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379200 00000100:00100000:1.0:1785774972.069792:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:1.0:1785774972.069807:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671379200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774972.069848:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774972.069900:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671379200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774972.069907:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00100000:1.0:1785774972.069955:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671379200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774972.070461:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671379456:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.070492:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774972.070515:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671379968:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.070533:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774972.070562:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671380480:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.070584:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774972.070705:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671379712:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.070746:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1785774972.070752:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671379584:0@lo:400:kworker.0 00000100:00100000:0.0:1785774972.074457:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379456 00000100:00100000:0.0:1785774972.074471:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379456 00000100:00100000:0.0:1785774972.074536:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379968 00000100:00100000:0.0:1785774972.074540:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379968 00000100:00100000:0.0:1785774972.074582:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380480 00000100:00100000:0.0:1785774972.074585:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380480 00000100:00100000:0.0:1785774972.074621:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1785774972.074632:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671379456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.075790:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774972.078590:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671380224:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.078655:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774972.078681:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671380736:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.078701:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774972.078729:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1785774972.078736:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671379328:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.078761:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774972.078781:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671379840:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.078812:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774972.078824:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671380352:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.078843:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774972.078881:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379840 00000100:00100000:3.0:1785774972.078888:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379840 00000100:00100000:3.0:1785774972.078929:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380352 00000100:00100000:3.0:1785774972.078932:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380352 00000100:00100000:3.0:1785774972.078947:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1785774972.078957:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671379968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.079007:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671379968:12345-0@lo:400:kworker.0 Request processed in 52us (8472us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.079015:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1785774972.079032:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1785774972.079038:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671380480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.079063:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671380480:12345-0@lo:400:kworker.0 Request processed in 26us (8478us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.079069:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1785774972.079077:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1785774972.079082:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671379840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.079111:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1872519671379840:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.079117:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1785774972.079129:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:3.0:1785774972.079135:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671380352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.079183:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1872519671380352:12345-0@lo:400:kworker.0 Request processed in 48us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.079190:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1785774972.079700:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774972.079721:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671380096:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.079749:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774972.079771:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671380608:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.079792:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774972.079843:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671379968:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.079855:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671380480:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.079889:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379584 00000100:00100000:1.0:1785774972.079892:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379584 00000100:00100000:1.0:1785774972.079918:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1785774972.079923:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671379584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.079958:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1872519671379584:12345-0@lo:400:kworker.0 Request processed in 35us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774972.079964:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1785774972.079987:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1872519671379584:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.080892:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379712 00000100:00100000:3.0:1785774972.080898:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379712 00000100:00100000:3.0:1785774972.080939:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:3.0:1785774972.080947:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671379712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.080992:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671379712:12345-0@lo:400:kworker.0 Request processed in 47us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.081000:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:3.0:1785774972.081019:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380224 00000100:00100000:3.0:1785774972.081023:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380224 00000100:00100000:3.0:1785774972.081050:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380736 00000100:00100000:3.0:1785774972.081053:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380736 00000100:00100000:3.0:1785774972.081069:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380096 00000100:00100000:3.0:1785774972.081071:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380096 00000100:00100000:3.0:1785774972.081089:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380608 00000100:00100000:3.0:1785774972.081092:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380608 00000100:00100000:3.0:1785774972.081111:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1785774972.081117:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671380224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.081151:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671380224:12345-0@lo:400:kworker.0 Request processed in 34us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.081172:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1785774972.081184:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1785774972.081190:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671380736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774972.082117:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671379456:12345-0@lo:400:kworker.0 Request processed in 7482us (11619us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774972.082128:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00080000:0.0:1785774972.082180:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774972.082185:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774972.082188:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774972.082191:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1785774972.082313:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671379456:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.082531:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671380736:12345-0@lo:400:kworker.0 Request processed in 1341us (3827us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.082539:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1785774972.082563:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1785774972.082571:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671380096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.083289:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671380096:12345-0@lo:400:kworker.0 Request processed in 718us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.083297:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1785774972.083310:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1785774972.083317:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671380608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.083347:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671380608:12345-0@lo:400:kworker.0 Request processed in 30us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.083353:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1785774972.083380:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671379328 00000100:00100000:3.0:1785774972.083388:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671379328 00000100:00100000:1.0:1785774972.083691:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671380096:0@lo:400:kworker.0 00000100:00100000:1.0:1785774972.083702:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671380608:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.083749:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1785774972.083757:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671379328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.083793:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3653:x1872519671379328:12345-0@lo:400:kworker.0 Request processed in 37us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774972.083799:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1785774972.084341:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed609441-cebf-42ae-a19c-5d7643dc37b0:3653:1872519671379328:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.084356:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1872519671379840:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.084369:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1872519671380352:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.084381:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671379712:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.084392:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969952 gen 2 00000004:00080000:3.0:1785774972.084398:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b7603d7b480, transno 4294969952 00000100:00100000:3.0:1785774972.084904:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671380224:0@lo:400:kworker.0 00000100:00100000:3.0:1785774972.084921:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671380736:0@lo:400:kworker.0 00000100:00100000:2.0:1785774972.555910:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774972.555967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774972.555999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774972.556020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774972.556362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774972.556401:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648650496 00000100:00100000:2.0:1785774972.556418:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648650496 00000100:00100000:2.0:1785774972.557738:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648650368 00000100:00100000:2.0:1785774972.557747:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648650368 00000100:00100000:2.0:1785774972.557780:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 788 00000100:00100000:2.0:1785774972.557792:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648650496:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774972.557910:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648650496:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 121us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774972.557918:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 788 00000100:00100000:2.0:1785774972.557937:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 789 00000100:00100000:2.0:1785774972.557943:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648650368:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774972.557967:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648650368:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774972.557973:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 789 00000100:00100000:2.0:1785774972.557998:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648650240 00000100:00100000:2.0:1785774972.558001:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648650240 00000100:00100000:2.0:1785774972.558030:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648650112 00000100:00100000:2.0:1785774972.558033:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648650112 00000100:00100000:2.0:1785774972.558054:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1263 00000100:00100000:2.0:1785774972.558060:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648650240:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774972.558089:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2417:x1872519648650240:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774972.558094:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1263 00000100:00100000:2.0:1785774972.558105:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1264 00000100:00100000:2.0:1785774972.558110:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648650112:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774972.558131:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648650112:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 21us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774972.558137:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1264 00000100:00080000:2.0:1785774972.558157:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785774972.558178:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774972.558181:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785774972.558183:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774972.558316:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648649984 00000100:00100000:0.0:1785774972.558321:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648649984 00000100:00100000:0.0:1785774972.558355:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 617 00000100:00100000:0.0:1785774972.558362:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648649984:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774972.558392:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648649984:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774972.558403:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 617 00010000:00010000:1.0:1785774972.710249:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774973.093309:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671380992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785774973.093403:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774973.093552:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380992 00000100:00100000:0.0:1785774973.093563:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380992 00000100:00100000:0.0:1785774973.093624:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1785774973.093634:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671380992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774973.093671:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774973.093721:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671380992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774973.093729:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1785774973.094088:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671380992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774973.094177:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671380864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774973.094288:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774973.094363:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671380864 00000100:00100000:3.0:1785774973.094368:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671380864 00000100:00100000:3.0:1785774973.094403:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1785774973.094409:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671380864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1785774973.094421:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774973.094458:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671380864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774973.094466:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1785774973.095228:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671380864:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1785774973.734421:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774974.116846:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774974.116871:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671381120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774974.116943:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774974.117013:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671381120 00000100:00100000:0.0:1785774974.117034:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671381120 00000100:00100000:0.0:1785774974.117082:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:0.0:1785774974.117090:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671381120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774974.117121:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774974.117188:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671381120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774974.117195:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00100000:0.0:1785774974.117242:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671381120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774974.120351:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671381248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774974.120411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774974.120511:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671381248 00000100:00100000:0.0:1785774974.120518:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671381248 00000100:00100000:0.0:1785774974.120581:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1785774974.120590:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671381248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1785774974.120615:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1785774974.120658:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671381248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774974.120665:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1785774974.120710:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671381248:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1785774974.120760:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774974.637413:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774974.637436:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671381376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774974.637506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774974.637602:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671381376 00000100:00100000:1.0:1785774974.637610:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671381376 00000100:00100000:1.0:1785774974.637671:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1785774974.637679:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671381376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785774974.637700:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774974.637740:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671381376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774974.637748:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00080000:2.0:1785774974.637796:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774974.637827:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671381376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785774974.757983:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774975.780526:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774976.810628:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774977.188288:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785774977.188310:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671381504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774977.188434:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774977.188510:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671381504 00000100:00100000:1.0:1785774977.188517:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671381504 00000100:00100000:1.0:1785774977.188558:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:1.0:1785774977.188565:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671381504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774977.188597:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443893248 avail 1297653760 00000100:00100000:1.0:1785774977.188638:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671381504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774977.188645:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:1.0:1785774977.188687:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671381504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774977.188899:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671381760:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.188929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774977.188947:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671382272:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.188964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774977.188984:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671382784:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.189003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774977.189020:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1785774977.189025:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760275b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671381888:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.189043:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774977.189058:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671382400:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.189078:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774977.189092:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671382912:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.189109:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774977.189135:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671381760 00000100:00100000:0.0:1785774977.189139:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671381760 00000100:00100000:0.0:1785774977.189190:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382272 00000100:00100000:0.0:1785774977.189193:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382272 00000100:00100000:0.0:1785774977.189219:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382784 00000100:00100000:0.0:1785774977.189222:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382784 00000100:00100000:0.0:1785774977.189232:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671381888 00000100:00100000:0.0:1785774977.189234:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671381888 00000100:00100000:0.0:1785774977.189245:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1785774977.189250:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671381760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.189285:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671381760:12345-0@lo:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.189291:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1785774977.189303:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1785774977.189308:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671382272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.189335:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671382272:12345-0@lo:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.189341:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1785774977.189352:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1785774977.189358:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671382784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.189830:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671381632:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.189866:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774977.189892:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671382144:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.189913:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774977.189924:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671382656:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.189944:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774977.189956:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1785774977.189963:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7602758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671382016:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.189985:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774977.189999:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671382528:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.190017:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774977.190035:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671383040:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.190056:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774977.190080:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382400 00000100:00100000:1.0:1785774977.190085:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382400 00000100:00100000:1.0:1785774977.190112:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382912 00000100:00100000:1.0:1785774977.190115:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382912 00000100:00100000:1.0:1785774977.190130:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382528 00000100:00100000:1.0:1785774977.190132:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382528 00000100:00100000:1.0:1785774977.190148:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383040 00000100:00100000:1.0:1785774977.190151:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383040 00000100:00100000:1.0:1785774977.190188:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1785774977.190195:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671382400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.190226:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671382400:12345-0@lo:400:kworker.0 Request processed in 32us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774977.190233:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1785774977.190246:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1785774977.190252:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671382912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.190279:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671382912:12345-0@lo:400:kworker.0 Request processed in 27us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774977.190284:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1785774977.190295:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1785774977.190301:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671382528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.190332:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671382528:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774977.190338:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1785774977.190351:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1785774977.190357:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671383040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.190844:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671382784:12345-0@lo:400:kworker.0 Request processed in 1485us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.190851:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1785774977.190863:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382144 00000100:00100000:0.0:1785774977.190867:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382144 00000100:00100000:0.0:1785774977.190881:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382656 00000100:00100000:0.0:1785774977.190883:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382656 00000100:00100000:0.0:1785774977.190896:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1785774977.190903:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671381888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.190931:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1872519671381888:12345-0@lo:400:kworker.0 Request processed in 28us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.190936:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1785774977.190948:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1785774977.190954:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671382144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.190980:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671382144:12345-0@lo:400:kworker.0 Request processed in 27us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.190986:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1785774977.190998:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1785774977.191004:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671382656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191029:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671382656:12345-0@lo:400:kworker.0 Request processed in 26us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.191034:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00080000:0.0:1785774977.191069:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774977.191073:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774977.191075:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774977.191077:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774977.191101:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760275b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1872519671381888:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191111:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671382400:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191120:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671382912:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191130:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671381760:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191139:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671382272:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191147:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671382784:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191205:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671381632 00000100:00100000:0.0:1785774977.191209:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671381632 00000100:00100000:0.0:1785774977.191234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1785774977.191240:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671381632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.191268:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671381632:12345-0@lo:400:kworker.0 Request processed in 28us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.191274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1785774977.191300:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671382016 00000100:00100000:0.0:1785774977.191303:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671382016 00000100:00100000:0.0:1785774977.191328:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:0.0:1785774977.191334:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671382016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.192893:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671383040:12345-0@lo:400:kworker.0 Request processed in 2533us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774977.192901:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1785774977.192932:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671382016:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.192942:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671382528:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.192950:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671383040:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.192958:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671381632:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.192968:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7602759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671382144:0@lo:400:kworker.0 00000100:00100000:1.0:1785774977.192977:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671382656:0@lo:400:kworker.0 00000100:00100000:0.0:1785774977.193894:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671382016:12345-0@lo:400:kworker.0 Request processed in 29us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.193904:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00100000:1.0:1785774977.674780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774977.674825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774977.674855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774977.674877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774977.674895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774977.674922:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648651136 00000100:00100000:1.0:1785774977.674930:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648651136 00000100:00100000:1.0:1785774977.674978:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648651008 00000100:00100000:1.0:1785774977.674980:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648651008 00000100:00100000:1.0:1785774977.674998:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 794 00000100:00100000:1.0:1785774977.675006:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648651136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774977.675241:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648650624 00000100:00100000:0.0:1785774977.675246:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648650624 00000100:00100000:0.0:1785774977.675277:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 619 00000100:00100000:0.0:1785774977.675284:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648650624:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774977.675383:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648650880 00000100:00100000:2.0:1785774977.675388:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648650880 00000100:00100000:2.0:1785774977.675419:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648650752 00000100:00100000:2.0:1785774977.675422:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648650752 00000100:00100000:2.0:1785774977.675444:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1271 00000100:00100000:2.0:1785774977.675452:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648650880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774977.675561:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648651136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 554us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774977.675569:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 794 00000100:00100000:1.0:1785774977.675587:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 795 00000100:00100000:1.0:1785774977.675594:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648651008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774977.676362:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648650624:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1074us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.676371:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 619 00000100:00100000:0.0:1785774977.676405:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1272 00000100:00100000:0.0:1785774977.676413:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648650752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774977.676442:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648650752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774977.676448:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1272 00000100:00080000:0.0:1785774977.676467:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785774977.676483:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785774977.676486:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785774977.676488:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774977.679891:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648650880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 4430us (5055us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774977.679907:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1271 00000100:00100000:1.0:1785774977.682940:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:2416:x1872519648651008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 7338us (8035us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774977.682954:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 795 00010000:00010000:0.0:1785774977.828347:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774978.215853:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671383168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774978.215937:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774978.216927:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383168 00000100:00100000:0.0:1785774978.216936:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383168 00000100:00100000:0.0:1785774978.216995:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1785774978.217003:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671383296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774978.217004:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671383168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774978.217035:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1785774978.217038:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774978.217078:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671383168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774978.217086:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1785774978.217098:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383296 00000100:00100000:0.0:1785774978.217100:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383296 00000100:00100000:3.0:1785774978.217103:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671383168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774978.217114:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1785774978.217118:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671383296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774978.217127:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1785774978.217182:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671383296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774978.217189:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1785774978.217212:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671383296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785774978.853330:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774979.239382:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671383424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774979.239448:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774979.245577:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383424 00000100:00100000:0.0:1785774979.245593:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383424 00000100:00100000:0.0:1785774979.245662:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:0.0:1785774979.245672:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671383424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774979.245711:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445056512 avail 1298817024 00000100:00100000:0.0:1785774979.245792:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671383424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (6343us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.245799:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00100000:1.0:1785774979.247111:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671383552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774979.247156:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774979.247417:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671383424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774979.248288:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383552 00000100:00100000:0.0:1785774979.248295:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383552 00000100:00100000:0.0:1785774979.249926:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1785774979.249937:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671383552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1785774979.249965:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00080000:1.0:1785774979.250120:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774979.250977:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671383552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1040us (3818us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.250985:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1785774979.251071:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671383552:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1785774979.283526:0:23320:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63c: test sync_on_close=1 ================= 12:36:16 (1785774976) 00000100:00100000:1.0:1785774979.700933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.701014:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648651392 00000100:00100000:0.0:1785774979.701024:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648651392 00000100:00100000:0.0:1785774979.701092:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24154 00000100:00100000:0.0:1785774979.701102:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:22346:x1872519648651392:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:0.0:1785774979.701258:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671383680:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774979.701304:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774979.701350:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606023240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774979.701374:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383680 00000100:00100000:0.0:1785774979.701377:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383680 00000100:00100000:0.0:1785774979.701402:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:0.0:1785774979.701407:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671383680:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774979.701463:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671383680:12345-0@lo:1000:mdt00_001.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.701470:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00100000:0.0:1785774979.701523:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671383680:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774979.701565:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671383808:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774979.701588:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774979.701603:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606023240 going to sleep for 11 seconds 00000100:00100000:0.0:1785774979.701615:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383808 00000100:00100000:0.0:1785774979.701618:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383808 00000100:00100000:0.0:1785774979.701638:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:0.0:1785774979.701643:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671383808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774979.701734:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671383808:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (144us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785774979.701740:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00100000:0.0:1785774979.701761:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671383808:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1785774979.701800:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.701810:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.701819:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774979.701829:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671383936:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1785774979.701849:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774979.701862:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774979.701872:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671383936 00000100:00100000:0.0:1785774979.701875:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671383936 00000100:00100000:0.0:1785774979.701894:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1785774979.701899:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6530:x1872519671383936:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774979.701907:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774979.701920:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d0a1cc6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.701944:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 14 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.701953:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.701973:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 14 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.701985:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 14 pid: 21784 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774979.701996:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671384064:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774979.702037:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606023240 going to sleep for 11 seconds 00000100:00080000:1.0:1785774979.702436:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774979.713328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.713734:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605d500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6534:1872519671384064:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774979.713766:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.713777:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774979.713780:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774979.713784:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.713792:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9da00, rc 0) 00000100:00100000:0.0:1785774979.713855:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6530:x1872519671383936:12345-0@lo:101:mdt00_001.0 Request processed in 11955us (12005us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.713863:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00100000:3.0:1785774979.718503:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671383936:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1785774979.718531:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.718546:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774979.720224:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648651520 00000100:00100000:1.0:1785774979.720237:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648651520 00010000:00010000:1.0:1785774979.720348:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 15 pid: 21784 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774979.720390:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1678 00000100:00100000:1.0:1785774979.720399:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2419:x1872519648651520:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774979.720415:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774979.720421:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 15 pid: 21784 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.720435:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 15 pid: 21784 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.720459:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1cbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c62a expref: 15 pid: 21784 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.720483:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774979.720490:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.720502:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.720511:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.720543:0:9541:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774979.720556:0:9541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671384192:0@lo:105: 00000100:00100000:1.0:1785774979.721749:0:9541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774979.721792:0:9541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7602559480 going to sleep for 11 seconds 00000100:00100000:3.0:1785774979.721949:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671384192 00000100:00100000:3.0:1785774979.721956:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671384192 00000100:00100000:3.0:1785774979.722011:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1785774979.722018:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671384192:12345-0@lo:105: 00010000:00010000:3.0:1785774979.722031:0:6512:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.722041:0:6512:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.722050:0:6512:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.722057:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.722064:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.722070:0:6512:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.722097:0:6512:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b7603f9dc00) 00010000:00010000:2.0:1785774979.722251:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.722262:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774979.722287:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1785774979.722325:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.722333:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.722355:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774979.722372:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384320:0@lo:101:mdt00_001.0 00000100:00080000:0.0:1785774979.730836:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785774979.735808:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774979.735847:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770ef1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1785774979.735922:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671384320 00000100:00100000:0.0:1785774979.735931:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671384320 00000100:00100000:0.0:1785774979.736003:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:0.0:1785774979.736011:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6530:x1872519671384320:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1785774979.736032:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774979.736074:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1cdb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b7109e1d0a1cd4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.736103:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1cdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cd4 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.736117:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1cdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cd4 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.736125:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9b77131b5d00) 00010000:00010000:0.0:1785774979.736128:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774979.736132:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9de00, rc 0) 00000100:00100000:0.0:1785774979.736199:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384320:12345-0@lo:101:mdt00_001.0 Request processed in 189us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.736206:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1785774979.736313:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384320:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1785774979.736330:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.736341:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774979.736364:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1785774979.736409:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384448:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.736441:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774979.736466:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770ef1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1785774979.737100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9541:x1872519671384192:12345-0@lo:105: Request processed in 15081us (15350us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774979.737110:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1785774979.737192:0:9541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9541:1872519671384192:0@lo:105: 00010000:00010000:2.0:1785774979.737206:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774979.737262:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2419:x1872519648651520:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 16862us (23940us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774979.737271:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1678 00000100:00100000:0.0:1785774979.737461:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671384448 00000100:00100000:0.0:1785774979.737467:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671384448 00000100:00100000:0.0:1785774979.737514:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:0.0:1785774979.737521:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785774979.737597:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384448:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.737603:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000100:00100000:3.0:1785774979.737710:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384448:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774979.737753:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384576:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774979.737793:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774979.737815:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605da5480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774979.737864:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671384576 00000100:00100000:2.0:1785774979.737868:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671384576 00000100:00100000:2.0:1785774979.737898:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:2.0:1785774979.737904:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.737996:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384576:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (201us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774979.738002:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00100000:2.0:1785774979.738025:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384576:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738088:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384704:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738128:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774979.738141:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770ef1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774979.738151:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671384704 00000100:00100000:2.0:1785774979.738154:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671384704 00000100:00100000:2.0:1785774979.738193:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:2.0:1785774979.738198:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738253:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384704:12345-0@lo:1000:mdt00_001.0 Request processed in 55us (123us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785774979.738260:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00100000:2.0:1785774979.738282:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384704:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738323:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384832:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738347:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774979.738361:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770ef1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774979.738371:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671384832 00000100:00100000:2.0:1785774979.738374:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671384832 00000100:00100000:2.0:1785774979.738390:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:2.0:1785774979.738396:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738443:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384832:12345-0@lo:1000:mdt00_001.0 Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774979.738449:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:2.0:1785774979.738472:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384832:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738519:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384960:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785774979.738541:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774979.738554:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770ef1e900 going to sleep for 11 seconds 00000100:00100000:3.0:1785774979.738696:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671384960 00000100:00100000:3.0:1785774979.738701:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671384960 00000100:00100000:3.0:1785774979.738720:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:3.0:1785774979.738726:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774979.743230:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671384960:12345-0@lo:1000:mdt00_001.0 Request processed in 4494us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774979.743246:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00100000:0.0:1785774979.745747:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7735aaa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671384960:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785774979.747534:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671385088:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785774979.747660:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774979.747752:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7602559480 going to sleep for 11 seconds 00000100:00100000:2.0:1785774979.750744:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671385088 00000100:00100000:2.0:1785774979.750755:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671385088 00000100:00100000:3.0:1785774979.752151:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00100000:3.0:1785774979.752194:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671385088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785774979.752311:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:6530:x1872519671385088:12345-0@lo:1000:mdt00_001.0 Request processed in 150us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774979.752319:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00100000:2.0:1785774979.752420:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76054b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6530:1872519671385088:0@lo:1000:mdt00_001.0 00000040:00080000:2.0:1785774979.752918:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].407, 984 off610272 00000040:00080000:2.0:1785774979.752966:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].407, 1136 off657536 00000004:00080000:2.0:1785774979.752971:0:6530:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b770ef1ea80 with version 779 00000004:00080000:3.0:1785774979.753190:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 779 rpc_version 779 00000020:00100000:3.0:1785774979.753239:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1785774979.753246:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b773fb89880 x1872519671385344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785774979.753269:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb89880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671385344:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1785774979.753307:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774979.753337:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605da5180 going to sleep for 11 seconds 00000100:00100000:2.0:1785774979.753392:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671385344 00000100:00100000:2.0:1785774979.753398:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671385344 00000100:00100000:2.0:1785774979.753434:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:2.0:1785774979.753440:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:7474:x1872519671385344:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1785774979.756565:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:7474:x1872519671385344:12345-0@lo:1000:osp_up0-1.0 Request processed in 3118us (3250us total) trans 4294984190 rc 0/0 00000100:00100000:2.0:1785774979.756577:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00100000:0.0:1785774979.757149:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671385472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785774979.757215:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774979.757401:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671385472 00000100:00100000:1.0:1785774979.757408:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671385472 00000100:00100000:1.0:1785774979.757461:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1785774979.757469:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671385472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785774979.757501:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 172032 granted 135653056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1785774979.757557:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671385472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (341us total) trans 0 rc 0/0 00000100:00080000:0.0:1785774979.757631:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774979.757882:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1785774979.757928:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671385472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774979.758156:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb89880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671385344:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1785774979.763355:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763379:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763395:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774979.763416:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096ba536d reply state 00000000c38bfcff transno 4294968548 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763428:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763434:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7711ae8300) 00010000:00010000:3.0:1785774979.763437:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774979.763441:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785774979.763446:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000004:00080000:3.0:1785774979.763456:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1785774979.763468:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763488:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763496:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763572:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785774979.763578:0:6530:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1785774979.763584:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.763591:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774979.763709:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22346:x1872519648651392:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 62605us (62780us total) trans 4294968548 rc 0/0 00000100:00100000:3.0:1785774979.763718:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24154 00010000:00010000:2.0:1785774979.767236:0:6517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774979.767251:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.767262:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9dc00 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774979.767517:0:6517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774979.767530:0:6517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.773758:0:6517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.773775:0:6517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1785774979.773847:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671385600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774979.773916:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774979.774001:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671385600 00000100:00100000:1.0:1785774979.774010:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671385600 00000100:00100000:1.0:1785774979.774076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1785774979.774085:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3653:x1872519671385600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785774979.774099:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774979.774122:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1ccd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7b7109e1d0a1cc6 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.774152:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774979.774156:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774979.775657:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.775671:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7603f9dc00/0x7b7109e1d0a1cc6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7b7109e1d0a1ccd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.775688:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774979.775690:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785774979.775692:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774979.777355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3653:x1872519671385600:12345-0@lo:103:ldlm_bl.0 Request processed in 3264us (3431us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774979.777367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1785774979.780361:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671385600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785774979.831152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.831310:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648651648 00000100:00100000:0.0:1785774979.831320:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648651648 00000100:00100000:0.0:1785774979.831381:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24155 00000100:00100000:0.0:1785774979.831392:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22351:x1872519648651648:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774979.831413:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774979.831436:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c631 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.831520:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1cf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.831534:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.831545:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774979.831598:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:0.0:1785774979.831602:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774979.831622:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.831646:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c631 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.831663:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c631 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.831672:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774979.831675:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774979.831678:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c000, rc 0) 00000100:00100000:0.0:1785774979.831740:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76054b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22351:x1872519648651648:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 350us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.831747:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24155 00000100:00100000:1.0:1785774979.841661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.841756:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648651904 00000100:00100000:0.0:1785774979.841765:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648651904 00000100:00100000:0.0:1785774979.841831:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24156 00000100:00100000:0.0:1785774979.841841:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22351:x1872519648651904:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774979.841862:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774979.841865:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785774979.841889:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1cf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c631 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.841908:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774979.841913:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774979.841925:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1cf7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c638 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.842045:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.842058:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.842067:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.842077:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.842086:0:21784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1cdb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7b7109e1d0a1cd4 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.842093:0:21784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.842120:0:21784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1cdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7b7109e1d0a1cd4 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774979.842134:0:21784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21784:1872519671385728:0@lo:104: 00000100:00100000:0.0:1785774979.842536:0:21784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774979.842588:0:21784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606023240 going to sleep for 11 seconds 00000100:00100000:3.0:1785774979.842865:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671385728 00000100:00100000:3.0:1785774979.842871:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671385728 00000100:00100000:3.0:1785774979.842906:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1785774979.842913:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:21784:x1872519671385728:12345-0@lo:104: 00010000:00010000:3.0:1785774979.842926:0:16514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774979.843005:0:16514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785774979.843011:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:21784:x1872519671385728:12345-0@lo:104: Request processed in 99us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774979.843018:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00010000:00010000:2.0:1785774979.843208:0:14708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785774979.843215:0:14708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.843224:0:14708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745200 already unused, calling callback (ffffffffc18c3ed0) 00010000:00010000:2.0:1785774979.843229:0:14708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774979.843237:0:14708:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.843269:0:14708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.843276:0:14708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785774979.843300:0:14708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.843308:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9b7711745200/0x7b7109e1d0a1cd4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7b7109e1d0a1cdb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.843324:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774979.843325:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785774979.843327:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774979.843490:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671385856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785774979.843537:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774979.843688:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671385856 00000100:00100000:2.0:1785774979.843692:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671385856 00010000:00010000:2.0:1785774979.843712:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1cdb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7b7109e1d0a1cd4 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774979.843743:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1785774979.843750:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7707d73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3654:x1872519671385856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785774979.843761:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1785774979.844586:0:21784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21784:1872519671385728:0@lo:104: 00010000:00010000:0.0:1785774979.844609:0:21784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774979.854953:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984190 is committed 00010000:00010000:2.0:1785774979.855102:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1cdb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7b7109e1d0a1cd4 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.855131:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9b77131b5d00) 00010000:00010000:2.0:1785774979.855137:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.855152:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.855216:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.855240:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774979.855279:0:21784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855291:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774979.855331:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7707d73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3654:x1872519671385856:12345-0@lo:103:ldlm_bl.0 Request processed in 11579us (11791us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.855389:0:21784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21784:1872519671385984:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1785774979.855436:0:21784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774979.855465:0:21784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7606023600 going to sleep for 11 seconds 00000100:00100000:0.0:1785774979.855502:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671385984 00000100:00100000:0.0:1785774979.855510:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671385984 00000100:00100000:0.0:1785774979.855583:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:0.0:1785774979.855592:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:21784:x1872519671385984:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1785774979.855612:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:0.0:1785774979.855671:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:21784:x1872519671385984:12345-0@lo:1000:mdt00_005.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.855679:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00100000:0.0:1785774979.855719:0:21784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760605ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21784:1872519671385984:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1785774979.855735:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671385856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785774979.855786:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1d0c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855890:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1d0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855901:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1d0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855913:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855922:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855928:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855933:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774979.855936:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855942:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855949:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774979.855951:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774979.855955:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855959:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1cfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855967:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855973:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855978:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855982:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774979.855985:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855990:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.855995:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9b77131b5d00) 00010000:00010000:0.0:1785774979.855997:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774979.855999:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.856003:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.856039:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1cf7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c638 expref: 16 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.856051:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9c000/0x7b7109e1d0a1d0c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c638 expref: 15 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.856058:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5100) 00010000:00010000:0.0:1785774979.856061:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774979.856063:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c000, rc 0) 00000100:00100000:0.0:1785774979.856109:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22351:x1872519648651904:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 14270us (14457us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.856115:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24156 00000100:00100000:3.0:1785774979.876236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.876306:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648652160 00000100:00100000:0.0:1785774979.876316:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648652160 00000100:00100000:0.0:1785774979.876374:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24157 00000100:00100000:0.0:1785774979.876383:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22351:x1872519648652160:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774979.876407:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774979.876425:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d13 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774979.876534:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:0.0:1785774979.876557:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d13 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c63f expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.876581:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7711ae8300) 00010000:00010000:0.0:1785774979.876584:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774979.876589:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d13 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c63f expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.876602:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9dc00, rc 0) 00000100:00100000:0.0:1785774979.876656:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22351:x1872519648652160:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 274us (430us total) trans 0 rc 301/301 00000100:00100000:0.0:1785774979.876663:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24157 00010000:00010000:0.0:1785774979.876717:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774979.902258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.902396:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648652288 00000100:00100000:0.0:1785774979.902406:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648652288 00000100:00100000:0.0:1785774979.902465:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24158 00000100:00100000:0.0:1785774979.902485:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22351:x1872519648652288:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774979.902506:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774979.902525:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c646 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.902596:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.902610:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.902621:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774979.902662:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 266240 00000004:00200000:0.0:1785774979.902666:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774979.902686:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.902708:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c646 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.902726:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603f9d200/0x7b7109e1d0a1d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c646 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.902734:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:0.0:1785774979.902737:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785774979.902741:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9d200, rc 0) 00000100:00100000:0.0:1785774979.902809:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22351:x1872519648652288:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 336us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774979.902816:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24158 00000100:00100000:1.0:1785774979.949095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774979.949272:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648652544 00000100:00100000:2.0:1785774979.949282:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648652544 00000100:00100000:2.0:1785774979.949390:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24159 00000100:00100000:2.0:1785774979.949402:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22351:x1872519648652544:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1785774979.949423:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774979.949444:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1d28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c64d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949545:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949569:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949581:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949597:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949605:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949611:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949674:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1d3d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949683:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1d3d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949689:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1d3d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949702:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949709:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949715:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949722:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949728:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774979.949731:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949738:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949749:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:2.0:1785774979.949752:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774979.949757:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949764:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745800/0x7b7109e1d0a1d2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949777:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949782:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949787:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949803:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774979.949806:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949811:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949817:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9b7604f39b00) 00010000:00010000:2.0:1785774979.949820:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774979.949822:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949827:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1d36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949858:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711745600/0x7b7109e1d0a1d28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c64d expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949869:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1d3d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c64d expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774979.949876:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5100) 00010000:00010000:2.0:1785774979.949878:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785774979.949880:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744a00, rc 0) 00000100:00100000:2.0:1785774979.949951:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22351:x1872519648652544:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 552us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774979.949957:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24159 00000100:00100000:3.0:1785774979.956653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774979.957272:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648652672 00000100:00100000:1.0:1785774979.957281:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648652672 00000100:00100000:1.0:1785774979.957346:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1498 00000100:00100000:1.0:1785774979.957355:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648652672:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774979.957371:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774979.957393:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1d3d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c64d expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774979.957411:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5100) 00010000:00010000:1.0:1785774979.957415:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774979.957467:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648652672:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 113us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774979.957483:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1498 00000100:00100000:3.0:1785774979.958787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.958910:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648652928 00000100:00100000:0.0:1785774979.958915:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648652928 00000100:00100000:0.0:1785774979.958952:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24160 00000100:00100000:0.0:1785774979.958960:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22351:x1872519648652928:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774979.958984:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774979.959001:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d44 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c654 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774979.959091:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:0.0:1785774979.959918:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d44 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c654 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.959932:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7711ae8300) 00010000:00010000:0.0:1785774979.959934:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774979.959939:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d44 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c654 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.959950:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9d400, rc 0) 00000100:00100000:0.0:1785774979.960011:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22351:x1872519648652928:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1051us (1224us total) trans 4294968549 rc 301/301 00000100:00100000:0.0:1785774979.960018:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24160 00000100:00100000:1.0:1785774979.985208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774979.985343:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648653184 00000100:00100000:0.0:1785774979.985353:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648653184 00000100:00100000:0.0:1785774979.985414:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24161 00000100:00100000:0.0:1785774979.985423:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22351:x1872519648653184:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1785774979.985511:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.985526:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.985537:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774979.985679:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044ac7f16 reply state 000000008b31ec25 transno 4294968550 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.985692:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774979.985699:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7711ae8300) 00010000:00010000:0.0:1785774979.985702:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1785774979.985706:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1785774979.985712:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000100:00100000:0.0:1785774979.985807:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22351:x1872519648653184:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 385us (606us total) trans 4294968550 rc 0/0 00000100:00100000:0.0:1785774979.985813:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24161 00000100:00100000:3.0:1785774980.001909:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.002076:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648653440 00000100:00100000:1.0:1785774980.002086:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648653440 00000100:00100000:1.0:1785774980.002144:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5238 00000100:00100000:1.0:1785774980.002154:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22351:x1872519648653440:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1785774980.003256:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22351:x1872519648653440:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 1101us (1351us total) trans 4294968551 rc 0/0 00000100:00100000:1.0:1785774980.003266:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5238 00000100:00100000:1.0:1785774980.216595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.216689:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648653696 00000100:00100000:0.0:1785774980.216698:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648653696 00000100:00100000:0.0:1785774980.216752:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24162 00000100:00100000:0.0:1785774980.216760:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22362:x1872519648653696:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774980.216781:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774980.216801:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1d59 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c65b expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.216898:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.216913:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.216926:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.216976:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.216984:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.216991:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774980.217124:0:21784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21784:1872519671386112:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1785774980.217205:0:21784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774980.217272:0:21784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b76060233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785774980.217494:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671386112 00000100:00100000:1.0:1785774980.217499:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671386112 00000100:00100000:1.0:1785774980.217533:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:1.0:1785774980.217539:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:21784:x1872519671386112:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1785774980.217635:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76062c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:21784:x1872519671386112:12345-0@lo:1000:mdt00_005.0 Request processed in 96us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774980.217643:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00100000:0.0:1785774980.218086:0:21784:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294984190 gen 2 00000004:00080000:0.0:1785774980.218093:0:21784:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294984190 committed transno 4294984190 00000100:00100000:0.0:1785774980.218126:0:21784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21784:1872519671386112:0@lo:1000:mdt00_005.0 00000004:00080000:0.0:1785774980.218416:0:21784:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1785774980.218596:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1d6e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218609:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1d6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218619:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1d6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218652:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218660:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218679:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218685:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.218689:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218696:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218708:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7711ae8300) 00010000:00010000:0.0:1785774980.218712:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.218716:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218723:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d60 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774980.218735:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032a470cf reply state 0000000000dea948 transno 4294968552 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218745:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218751:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x69eaf62e (ffff9b77131b5d00) 00010000:00010000:0.0:1785774980.218753:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774980.218755:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774980.218784:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1d59 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c65b expref: 15 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218803:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1d6e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c65b expref: 14 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.218810:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:0.0:1785774980.218813:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774980.218815:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9da00, rc 0) 00000100:00100000:0.0:1785774980.219023:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648653696:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2263us (2437us total) trans 4294968552 rc 0/0 00000100:00100000:0.0:1785774980.219031:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24162 00000100:00100000:3.0:1785774980.249637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.249746:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648653952 00000100:00100000:0.0:1785774980.249756:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648653952 00000100:00100000:0.0:1785774980.249815:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5239 00000100:00100000:0.0:1785774980.249825:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648653952:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774980.250106:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648653952:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 282us (476us total) trans 4294968553 rc 0/0 00000100:00100000:0.0:1785774980.250114:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5239 00000100:00100000:3.0:1785774980.259825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.260004:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648654080 00000100:00100000:2.0:1785774980.260013:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648654080 00000100:00100000:2.0:1785774980.260070:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24163 00000100:00100000:2.0:1785774980.260080:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648654080:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774980.265696:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968553 is committed 00000020:00080000:3.0:1785774980.265728:0:7462:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9b770ef1e6c0 refcount 2 committed 0 result 0 batchid 408 00000020:00080000:3.0:1785774980.265734:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604fdf900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9b770ef1ea80 00000020:00080000:3.0:1785774980.265739:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].407 00000020:00080000:3.0:1785774980.265742:0:7462:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b7604fdf200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7606101200 00000020:00080000:3.0:1785774980.265744:0:7462:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].407 00010000:00010000:2.0:1785774980.265862:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265877:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265886:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265894:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.265899:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265910:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265939:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7711ae8300) 00010000:00010000:2.0:1785774980.265942:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.265948:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265955:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce200/0x7b7109e1d0a1ce2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265977:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265984:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265991:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.265996:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.265999:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266005:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266013:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7711ae8300) 00010000:00010000:2.0:1785774980.266015:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774980.266018:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266030:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1d52 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266050:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266056:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266063:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266068:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9de00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.266071:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266077:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266084:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x69eaf62e (ffff9b77131b5d00) 00010000:00010000:2.0:1785774980.266086:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.266089:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.266095:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1d67 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1785774980.266332:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 408 committed batchid 407 00000020:00080000:0.0:1785774980.266415:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 407 00000100:00100000:1.0:1785774980.266657:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:22362:x1872519648654080:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 6572us (6833us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774980.266670:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24163 00000100:00100000:1.0:1785774980.275346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.275416:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648654336 00000100:00100000:0.0:1785774980.275428:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648654336 00000100:00100000:0.0:1785774980.275504:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24164 00000100:00100000:0.0:1785774980.275515:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:22362:x1872519648654336:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774980.275546:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774980.275576:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1d7c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c662 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.275717:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.275734:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.275747:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.275760:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.275767:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.275774:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774980.276195:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1785774980.276344:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1d91 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276353:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1d91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276361:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1d91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276398:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276410:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276417:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276424:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276431:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.276436:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276444:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276458:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5800) 00010000:00010000:0.0:1785774980.276462:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.276467:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276483:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1d83 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774980.276496:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000362f9d12 reply state 000000008d1b5317 transno 4294968554 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276508:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276514:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x112b43cf (ffff9b77131b5f00) 00010000:00010000:0.0:1785774980.276517:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774980.276520:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774980.276552:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1d7c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c662 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276575:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1d91 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c662 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.276583:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:0.0:1785774980.276585:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774980.276588:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9cc00, rc 0) 00000100:00100000:0.0:1785774980.276665:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:22362:x1872519648654336:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1151us (1332us total) trans 4294968554 rc 0/0 00000100:00100000:0.0:1785774980.276673:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24164 00000100:00100000:3.0:1785774980.307320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.307650:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648654592 00000100:00100000:1.0:1785774980.307663:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648654592 00000100:00100000:1.0:1785774980.307736:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5240 00000100:00100000:1.0:1785774980.307748:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:22362:x1872519648654592:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774980.308429:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22362:x1872519648654592:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 681us (1121us total) trans 4294968555 rc 0/0 00000100:00100000:0.0:1785774980.308440:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5240 00000100:00100000:3.0:1785774980.319445:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.319611:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648654720 00000100:00100000:1.0:1785774980.319624:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648654720 00000100:00100000:1.0:1785774980.319699:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24165 00000100:00100000:1.0:1785774980.319711:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22362:x1872519648654720:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774980.322268:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968555 is committed 00000020:00080000:3.0:1785774980.322290:0:7462:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 408 batchid updated 00000020:00080000:1.0:1785774980.322401:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 408 00000004:00080000:1.0:1785774980.322486:0:7483:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9b7602559f00 with version 780 00000020:00080000:1.0:1785774980.322501:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 408 cancel update log [0x200000401:0x3:0x0].407: rc = 0 00010000:00010000:0.0:1785774980.322576:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.322589:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.322598:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.322606:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.322611:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.322625:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.322644:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x112b43cf (ffff9b77131b5f00) 00010000:00010000:0.0:1785774980.322647:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.322652:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.322659:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d8a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774980.322696:0:7474:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9b77087cc240 version 780 rpc_version 780 00000020:00100000:0.0:1785774980.322735:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1785774980.322746:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9b76062c0e00 x1872519671386368/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785774980.322772:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671386368:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774980.322848:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774980.322899:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770ef1e540 going to sleep for 11 seconds 00000100:00100000:0.0:1785774980.326091:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671386368 00000100:00100000:0.0:1785774980.326113:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671386368 00000100:00100000:0.0:1785774980.326232:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:0.0:1785774980.326244:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7474:x1872519671386368:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1785774980.326510:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7474:x1872519671386368:12345-0@lo:1000:osp_up0-1.0 Request processed in 268us (3660us total) trans 4294984191 rc 0/0 00000100:00100000:0.0:1785774980.326519:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:0.0:1785774980.326591:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76062c0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7474:1872519671386368:0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1785774980.329928:0:7483:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 408 cancel update log [0x240000400:0x3:0x0].407: rc = 0 00000020:00080000:1.0:1785774980.329950:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 408 00000100:00100000:2.0:1785774980.333262:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22362:x1872519648654720:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 13539us (13816us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774980.333279:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24165 00000100:00100000:1.0:1785774980.344307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.344410:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648654976 00000100:00100000:0.0:1785774980.344421:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648654976 00000100:00100000:0.0:1785774980.344498:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24166 00000100:00100000:0.0:1785774980.344509:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22362:x1872519648654976:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774980.344536:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774980.344567:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d9f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.344696:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.344712:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.344725:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.344739:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.344746:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.344753:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774980.345142:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1785774980.345343:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1db4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345352:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1db4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345364:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1db4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345400:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345408:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345415:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345422:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345428:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.345433:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345441:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345454:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5f00) 00010000:00010000:0.0:1785774980.345457:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.345462:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345478:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1da6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774980.345493:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067626d40 reply state 00000000ebd9bc36 transno 4294968556 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345505:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345511:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5e132fd4 (ffff9b77131b5800) 00010000:00010000:0.0:1785774980.345514:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774980.345517:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774980.345547:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1d9f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c669 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345566:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1db4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c669 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.345573:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:0.0:1785774980.345576:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774980.345578:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9d800, rc 0) 00000100:00100000:0.0:1785774980.345655:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22362:x1872519648654976:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1148us (1360us total) trans 4294968556 rc 0/0 00000100:00100000:0.0:1785774980.345662:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24166 00000100:00100000:3.0:1785774980.360561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.360738:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648655232 00000100:00100000:0.0:1785774980.360750:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648655232 00000100:00100000:0.0:1785774980.360818:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5241 00000100:00100000:0.0:1785774980.360828:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22362:x1872519648655232:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774980.361235:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22362:x1872519648655232:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 408us (687us total) trans 4294968557 rc 0/0 00000100:00100000:0.0:1785774980.361243:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5241 00000100:00100000:3.0:1785774980.374316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.375038:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648655360 00000100:00100000:0.0:1785774980.375052:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648655360 00000100:00100000:0.0:1785774980.375134:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24167 00000100:00100000:0.0:1785774980.375155:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22362:x1872519648655360:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774980.377463:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968557 is committed 00010000:00010000:2.0:1785774980.377763:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.377779:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.377788:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.377795:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.377800:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.377809:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.377827:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5e132fd4 (ffff9b77131b5800) 00010000:00010000:2.0:1785774980.377830:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.377836:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.377843:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1dad lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774980.378660:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22362:x1872519648655360:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 3510us (4351us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774980.378670:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24167 00000100:00100000:1.0:1785774980.389098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.391096:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648655616 00000100:00100000:0.0:1785774980.391111:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648655616 00000100:00100000:0.0:1785774980.391504:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24168 00000100:00100000:0.0:1785774980.391518:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22362:x1872519648655616:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774980.391547:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774980.391578:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1dc2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c670 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.391714:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.391731:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.391743:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.399508:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.399542:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.399559:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774980.400238:0:21784:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1785774980.400539:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1dd7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400550:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400560:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400662:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400669:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400675:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400681:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774980.400685:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400692:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400704:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5f00) 00010000:00010000:1.0:1785774980.400707:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774980.400711:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400717:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1dc9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774980.400733:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa858867 reply state 000000002daa3961 transno 4294968558 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400745:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400751:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xd873b914 (ffff9b7605fd8800) 00010000:00010000:1.0:1785774980.400752:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774980.400756:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774980.400799:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1dc2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c670 expref: 12 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400820:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c670 expref: 11 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.400827:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:1.0:1785774980.400829:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774980.400832:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9200, rc 0) 00000100:00100000:1.0:1785774980.401942:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22362:x1872519648655616:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 9404us (11835us total) trans 4294968558 rc 0/0 00000100:00100000:1.0:1785774980.401954:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24168 00000100:00100000:3.0:1785774980.421311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.421465:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648655872 00000100:00100000:0.0:1785774980.421488:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648655872 00000100:00100000:0.0:1785774980.422628:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5242 00000100:00100000:0.0:1785774980.422645:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22362:x1872519648655872:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774980.423052:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22362:x1872519648655872:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 411us (1753us total) trans 4294968559 rc 0/0 00000100:00100000:0.0:1785774980.423061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5242 00000100:00100000:3.0:1785774980.434614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.434817:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648656000 00000100:00100000:0.0:1785774980.434829:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648656000 00000100:00100000:0.0:1785774980.434901:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24169 00000100:00100000:0.0:1785774980.434911:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22362:x1872519648656000:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774980.437703:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968559 is committed 00000100:00100000:1.0:1785774980.439263:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22362:x1872519648656000:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 4343us (4654us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774980.439278:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24169 00010000:00010000:0.0:1785774980.441485:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.441508:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.441518:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.441526:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.441531:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.441540:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.441974:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xd873b914 (ffff9b7605fd8800) 00010000:00010000:0.0:1785774980.441980:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.441988:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.441996:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1dd0 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774980.454904:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.455048:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648656256 00000100:00100000:2.0:1785774980.455063:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648656256 00000100:00100000:2.0:1785774980.455149:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24170 00000100:00100000:2.0:1785774980.455213:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:22362:x1872519648656256:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774980.455254:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774980.455285:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1de5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c677 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.455460:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.455489:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.455502:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.455518:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.455525:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.455532:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774980.455966:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1785774980.456137:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d0a1dfa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456145:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d0a1dfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456152:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d0a1dfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456217:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456230:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456236:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456243:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456250:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.456255:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456263:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456277:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39b00) 00010000:00010000:2.0:1785774980.456281:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.456286:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456293:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1dec lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774980.456307:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000830030be reply state 0000000006fc1cc6 transno 4294968560 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456319:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456326:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x233016a9 (ffff9b7604f39c00) 00010000:00010000:2.0:1785774980.456329:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774980.456332:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774980.456364:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1de5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c677 expref: 13 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456386:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d0a1dfa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c677 expref: 12 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.456394:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:2.0:1785774980.456396:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774980.456398:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745000, rc 0) 00000100:00100000:2.0:1785774980.456486:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22362:x1872519648656256:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1327us (1599us total) trans 4294968560 rc 0/0 00000100:00100000:2.0:1785774980.456494:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24170 00000100:00100000:3.0:1785774980.482684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.485666:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648656512 00000100:00100000:0.0:1785774980.485686:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648656512 00000100:00100000:2.0:1785774980.490594:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5243 00000100:00100000:2.0:1785774980.490614:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22362:x1872519648656512:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:2.0:1785774980.491011:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22362:x1872519648656512:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 402us (8341us total) trans 4294968561 rc 0/0 00000100:00100000:2.0:1785774980.491019:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5243 00000100:00100000:3.0:1785774980.495551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.495689:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648656640 00000100:00100000:0.0:1785774980.495702:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648656640 00000100:00100000:0.0:1785774980.495778:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24171 00000100:00100000:0.0:1785774980.495790:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22362:x1872519648656640:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:0.0:1785774980.500447:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968561 is committed 00010000:00010000:3.0:1785774980.500538:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.500573:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.500582:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.500588:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774980.500592:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.500600:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.500618:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x233016a9 (ffff9b7604f39c00) 00010000:00010000:3.0:1785774980.500622:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774980.500626:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.500632:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1df3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774980.500965:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22362:x1872519648656640:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 5171us (5421us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774980.500978:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24171 00000100:00100000:1.0:1785774980.526007:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.526081:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648656896 00000100:00100000:2.0:1785774980.526094:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648656896 00000100:00100000:2.0:1785774980.526294:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24172 00000100:00100000:2.0:1785774980.526305:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22362:x1872519648656896:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774980.526325:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774980.526458:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1e08 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c67e expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.526639:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.526653:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.526665:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.526677:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.526684:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.526691:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774980.537299:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1785774980.537731:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1e1d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.537748:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1e1d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.537760:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1e1d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538328:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538428:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538434:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538447:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538453:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.538458:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538465:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538487:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39b00) 00010000:00010000:0.0:1785774980.538490:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.538494:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538501:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1e0f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774980.538515:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e03ca8c reply state 0000000055af0dd7 transno 4294968562 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538526:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538532:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa88c5e99 (ffff9b7604f39800) 00010000:00010000:0.0:1785774980.538535:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774980.538538:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774980.538644:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1e08 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c67e expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538663:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1e1d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c67e expref: 13 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.538672:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:0.0:1785774980.538673:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774980.538676:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c800, rc 0) 00000100:00100000:0.0:1785774980.538743:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22362:x1872519648656896:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 12440us (12749us total) trans 4294968562 rc 0/0 00000100:00100000:0.0:1785774980.538751:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24172 00000100:00100000:3.0:1785774980.555751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.559679:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648657152 00000100:00100000:0.0:1785774980.559694:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648657152 00000100:00100000:1.0:1785774980.564057:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5244 00000100:00100000:1.0:1785774980.564071:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22362:x1872519648657152:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:1.0:1785774980.564395:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648657152:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 326us (8653us total) trans 4294968563 rc 0/0 00000100:00100000:1.0:1785774980.564403:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5244 00000100:00100000:3.0:1785774980.569961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.570087:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648657280 00000100:00100000:2.0:1785774980.570096:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648657280 00000100:00100000:3.0:1785774980.570290:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24173 00000100:00100000:3.0:1785774980.570301:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648657280:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:0.0:1785774980.581461:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968563 is committed 00000100:00100000:1.0:1785774980.582022:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22362:x1872519648657280:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 11717us (12062us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774980.582034:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24173 00010000:00010000:3.0:1785774980.590479:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.590495:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.590504:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.590510:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774980.590514:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.590522:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.590539:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa88c5e99 (ffff9b7604f39800) 00010000:00010000:3.0:1785774980.590542:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774980.590546:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.592256:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e16 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774980.601949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.602786:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648657536 00000100:00100000:1.0:1785774980.602796:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648657536 00000100:00100000:1.0:1785774980.602857:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24174 00000100:00100000:1.0:1785774980.602866:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22362:x1872519648657536:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774980.602886:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774980.602908:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1e2b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c685 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603000:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603013:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603023:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603063:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603069:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603078:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774980.603421:0:21784:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1785774980.603565:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1e40 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603573:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1e40 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603580:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1e40 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603611:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603618:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603625:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603631:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774980.603635:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603643:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603654:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:1.0:1785774980.603657:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774980.603662:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603668:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e32 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774980.603679:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f104b5a reply state 000000000dcc867f transno 4294968564 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603689:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603696:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x24f3e3ee (ffff9b7605fd8400) 00010000:00010000:1.0:1785774980.603698:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774980.603700:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774980.603725:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1e2b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c685 expref: 15 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603741:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1e40 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c685 expref: 14 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.603749:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774980.603751:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774980.603753:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8c00, rc 0) 00000100:00100000:1.0:1785774980.603823:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648657536:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 958us (1882us total) trans 4294968564 rc 0/0 00000100:00100000:1.0:1785774980.603831:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24174 00000100:00100000:2.0:1785774980.628970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774980.629265:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648657792 00000100:00100000:3.0:1785774980.629274:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648657792 00000100:00100000:3.0:1785774980.629329:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5245 00000100:00100000:3.0:1785774980.629338:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648657792:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:3.0:1785774980.629654:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648657792:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 316us (693us total) trans 4294968565 rc 0/0 00000100:00100000:3.0:1785774980.629663:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5245 00000100:00100000:3.0:1785774980.632822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.632910:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648657920 00000100:00100000:1.0:1785774980.632918:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648657920 00000100:00100000:1.0:1785774980.632967:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24175 00000100:00100000:1.0:1785774980.632975:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648657920:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:2.0:1785774980.640769:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968565 is committed 00000100:00100000:1.0:1785774980.640959:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22362:x1872519648657920:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 7980us (8138us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774980.640969:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24175 00010000:00010000:3.0:1785774980.644357:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.644373:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.644382:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.644388:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774980.644392:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.644399:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.644417:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x24f3e3ee (ffff9b7605fd8400) 00010000:00010000:3.0:1785774980.644420:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774980.644425:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.644430:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1e39 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774980.645776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.647219:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648658176 00000100:00100000:2.0:1785774980.647231:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648658176 00000100:00100000:2.0:1785774980.647291:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24176 00000100:00100000:2.0:1785774980.647300:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22362:x1872519648658176:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774980.647318:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774980.647347:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1e4e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c68c expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.647454:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.647476:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.647486:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.647499:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.647506:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.647512:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774980.647992:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1785774980.648107:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1e63 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648115:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1e63 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648122:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1e63 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648669:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648683:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648690:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648696:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648702:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.648707:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648714:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648725:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fced00) 00010000:00010000:2.0:1785774980.648728:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.648732:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648739:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a1e55 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774980.648752:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e79ef02d reply state 000000006b21e0f0 transno 4294968566 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648763:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648770:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x3f283190 (ffff9b7605fce100) 00010000:00010000:2.0:1785774980.648773:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774980.648776:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774980.648805:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1e4e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c68c expref: 16 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648825:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1e63 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c68c expref: 15 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.648832:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:2.0:1785774980.648834:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774980.648837:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745600, rc 0) 00000100:00100000:2.0:1785774980.648905:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648658176:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1605us (3135us total) trans 4294968566 rc 0/0 00000100:00100000:2.0:1785774980.648913:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24176 00000100:00100000:2.0:1785774980.660261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.660350:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648658432 00000100:00100000:1.0:1785774980.660361:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648658432 00000100:00100000:1.0:1785774980.660413:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5246 00000100:00100000:1.0:1785774980.660422:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648658432:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:1.0:1785774980.660713:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22362:x1872519648658432:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 291us (460us total) trans 4294968567 rc 0/0 00000100:00100000:1.0:1785774980.660720:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5246 00000100:00100000:3.0:1785774980.675297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.675428:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648658560 00000100:00100000:0.0:1785774980.675437:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648658560 00000100:00100000:0.0:1785774980.675503:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24177 00000100:00100000:0.0:1785774980.675513:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22362:x1872519648658560:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:2.0:1785774980.677082:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968567 is committed 00000100:00100000:0.0:1785774980.677595:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648658560:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 2081us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774980.677605:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24177 00010000:00010000:3.0:1785774980.677772:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.677783:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.677790:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.677801:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774980.677805:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.677813:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.677829:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x3f283190 (ffff9b7605fce100) 00010000:00010000:3.0:1785774980.677832:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774980.677836:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.677843:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1e5c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774980.695424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.695524:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648658816 00000100:00100000:0.0:1785774980.695535:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648658816 00000100:00100000:0.0:1785774980.695603:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24178 00000100:00100000:0.0:1785774980.695611:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22362:x1872519648658816:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774980.695631:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774980.695652:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1e71 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c693 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.695749:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.695763:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.695772:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.695782:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.695789:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.695795:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774980.696100:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1785774980.698389:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1e86 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698405:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1e86 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698414:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1e86 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698444:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698450:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698455:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698463:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698480:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.698484:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698491:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698503:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7707de8e00) 00010000:00010000:0.0:1785774980.698506:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.698509:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698515:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1e78 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774980.698528:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035cedee2 reply state 000000001785a683 transno 4294968568 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698539:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698545:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa000570f (ffff9b7707de8700) 00010000:00010000:0.0:1785774980.698547:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774980.698549:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774980.698579:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1e71 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c693 expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698599:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1e86 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c693 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.698606:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:0.0:1785774980.698608:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774980.698610:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ce00, rc 0) 00000100:00100000:0.0:1785774980.698674:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22362:x1872519648658816:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3064us (3351us total) trans 4294968568 rc 0/0 00000100:00100000:0.0:1785774980.698681:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24178 00000100:00100000:2.0:1785774980.714348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.714489:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648659072 00000100:00100000:0.0:1785774980.714499:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648659072 00000100:00100000:0.0:1785774980.714560:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5247 00000100:00100000:0.0:1785774980.714570:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22362:x1872519648659072:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774980.714826:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:22362:x1872519648659072:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 257us (494us total) trans 4294968569 rc 0/0 00000100:00100000:0.0:1785774980.714834:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5247 00000100:00100000:3.0:1785774980.719018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.719105:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648659200 00000100:00100000:1.0:1785774980.719122:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648659200 00000100:00100000:1.0:1785774980.719208:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24179 00000100:00100000:1.0:1785774980.719218:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:22362:x1872519648659200:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:0.0:1785774980.721996:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968569 is committed 00000100:00100000:1.0:1785774980.723868:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648659200:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 4646us (4851us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774980.723879:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24179 00010000:00010000:3.0:1785774980.732652:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.732671:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.732679:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.732686:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774980.732691:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.732699:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.732716:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa000570f (ffff9b7707de8700) 00010000:00010000:3.0:1785774980.732719:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774980.732724:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.732731:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a1e7f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774980.732895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.733047:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648659456 00000100:00100000:1.0:1785774980.733055:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648659456 00000100:00100000:1.0:1785774980.733104:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24180 00000100:00100000:1.0:1785774980.733112:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22362:x1872519648659456:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774980.733142:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774980.733430:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e94 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c69a expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.733545:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.733569:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.733580:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.733594:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.733601:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.733608:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774980.733945:0:21784:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1785774980.734082:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8400/0x7b7109e1d0a1ea9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734092:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8400/0x7b7109e1d0a1ea9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734100:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8400/0x7b7109e1d0a1ea9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734691:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734705:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734713:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734718:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774980.734723:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734730:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734740:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fd8100) 00010000:00010000:1.0:1785774980.734743:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774980.734746:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734750:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1e9b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774980.734761:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011e7eaaf reply state 00000000435ce8a9 transno 4294968570 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734769:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734774:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x9a2cdc4e (ffff9b7605fd8700) 00010000:00010000:1.0:1785774980.734776:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774980.734778:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774980.734806:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1e94 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c69a expref: 18 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734824:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8400/0x7b7109e1d0a1ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c69a expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.734832:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:1.0:1785774980.734834:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774980.734837:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8400, rc 0) 00000100:00100000:1.0:1785774980.734903:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:22362:x1872519648659456:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1792us (2011us total) trans 4294968570 rc 0/0 00000100:00100000:1.0:1785774980.734911:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24180 00000100:00100000:2.0:1785774980.740838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774980.741070:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648659712 00000100:00100000:3.0:1785774980.741079:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648659712 00000100:00100000:3.0:1785774980.741142:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5248 00000100:00100000:3.0:1785774980.741150:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:22362:x1872519648659712:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:2.0:1785774980.746777:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:22362:x1872519648659712:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 5617us (5936us total) trans 4294968571 rc 0/0 00000100:00100000:2.0:1785774980.746790:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5248 00000100:00100000:1.0:1785774980.757745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.761406:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648659840 00000100:00100000:0.0:1785774980.761420:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648659840 00000100:00100000:2.0:1785774980.765962:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24181 00000100:00100000:2.0:1785774980.765976:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:22362:x1872519648659840:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774980.772138:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968571 is committed 00000100:00100000:2.0:1785774980.774157:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22362:x1872519648659840:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 8176us (16412us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774980.774649:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24181 00010000:00010000:1.0:1785774980.776915:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.776929:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.776951:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.776956:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774980.776960:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.776966:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.776996:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x9a2cdc4e (ffff9b7605fd8700) 00010000:00010000:1.0:1785774980.777000:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774980.777004:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.777009:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1ea2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774980.789303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.789631:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648660096 00000100:00100000:2.0:1785774980.789641:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648660096 00000100:00100000:2.0:1785774980.789694:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24182 00000100:00100000:2.0:1785774980.789702:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22362:x1872519648660096:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774980.789721:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774980.789742:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d0a1eb7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6a1 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.789932:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.789947:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.789957:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.789969:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.789975:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.789981:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774980.790646:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x7:0x0], index 0: 0 00010000:00010000:2.0:1785774980.790767:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d0a1ecc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.790776:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d0a1ecc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791275:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d0a1ecc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791310:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791316:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791321:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791445:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791452:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.791456:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791462:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791483:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fcea00) 00010000:00010000:2.0:1785774980.791486:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.791538:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791545:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1ebe lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774980.791635:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088f12185 reply state 000000007cf18810 transno 4294968572 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791645:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791651:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xb3c1e899 (ffff9b7605fcef00) 00010000:00010000:2.0:1785774980.791653:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774980.791656:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774980.791689:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d0a1eb7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6a1 expref: 19 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791706:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d0a1ecc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6a1 expref: 18 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.791712:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:2.0:1785774980.791714:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774980.791716:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744600, rc 0) 00000100:00100000:2.0:1785774980.791824:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:22362:x1872519648660096:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2123us (2529us total) trans 4294968572 rc 0/0 00000100:00100000:2.0:1785774980.791831:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24182 00000100:00100000:3.0:1785774980.812558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.812680:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648660352 00000100:00100000:1.0:1785774980.812689:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648660352 00000100:00100000:1.0:1785774980.812749:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5249 00000100:00100000:1.0:1785774980.812758:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:22362:x1872519648660352:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:1.0:1785774980.813021:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:22362:x1872519648660352:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 264us (472us total) trans 4294968573 rc 0/0 00000100:00100000:1.0:1785774980.813028:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5249 00000100:00100000:1.0:1785774980.816953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774980.820426:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648660480 00000100:00100000:3.0:1785774980.820437:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648660480 00000100:00100000:3.0:1785774980.820659:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24183 00000100:00100000:3.0:1785774980.820669:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:22362:x1872519648660480:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:1.0:1785774980.825609:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968573 is committed 00010000:00010000:3.0:1785774980.825672:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.825686:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.825693:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.825699:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774980.825704:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.825711:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.825728:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xb3c1e899 (ffff9b7605fcef00) 00010000:00010000:3.0:1785774980.825731:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774980.825735:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.825741:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1ec5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774980.825963:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22362:x1872519648660480:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 5291us (9011us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774980.825973:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24183 00000100:00100000:1.0:1785774980.856326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.856407:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648660736 00000100:00100000:0.0:1785774980.856416:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648660736 00000100:00100000:0.0:1785774980.856503:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24184 00000100:00100000:0.0:1785774980.856513:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22362:x1872519648660736:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774980.856534:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774980.856792:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1eda lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6a8 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.856895:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.856909:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.856920:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.856968:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.856976:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.856982:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774980.857647:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x7:0x0], index 1: 0 00010000:00010000:0.0:1785774980.857778:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1eef lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858283:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1eef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858292:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1eef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858328:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858336:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858341:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858348:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858354:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774980.858358:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858365:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858375:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5f00) 00010000:00010000:0.0:1785774980.858378:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774980.858381:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858388:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1ee1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774980.858401:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027cb4c3a reply state 000000007cd19d92 transno 4294968574 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858410:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858415:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5b3c1a7 (ffff9b77131b5800) 00010000:00010000:0.0:1785774980.858418:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774980.858420:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774980.858447:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1eda lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6a8 expref: 20 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858477:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1eef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6a8 expref: 19 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774980.858484:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:0.0:1785774980.858486:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774980.858488:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9dc00, rc 0) 00000100:00100000:1.0:1785774980.863662:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:22362:x1872519648660736:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 7141us (7336us total) trans 4294968574 rc 0/0 00000100:00100000:1.0:1785774980.863674:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24184 00000100:00100000:3.0:1785774980.881452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.881526:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648660992 00000100:00100000:2.0:1785774980.881537:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648660992 00000100:00100000:2.0:1785774980.881725:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5250 00000100:00100000:2.0:1785774980.881736:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:22362:x1872519648660992:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:2.0:1785774980.882111:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:22362:x1872519648660992:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 376us (665us total) trans 4294968575 rc 0/0 00000100:00100000:2.0:1785774980.882119:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5250 00000100:00100000:3.0:1785774980.891451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774980.891665:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648661120 00000100:00100000:1.0:1785774980.891674:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648661120 00000100:00100000:1.0:1785774980.891729:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24185 00000100:00100000:1.0:1785774980.891737:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:22362:x1872519648661120:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774980.893950:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968575 is committed 00010000:00010000:1.0:1785774980.894046:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.894061:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.894082:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.894087:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774980.894091:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.894097:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.894113:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5b3c1a7 (ffff9b77131b5800) 00010000:00010000:1.0:1785774980.894116:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774980.894120:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774980.894125:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a1ee8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774980.901263:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774980.903070:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:22362:x1872519648661120:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 11326us (11619us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774980.903084:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24185 00000100:00100000:0.0:1785774980.932315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.932423:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648661376 00000100:00100000:2.0:1785774980.932434:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648661376 00000100:00100000:2.0:1785774980.932509:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24186 00000100:00100000:2.0:1785774980.932518:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:22362:x1872519648661376:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774980.932539:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774980.932704:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d0a1efd lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6af expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.932864:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.932879:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.932891:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.932959:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.932966:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.932974:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774980.933425:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x8:0x0], index 0: 0 00010000:00010000:2.0:1785774980.933871:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1f12 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933881:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1f12 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933887:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1f12 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933915:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933921:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933926:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933932:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933937:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.933940:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933946:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933959:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fcea00) 00010000:00010000:2.0:1785774980.933961:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.933965:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933969:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f04 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774980.933979:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac45f73c reply state 00000000b03a685e transno 4294968576 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933989:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.933994:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x72a5df42 (ffff9b7605fce500) 00010000:00010000:2.0:1785774980.933996:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774980.933998:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774980.934024:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d0a1efd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6af expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.934041:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1f12 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6af expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.934047:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:2.0:1785774980.934049:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774980.934051:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744a00, rc 0) 00000100:00100000:2.0:1785774980.934389:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:22362:x1872519648661376:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1871us (2081us total) trans 4294968576 rc 0/0 00000100:00100000:2.0:1785774980.934398:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24186 00000100:00100000:0.0:1785774980.946080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774980.946216:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648661632 00000100:00100000:3.0:1785774980.946227:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648661632 00000100:00100000:3.0:1785774980.946283:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5251 00000100:00100000:3.0:1785774980.946301:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:22362:x1872519648661632:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774980.947051:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:22362:x1872519648661632:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 758us (976us total) trans 4294968577 rc 0/0 00000100:00100000:0.0:1785774980.947061:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5251 00000100:00100000:1.0:1785774980.950362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.954263:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648661760 00000100:00100000:2.0:1785774980.954673:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648661760 00000100:00100000:0.0:1785774980.957719:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24187 00000100:00100000:0.0:1785774980.957730:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:22362:x1872519648661760:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774980.960347:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968577 is committed 00010000:00010000:2.0:1785774980.960495:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.960507:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.960514:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.960521:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.960525:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.960532:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.960556:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x72a5df42 (ffff9b7605fce500) 00010000:00010000:2.0:1785774980.960559:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.960564:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.960569:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f0b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774980.960863:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:22362:x1872519648661760:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 3130us (10503us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774980.960872:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24187 00000100:00100000:3.0:1785774980.974149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774980.978955:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648662016 00000100:00100000:2.0:1785774980.978970:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648662016 00000100:00100000:2.0:1785774980.979043:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24188 00000100:00100000:2.0:1785774980.979054:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:22362:x1872519648662016:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774980.979074:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774980.979097:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f20 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6b6 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.979956:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.979972:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.979985:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.979999:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.980007:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.980013:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774980.980771:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x8:0x0], index 1: 0 00010000:00010000:2.0:1785774980.980966:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1f35 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.980977:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1f35 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.980986:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1f35 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981017:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981029:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981035:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981042:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981048:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774980.981052:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981059:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981071:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fce500) 00010000:00010000:2.0:1785774980.981074:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774980.981078:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981085:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f27 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774980.981097:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c9d332d reply state 00000000503d12d7 transno 4294968578 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.981107:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.982354:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa14d934 (ffff9b7605fcea00) 00010000:00010000:2.0:1785774980.982362:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774980.982365:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774980.982411:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f20 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6b6 expref: 22 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.982432:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1f35 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6b6 expref: 21 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774980.982440:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:2.0:1785774980.982441:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774980.982444:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745a00, rc 0) 00000100:00100000:2.0:1785774980.983108:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:22362:x1872519648662016:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 4015us (9284us total) trans 4294968578 rc 0/0 00000100:00100000:2.0:1785774980.983123:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24188 00000100:00100000:2.0:1785774980.993748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774980.993921:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648662272 00000100:00100000:0.0:1785774980.993933:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648662272 00000100:00100000:0.0:1785774980.993998:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5252 00000100:00100000:0.0:1785774980.994009:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:22362:x1872519648662272:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774980.994535:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:22362:x1872519648662272:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 526us (796us total) trans 4294968579 rc 0/0 00000100:00100000:0.0:1785774980.994544:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5252 00000100:00100000:1.0:1785774981.000639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774981.000724:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648662400 00000100:00100000:3.0:1785774981.000734:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648662400 00000100:00080000:0.0:1785774981.000869:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774981.000922:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24189 00000100:00100000:3.0:1785774981.000934:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:22362:x1872519648662400:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:1.0:1785774981.003449:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968579 is committed 00010000:00010000:3.0:1785774981.003566:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.003579:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.003587:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.003593:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774981.003598:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.003605:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.003621:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa14d934 (ffff9b7605fcea00) 00010000:00010000:3.0:1785774981.003625:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774981.003629:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.003636:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a1f2e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774981.019084:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:22362:x1872519648662400:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 18141us (18534us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.019101:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24189 00000100:00100000:2.0:1785774981.029674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.032707:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648662656 00000100:00100000:1.0:1785774981.032721:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648662656 00000100:00100000:1.0:1785774981.032778:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24190 00000100:00100000:1.0:1785774981.032897:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:22362:x1872519648662656:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774981.032916:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774981.032938:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a1f43 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6bd expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033037:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033051:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033062:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033076:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033082:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033089:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774981.033431:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9:0x0], index 0: 0 00010000:00010000:1.0:1785774981.033581:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1f58 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033590:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1f58 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033597:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1f58 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033623:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033633:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033639:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033659:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033663:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774981.033667:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033672:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033686:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe600) 00010000:00010000:1.0:1785774981.033688:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774981.033692:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033697:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1f4a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774981.033710:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000135c1d06 reply state 00000000d6f69038 transno 4294968580 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033719:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033725:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xc0330bcf (ffff9b7605dfe700) 00010000:00010000:1.0:1785774981.033727:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774981.033730:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774981.033751:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a1f43 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6bd expref: 23 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033767:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1f58 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6bd expref: 22 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.033773:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:1.0:1785774981.033775:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774981.033777:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8a00, rc 0) 00000100:00100000:1.0:1785774981.033848:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:22362:x1872519648662656:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 954us (4183us total) trans 4294968580 rc 0/0 00000100:00100000:1.0:1785774981.039432:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24190 00000100:00100000:0.0:1785774981.043744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.043927:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648662912 00000100:00100000:2.0:1785774981.043936:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648662912 00000100:00100000:2.0:1785774981.043989:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5253 00000100:00100000:2.0:1785774981.043998:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:22362:x1872519648662912:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:2.0:1785774981.044969:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:22362:x1872519648662912:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 971us (1232us total) trans 4294968581 rc 0/0 00000100:00100000:2.0:1785774981.044977:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5253 00000100:00100000:3.0:1785774981.055049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.058695:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648663040 00000100:00100000:1.0:1785774981.058709:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648663040 00000100:00100000:1.0:1785774981.059668:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24191 00000100:00100000:1.0:1785774981.059680:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:22362:x1872519648663040:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:0.0:1785774981.071502:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968581 is committed 00000100:00100000:1.0:1785774981.072392:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:22362:x1872519648663040:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 12709us (17345us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.072403:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24191 00010000:00010000:2.0:1785774981.080018:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.080034:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.080067:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.080074:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e9800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774981.080078:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.080086:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.080102:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xc0330bcf (ffff9b7605dfe700) 00010000:00010000:2.0:1785774981.080105:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774981.080109:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.080116:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a1f51 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774981.084639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.084722:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648663296 00000100:00100000:0.0:1785774981.084730:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648663296 00000100:00100000:0.0:1785774981.084877:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24192 00000100:00100000:0.0:1785774981.084886:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:22362:x1872519648663296:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:0.0:1785774981.084906:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774981.084927:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1f66 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6c4 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.085021:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.085035:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.085046:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.085058:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.085065:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.085070:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774981.085872:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x9:0x0], index 1: 0 00010000:00010000:0.0:1785774981.085994:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1f7b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086005:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1f7b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086013:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1f7b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086041:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086049:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086055:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086061:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086067:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9de00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774981.086071:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086078:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086087:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5f00) 00010000:00010000:0.0:1785774981.086090:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774981.086095:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.086105:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9de00/0x7b7109e1d0a1f6d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774981.086117:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8e5af49 reply state 00000000c1557d29 transno 4294968582 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.087274:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.087285:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5be36ea4 (ffff9b77131b5600) 00010000:00010000:0.0:1785774981.087287:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774981.087290:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774981.087325:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a1f66 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6c4 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.087347:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1f7b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6c4 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.087354:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:0.0:1785774981.087356:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774981.087358:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9d600, rc 0) 00000100:00100000:0.0:1785774981.087424:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:22362:x1872519648663296:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 2538us (2793us total) trans 4294968582 rc 0/0 00000100:00100000:0.0:1785774981.087432:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24192 00000100:00100000:3.0:1785774981.095522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.095665:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648663552 00000100:00100000:1.0:1785774981.095675:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648663552 00000100:00100000:1.0:1785774981.095723:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5254 00000100:00100000:1.0:1785774981.095732:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:22362:x1872519648663552:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:1.0:1785774981.095997:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:22362:x1872519648663552:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 265us (483us total) trans 4294968583 rc 0/0 00000100:00100000:1.0:1785774981.096009:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5254 00000100:00100000:3.0:1785774981.103960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.104103:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648663680 00000100:00100000:0.0:1785774981.104112:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648663680 00000100:00100000:0.0:1785774981.104219:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24193 00000100:00100000:0.0:1785774981.104229:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:22362:x1872519648663680:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:1.0:1785774981.113862:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968583 is committed 00000100:00100000:0.0:1785774981.114388:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:22362:x1872519648663680:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 10154us (10430us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.114400:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24193 00010000:00010000:3.0:1785774981.117936:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.117953:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.117965:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.117971:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774981.117975:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.117984:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.118001:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x5be36ea4 (ffff9b77131b5600) 00010000:00010000:3.0:1785774981.118004:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774981.118009:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.118016:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a1f74 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774981.128943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.133468:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648663936 00000100:00100000:2.0:1785774981.133482:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648663936 00000100:00100000:2.0:1785774981.133658:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24194 00000100:00100000:2.0:1785774981.133668:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:22362:x1872519648663936:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774981.133690:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.133711:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1f89 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6cb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.133815:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.133829:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.133839:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.133851:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.133857:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.133862:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774981.135407:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa:0x0], index 0: 0 00010000:00010000:2.0:1785774981.135735:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f9e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.135747:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f9e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.135756:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f9e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136427:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136436:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136443:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136451:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136457:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774981.136471:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136479:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136492:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fce500) 00010000:00010000:2.0:1785774981.136495:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774981.136500:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136506:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1f90 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774981.136518:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b38a532 reply state 000000002f1f5f68 transno 4294968584 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136529:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136536:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x13f7213f (ffff9b7605fceb00) 00010000:00010000:2.0:1785774981.136538:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774981.136541:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774981.136710:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1f89 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6cb expref: 25 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136729:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f9e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6cb expref: 24 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.136738:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:2.0:1785774981.136740:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774981.136742:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745e00, rc 0) 00000100:00100000:2.0:1785774981.137457:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:22362:x1872519648663936:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 3786us (8517us total) trans 4294968584 rc 0/0 00000100:00100000:2.0:1785774981.137474:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24194 00000100:00100000:1.0:1785774981.145758:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.145886:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648664192 00000100:00100000:2.0:1785774981.145895:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648664192 00000100:00100000:2.0:1785774981.145951:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5255 00000100:00100000:2.0:1785774981.145961:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:22362:x1872519648664192:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774981.156915:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:22362:x1872519648664192:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 10945us (11361us total) trans 4294968585 rc 0/0 00000100:00100000:0.0:1785774981.156930:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5255 00000100:00100000:3.0:1785774981.162930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.163507:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648664320 00000100:00100000:0.0:1785774981.163517:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648664320 00000100:00100000:0.0:1785774981.163657:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24195 00000100:00100000:0.0:1785774981.163668:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:22362:x1872519648664320:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:1.0:1785774981.167804:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968585 is committed 00000100:00100000:1.0:1785774981.169455:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:22362:x1872519648664320:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 5782us (6527us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.169478:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24195 00010000:00010000:2.0:1785774981.172389:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.172406:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.172415:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.172422:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774981.172426:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.172434:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.172451:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x13f7213f (ffff9b7605fceb00) 00010000:00010000:2.0:1785774981.172455:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774981.172468:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.172475:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1f97 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774981.184421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.184512:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648664576 00000100:00100000:1.0:1785774981.184521:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648664576 00000100:00100000:1.0:1785774981.184582:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24196 00000100:00100000:1.0:1785774981.184592:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+23:22362:x1872519648664576:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:1.0:1785774981.184612:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774981.184631:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1fac lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6d2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.184726:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.184739:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.184749:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.184762:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.184767:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.184773:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785774981.185056:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa:0x0], index 1: 0 00010000:00010000:1.0:1785774981.185478:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1fc1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185488:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1fc1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185496:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1fc1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185527:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185534:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185665:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185674:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185680:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774981.185684:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185692:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185712:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe700) 00010000:00010000:1.0:1785774981.185715:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774981.185719:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185726:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8e00/0x7b7109e1d0a1fb3 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774981.185738:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da26ed00 reply state 0000000021e9fd97 transno 4294968586 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185748:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185753:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x4a6b5b31 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774981.185756:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774981.185758:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785774981.185787:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a1fac lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6d2 expref: 26 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185806:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1fc1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6d2 expref: 25 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.185813:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:1.0:1785774981.185815:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774981.185817:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8000, rc 0) 00000100:00100000:1.0:1785774981.185872:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:22362:x1872519648664576:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1283us (1460us total) trans 4294968586 rc 0/0 00000100:00100000:1.0:1785774981.185878:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24196 00000100:00100000:3.0:1785774981.193094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.193571:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648664832 00000100:00100000:0.0:1785774981.193581:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648664832 00000100:00100000:0.0:1785774981.193642:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5256 00000100:00100000:0.0:1785774981.193651:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:22362:x1872519648664832:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774981.193910:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:22362:x1872519648664832:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 259us (823us total) trans 4294968587 rc 0/0 00000100:00100000:0.0:1785774981.193917:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5256 00000100:00100000:3.0:1785774981.196876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.196951:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648664960 00000100:00100000:1.0:1785774981.196959:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648664960 00000100:00100000:1.0:1785774981.197011:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24197 00000100:00100000:1.0:1785774981.197020:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:22362:x1872519648664960:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774981.199868:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968587 is committed 00000100:00100000:2.0:1785774981.200053:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:22362:x1872519648664960:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 3031us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774981.200064:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24197 00010000:00010000:1.0:1785774981.200149:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.200178:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.200186:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.200192:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76045e8200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774981.200197:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.200205:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.200220:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x4a6b5b31 (ffff9b7605dfe100) 00010000:00010000:1.0:1785774981.200224:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774981.200228:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.200235:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a1fba lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774981.217350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.217529:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648665216 00000100:00100000:2.0:1785774981.217540:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648665216 00000100:00100000:2.0:1785774981.217604:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24198 00000100:00100000:2.0:1785774981.217614:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+24:22362:x1872519648665216:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774981.217634:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.217659:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1fcf lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6d9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.224587:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.224612:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.224624:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.224643:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.224650:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.224657:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785774981.224967:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb:0x0], index 0: 0 00010000:00010000:3.0:1785774981.225116:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1fe4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225853:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225865:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225907:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225915:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225921:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225928:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225934:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774981.225939:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225946:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225958:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fceb00) 00010000:00010000:3.0:1785774981.225961:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774981.225965:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225972:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce000/0x7b7109e1d0a1fd6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774981.225985:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf448b27 reply state 00000000014df7a5 transno 4294968588 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.225997:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.226003:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa8a8d8e4 (ffff9b7711ae8a00) 00010000:00010000:3.0:1785774981.226006:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774981.226008:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774981.226052:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a1fcf lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6d9 expref: 27 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.227257:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1fe4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6d9 expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.227269:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:3.0:1785774981.227271:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774981.227275:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:3.0:1785774981.227393:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:22362:x1872519648665216:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 9780us (10276us total) trans 4294968588 rc 0/0 00000100:00100000:3.0:1785774981.227403:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24198 00000100:00100000:1.0:1785774981.239193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.239332:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648665472 00000100:00100000:0.0:1785774981.239342:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648665472 00000100:00100000:0.0:1785774981.239403:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5257 00000100:00100000:0.0:1785774981.239414:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:22362:x1872519648665472:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:0.0:1785774981.239889:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:22362:x1872519648665472:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 476us (737us total) trans 4294968589 rc 0/0 00000100:00100000:0.0:1785774981.239898:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5257 00000100:00100000:1.0:1785774981.247374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.247648:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648665600 00000100:00100000:0.0:1785774981.247658:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648665600 00000100:00100000:0.0:1785774981.247718:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24199 00000100:00100000:0.0:1785774981.247727:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:22362:x1872519648665600:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:3.0:1785774981.254501:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968589 is committed 00000100:00100000:1.0:1785774981.254734:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:22362:x1872519648665600:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 7002us (7361us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.254747:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24199 00010000:00010000:0.0:1785774981.254986:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.254998:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.255005:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.255012:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774981.255016:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.255023:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.255039:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xa8a8d8e4 (ffff9b7711ae8a00) 00010000:00010000:0.0:1785774981.255042:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774981.255046:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.255052:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a1fdd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774981.260850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.261317:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648665856 00000100:00100000:2.0:1785774981.261327:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648665856 00000100:00100000:2.0:1785774981.261392:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24200 00000100:00100000:2.0:1785774981.261403:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+25:22362:x1872519648665856:12345-192.168.202.31@tcp:101:createmany.0 00010000:00010000:2.0:1785774981.261423:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.261446:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ff2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6e0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.261709:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.261726:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.261737:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.261793:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.261802:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.261809:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785774981.262105:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb:0x0], index 1: 0 00010000:00010000:2.0:1785774981.262434:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a2007 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262443:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a2007 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262451:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a2007 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262493:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262500:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262506:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262512:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262518:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711744200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774981.262522:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262530:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262541:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fce500) 00010000:00010000:2.0:1785774981.262704:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774981.262710:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262717:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744200/0x7b7109e1d0a1ff9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785774981.262730:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbbf4f6c reply state 000000005c07dcbe transno 4294968590 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262742:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262748:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xff13bf8 (ffff9b7605fce700) 00010000:00010000:2.0:1785774981.262751:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774981.262753:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785774981.262830:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a1ff2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6e0 expref: 28 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262850:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a2007 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6e0 expref: 27 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.262858:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:2.0:1785774981.262861:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774981.262863:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745c00, rc 0) 00000100:00100000:2.0:1785774981.262956:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:22362:x1872519648665856:12345-192.168.202.31@tcp:101:createmany.0 Request processed in 1555us (2114us total) trans 4294968590 rc 0/0 00000100:00100000:2.0:1785774981.262963:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24200 00000100:00100000:3.0:1785774981.281980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.282295:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648666112 00000100:00100000:1.0:1785774981.282304:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648666112 00000100:00100000:1.0:1785774981.282361:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5258 00000100:00100000:1.0:1785774981.282371:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:22362:x1872519648666112:12345-192.168.202.31@tcp:35:createmany.0 00000100:00100000:1.0:1785774981.282786:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:22362:x1872519648666112:12345-192.168.202.31@tcp:35:createmany.0 Request processed in 416us (814us total) trans 4294968591 rc 0/0 00000100:00100000:1.0:1785774981.282793:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5258 00000100:00100000:1.0:1785774981.289913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774981.289997:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648666240 00000100:00100000:3.0:1785774981.290006:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648666240 00000100:00100000:3.0:1785774981.290061:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24201 00000100:00100000:3.0:1785774981.290070:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773feaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+29:22362:x1872519648666240:12345-192.168.202.31@tcp:44:createmany.0 00000001:00080000:0.0:1785774981.294457:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968591 is committed 00010000:00010000:1.0:1785774981.294545:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.294558:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.294565:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.294571:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7711745800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774981.294576:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.294585:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.294600:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xff13bf8 (ffff9b7605fce700) 00010000:00010000:1.0:1785774981.294603:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774981.294608:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.294616:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a2000 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774981.294857:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773feaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:22362:x1872519648666240:12345-192.168.202.31@tcp:44:createmany.0 Request processed in 4784us (4948us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774981.294867:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24201 00000100:00100000:3.0:1785774981.492503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.492633:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648666496 00000100:00100000:1.0:1785774981.492643:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648666496 00000100:00100000:1.0:1785774981.492708:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24202 00000100:00100000:1.0:1785774981.492719:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+26:22206:x1872519648666496:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774981.492740:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774981.492763:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a2015 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6e7 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.492878:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a201c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.492891:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a201c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.492901:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a201c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774981.492911:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 0 00010000:00010000:1.0:1785774981.493026:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a2015 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6e7 expref: 29 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.493046:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a201c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6e7 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.493053:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:1.0:1785774981.493057:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774981.493060:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8800, rc 0) 00000100:00100000:1.0:1785774981.493120:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:22206:x1872519648666496:12345-192.168.202.31@tcp:101:bash.0 Request processed in 403us (625us total) trans 4294968592 rc 0/0 00000100:00100000:1.0:1785774981.493128:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24202 00000100:00100000:1.0:1785774981.498115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.498199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648666624 00000100:00100000:0.0:1785774981.498209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648666624 00000100:00100000:0.0:1785774981.498267:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1499 00000100:00100000:0.0:1785774981.498277:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:2418:x1872519648666624:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774981.498291:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774981.498315:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a201c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6e7 expref: 28 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.498332:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:0.0:1785774981.498336:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774981.498384:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:2418:x1872519648666624:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.498391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1499 00000100:00100000:3.0:1785774981.508906:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.509041:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648666752 00000100:00100000:0.0:1785774981.509050:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648666752 00000100:00100000:0.0:1785774981.509128:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5352 00000100:00100000:0.0:1785774981.509138:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:22206:x1872519648666752:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774981.509155:0:8661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1785774981.509298:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785774981.509404:0:8661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a202a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6ee expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774981.509428:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774981.509450:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1223s v=(0 0) 00010000:00010000:0.0:1785774981.509454:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774981.509471:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a202a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6ee expref: 7 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.509488:0:8661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028661029/0x7b7109e1d0a202a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6ee expref: 7 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.509499:0:8661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9de00, rc 0) 00000100:00100000:0.0:1785774981.509561:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:22206:x1872519648666752:12345-192.168.202.31@tcp:101:bash.0 Request processed in 425us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.509568:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5352 00000100:00100000:3.0:1785774981.514711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.514891:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648666880 00000100:00100000:1.0:1785774981.514901:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648666880 00000100:00100000:1.0:1785774981.514960:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24203 00000100:00100000:1.0:1785774981.514969:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+27:22206:x1872519648666880:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774981.514993:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774981.515013:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a2031 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6f5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.515046:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8600/0x7b7109e1d0a2038 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.515060:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8600/0x7b7109e1d0a2038 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.515071:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8600/0x7b7109e1d0a2038 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.515236:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a2031 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6f5 expref: 29 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.515254:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8600/0x7b7109e1d0a2038 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6f5 expref: 28 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.515268:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:1.0:1785774981.515270:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774981.515274:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8600, rc 0) 00000100:00100000:1.0:1785774981.515386:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:22206:x1872519648666880:12345-192.168.202.31@tcp:101:bash.0 Request processed in 417us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.515393:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24203 00000100:00100000:1.0:1785774981.529323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.529484:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648667008 00000100:00100000:2.0:1785774981.529494:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648667008 00002000:00100000:2.0:1785774981.529555:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->5) req@ffff9b773fb8aa00 x1872519648667008/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/0 e 0 to 0 dl 1785774992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774981.529567:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb8aa00 with x1872519648667008 ext(0->5) 00002000:00010000:2.0:1785774981.529573:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb8aa00 00000100:00100000:2.0:1785774981.529607:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 43 00000100:00100000:2.0:1785774981.529618:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2417:x1872519648667008:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774981.531506:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648667008:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1886us (2188us total) trans 4294969953 rc 0/0 00000100:00100000:2.0:1785774981.531516:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 43 00002000:00100000:2.0:1785774981.531524:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->5) req@ffff9b773fb8aa00 x1872519648667008/t4294969953(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/448 e 0 to 0 dl 1785774992 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774981.531534:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb8aa00 with x1872519648667008 ext(0->5) 00002000:00010000:2.0:1785774981.531539:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb8aa00 00000100:00100000:3.0:1785774981.542417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.543370:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648667136 00000100:00100000:2.0:1785774981.543381:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648667136 00000100:00100000:2.0:1785774981.543442:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5353 00000100:00100000:2.0:1785774981.543452:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2418:x1872519648667136:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774981.546444:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969953 is committed 00000100:00100000:2.0:1785774981.546764:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2418:x1872519648667136:12345-192.168.202.31@tcp:16:bash.0 Request processed in 3310us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774981.546782:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5353 00000100:00100000:3.0:1785774981.558028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.561888:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648667392 00000100:00100000:0.0:1785774981.561900:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648667392 00000100:00100000:0.0:1785774981.562027:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5259 00000100:00100000:0.0:1785774981.562037:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+28:22206:x1872519648667392:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774981.562294:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968593 00000100:00100000:0.0:1785774981.562414:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:22206:x1872519648667392:12345-192.168.202.31@tcp:35:bash.0 Request processed in 378us (4394us total) trans 4294968594 rc 0/0 00000100:00100000:0.0:1785774981.562422:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5259 00000020:00080000:0.0:1785774981.562426:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774981.576958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.578672:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648667648 00000100:00100000:0.0:1785774981.578683:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648667648 00000100:00100000:0.0:1785774981.578742:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24204 00000100:00100000:0.0:1785774981.578750:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+30:22206:x1872519648667648:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774981.578783:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774981.578804:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a203f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c6fc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.578907:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a2046 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.578922:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a2046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.578933:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a2046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774981.578943:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19b:0x0]: returning size 0 00010000:00010000:0.0:1785774981.579031:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a203f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6fc expref: 33 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.579052:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a2046 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6fc expref: 32 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.579062:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:0.0:1785774981.579066:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774981.579069:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c600, rc 0) 00000100:00100000:0.0:1785774981.579675:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:22206:x1872519648667648:12345-192.168.202.31@tcp:101:bash.0 Request processed in 924us (2724us total) trans 4294968595 rc 0/0 00000100:00100000:0.0:1785774981.579683:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24204 00000100:00100000:1.0:1785774981.607000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.607079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774981.608909:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648667904 00000100:00100000:3.0:1785774981.608918:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648667904 00000100:00100000:3.0:1785774981.608982:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1500 00000100:00100000:3.0:1785774981.608991:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:2418:x1872519648667904:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774981.609005:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774981.609026:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a2046 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6fc expref: 32 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774981.609048:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:3.0:1785774981.609052:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774981.609129:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:2418:x1872519648667904:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 140us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774981.609136:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1500 00000100:00100000:2.0:1785774981.616500:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648667776 00000100:00100000:2.0:1785774981.616514:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648667776 00000100:00100000:2.0:1785774981.616914:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5354 00000100:00100000:2.0:1785774981.616925:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+6:22206:x1872519648667776:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774981.616942:0:14722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.616965:0:14722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048e3010f/0x7b7109e1d0a2054 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c703 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774981.616990:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774981.617015:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=1223s v=(0 0) 00010000:00010000:2.0:1785774981.617021:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774981.617029:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048e3010f/0x7b7109e1d0a2054 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c703 expref: 7 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.617047:0:14722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048e3010f/0x7b7109e1d0a2054 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c703 expref: 7 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.617060:0:14722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744200, rc 0) 00000100:00100000:2.0:1785774981.617151:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:22206:x1872519648667776:12345-192.168.202.31@tcp:101:bash.0 Request processed in 228us (10158us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774981.617174:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5354 00000100:00100000:3.0:1785774981.626614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.626755:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648668032 00000100:00100000:0.0:1785774981.626764:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648668032 00000100:00100000:0.0:1785774981.626828:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24205 00000100:00100000:0.0:1785774981.626837:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+31:22206:x1872519648668032:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774981.626861:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774981.626880:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a205b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c70a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.626910:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a2062 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.626922:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a2062 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.626932:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a2062 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.627032:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a205b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c70a expref: 33 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.627047:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d400/0x7b7109e1d0a2062 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c70a expref: 32 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.627054:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:0.0:1785774981.627057:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774981.627059:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9d400, rc 0) 00000100:00100000:0.0:1785774981.627136:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:22206:x1872519648668032:12345-192.168.202.31@tcp:101:bash.0 Request processed in 300us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.627141:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24205 00000100:00080000:1.0:1785774981.628818:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774981.638872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.638998:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648668160 00000100:00100000:2.0:1785774981.639007:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648668160 00002000:00100000:2.0:1785774981.639053:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x2:0x0] (0->5) req@ffff9b7603c5d880 x1872519648668160/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/0 e 0 to 0 dl 1785774992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774981.639062:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603c5d880 with x1872519648668160 ext(0->5) 00002000:00010000:2.0:1785774981.639067:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7603c5d880 00000100:00100000:2.0:1785774981.639099:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 44 00000100:00100000:2.0:1785774981.639115:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2417:x1872519648668160:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774981.641450:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648668160:12345-192.168.202.31@tcp:4:bash.0 Request processed in 2337us (2581us total) trans 4294969978 rc 0/0 00000100:00100000:2.0:1785774981.641468:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 44 00002000:00100000:2.0:1785774981.641478:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x2:0x0] (0->5) req@ffff9b7603c5d880 x1872519648668160/t4294969978(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/448 e 0 to 0 dl 1785774992 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774981.641488:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603c5d880 with x1872519648668160 ext(0->5) 00002000:00010000:2.0:1785774981.641492:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7603c5d880 00000100:00100000:3.0:1785774981.662569:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.662752:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648668288 00000100:00100000:1.0:1785774981.662781:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648668288 00000100:00100000:1.0:1785774981.662840:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5355 00000100:00100000:1.0:1785774981.662850:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648668288:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774981.670422:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969978 is committed 00000100:00100000:1.0:1785774981.671335:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:2416:x1872519648668288:12345-192.168.202.31@tcp:16:bash.0 Request processed in 8480us (8769us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.671347:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5355 00000100:00100000:0.0:1785774981.680241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.680338:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648668544 00000100:00100000:1.0:1785774981.680347:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648668544 00000100:00100000:1.0:1785774981.680407:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5260 00000100:00100000:1.0:1785774981.680417:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+32:22206:x1872519648668544:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:1.0:1785774981.680730:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968596 00000100:00100000:1.0:1785774981.681033:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:22206:x1872519648668544:12345-192.168.202.31@tcp:35:bash.0 Request processed in 616us (798us total) trans 4294968597 rc 0/0 00000100:00100000:1.0:1785774981.681045:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5260 00000020:00080000:1.0:1785774981.681050:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774981.698963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774981.701904:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648668800 00000100:00100000:3.0:1785774981.701916:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648668800 00000100:00100000:2.0:1785774981.705029:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24206 00000100:00100000:2.0:1785774981.705042:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+34:22206:x1872519648668800:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774981.705068:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.705092:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d0a2069 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c711 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.705264:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a2070 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.705279:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a2070 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.705295:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a2070 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774981.705307:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19c:0x0]: returning size 0 00010000:00010000:2.0:1785774981.705423:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745200/0x7b7109e1d0a2069 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c711 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.705443:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a2070 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c711 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.705452:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:2.0:1785774981.705466:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774981.705470:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745400, rc 0) 00000100:00100000:2.0:1785774981.705536:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:22206:x1872519648668800:12345-192.168.202.31@tcp:101:bash.0 Request processed in 496us (6580us total) trans 4294968598 rc 0/0 00000100:00100000:2.0:1785774981.706083:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24206 00000100:00100000:3.0:1785774981.714712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.715691:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648668928 00000100:00100000:0.0:1785774981.715702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648668928 00000100:00100000:0.0:1785774981.715781:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1501 00000100:00100000:0.0:1785774981.715792:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:2418:x1872519648668928:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774981.715807:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774981.715830:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a2070 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c711 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.715848:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:0.0:1785774981.715852:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774981.715904:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:2418:x1872519648668928:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 115us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.715911:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1501 00000100:00100000:3.0:1785774981.726068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.726201:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648669056 00000100:00100000:2.0:1785774981.726210:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648669056 00000100:00100000:2.0:1785774981.726261:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5356 00000100:00100000:2.0:1785774981.726272:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:22206:x1872519648669056:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774981.726289:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.726308:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093219bea/0x7b7109e1d0a207e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c718 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774981.726341:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774981.726362:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1223s v=(0 0) 00010000:00010000:2.0:1785774981.726367:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774981.726373:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093219bea/0x7b7109e1d0a207e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c718 expref: 8 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.726388:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093219bea/0x7b7109e1d0a207e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c718 expref: 8 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.726399:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745200, rc 0) 00000100:00100000:2.0:1785774981.726469:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22206:x1872519648669056:12345-192.168.202.31@tcp:101:bash.0 Request processed in 199us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774981.726476:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5356 00000100:00100000:3.0:1785774981.740683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.740827:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648669184 00000100:00100000:1.0:1785774981.740837:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648669184 00000100:00100000:1.0:1785774981.740901:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24207 00000100:00100000:1.0:1785774981.740912:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+35:22206:x1872519648669184:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774981.740938:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774981.740958:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a2085 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c71f expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.740991:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a208c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.741005:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a208c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.741017:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a208c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.741133:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a2085 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c71f expref: 37 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.741151:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9a00/0x7b7109e1d0a208c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c71f expref: 36 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.741193:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:1.0:1785774981.741196:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774981.741200:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9a00, rc 0) 00000100:00100000:1.0:1785774981.741254:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:22206:x1872519648669184:12345-192.168.202.31@tcp:101:bash.0 Request processed in 344us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.741261:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24207 00000100:00100000:3.0:1785774981.751130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.751329:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648669312 00000100:00100000:0.0:1785774981.751338:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648669312 00002000:00100000:0.0:1785774981.751385:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (0->5) req@ffff9b773ff07480 x1872519648669312/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/0 e 0 to 0 dl 1785774992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774981.751395:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff07480 with x1872519648669312 ext(0->5) 00002000:00010000:0.0:1785774981.751400:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773ff07480 00000100:00100000:0.0:1785774981.751431:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 45 00000100:00100000:0.0:1785774981.751440:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2419:x1872519648669312:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:0.0:1785774981.752509:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2419:x1872519648669312:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1066us (1386us total) trans 4294969954 rc 0/0 00000100:00100000:0.0:1785774981.752519:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 45 00002000:00100000:0.0:1785774981.752527:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (0->5) req@ffff9b773ff07480 x1872519648669312/t4294969954(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/448 e 0 to 0 dl 1785774992 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774981.752537:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff07480 with x1872519648669312 ext(0->5) 00002000:00010000:0.0:1785774981.752954:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773ff07480 00000100:00100000:0.0:1785774981.759625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.762482:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648669440 00000100:00100000:1.0:1785774981.762493:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648669440 00000100:00100000:1.0:1785774981.762639:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5357 00000100:00100000:1.0:1785774981.762649:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2419:x1872519648669440:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774981.763765:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969954 is committed 00000100:00100000:1.0:1785774981.764703:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2419:x1872519648669440:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2053us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.764714:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5357 00000100:00100000:3.0:1785774981.786025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.786630:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648669696 00000100:00100000:0.0:1785774981.786641:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648669696 00000100:00100000:0.0:1785774981.786703:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5261 00000100:00100000:0.0:1785774981.786713:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+36:22206:x1872519648669696:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774981.786932:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968599 00000100:00100000:0.0:1785774981.787038:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:22206:x1872519648669696:12345-192.168.202.31@tcp:35:bash.0 Request processed in 325us (1021us total) trans 4294968600 rc 0/0 00000100:00100000:0.0:1785774981.787047:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5261 00000020:00080000:0.0:1785774981.787051:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774981.802944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.803879:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648669952 00000100:00100000:0.0:1785774981.803890:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648669952 00000100:00100000:0.0:1785774981.803955:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24208 00000100:00100000:0.0:1785774981.803965:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+38:22206:x1872519648669952:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774981.803991:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774981.804011:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a2093 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c726 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.804123:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a209a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.804136:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a209a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.804147:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a209a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774981.804200:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19d:0x0]: returning size 0 00010000:00010000:0.0:1785774981.804342:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ca00/0x7b7109e1d0a2093 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c726 expref: 41 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.804365:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a209a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c726 expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.804374:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:0.0:1785774981.804377:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774981.804380:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c600, rc 0) 00000100:00100000:0.0:1785774981.804442:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:22206:x1872519648669952:12345-192.168.202.31@tcp:101:bash.0 Request processed in 478us (1507us total) trans 4294968601 rc 0/0 00000100:00100000:0.0:1785774981.804450:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24208 00000100:00100000:3.0:1785774981.826341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.826533:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648670080 00000100:00100000:1.0:1785774981.826554:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648670080 00000100:00100000:1.0:1785774981.826618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1502 00000100:00100000:1.0:1785774981.826628:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:2418:x1872519648670080:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774981.826646:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774981.826669:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a209a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c726 expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.826691:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:1.0:1785774981.826696:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774981.826758:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:2418:x1872519648670080:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 132us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.826766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1502 00000100:00100000:3.0:1785774981.836275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.836451:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648670208 00000100:00100000:0.0:1785774981.836470:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648670208 00000100:00100000:0.0:1785774981.836528:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5358 00000100:00100000:0.0:1785774981.836538:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+7:22206:x1872519648670208:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774981.836564:0:8661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774981.836586:0:8661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a20a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c72d expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774981.836610:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774981.836632:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=1223s v=(0 0) 00010000:00010000:0.0:1785774981.836637:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774981.836645:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a20a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c72d expref: 8 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.836661:0:8661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d29c6cf4/0x7b7109e1d0a20a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c72d expref: 8 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.836673:0:8661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ca00, rc 0) 00000100:00100000:0.0:1785774981.836741:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22206:x1872519648670208:12345-192.168.202.31@tcp:101:bash.0 Request processed in 204us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.836748:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5358 00000100:00100000:0.0:1785774981.851487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.851575:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648670336 00000100:00100000:2.0:1785774981.851585:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648670336 00000100:00100000:2.0:1785774981.851646:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24209 00000100:00100000:2.0:1785774981.851656:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+39:22206:x1872519648670336:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774981.851680:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.851700:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a20af lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c734 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.851732:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a20b6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.851746:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a20b6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.851758:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a20b6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.851879:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a20af lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c734 expref: 41 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.851898:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744c00/0x7b7109e1d0a20b6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c734 expref: 40 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.851907:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:2.0:1785774981.851910:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774981.851913:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711744c00, rc 0) 00000100:00100000:2.0:1785774981.851970:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:22206:x1872519648670336:12345-192.168.202.31@tcp:101:bash.0 Request processed in 316us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774981.851977:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24209 00000100:00100000:1.0:1785774981.875493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774981.876007:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648670464 00000100:00100000:3.0:1785774981.876017:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648670464 00002000:00100000:3.0:1785774981.876062:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x3:0x0] (0->5) req@ffff9b772a316300 x1872519648670464/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/0 e 0 to 0 dl 1785774992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774981.876073:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a316300 with x1872519648670464 ext(0->5) 00002000:00010000:3.0:1785774981.876079:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b772a316300 00000100:00100000:3.0:1785774981.876122:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 46 00000100:00100000:3.0:1785774981.876131:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2417:x1872519648670464:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774981.877298:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648670464:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1164us (1809us total) trans 4294969979 rc 0/0 00000100:00100000:3.0:1785774981.877308:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 46 00002000:00100000:3.0:1785774981.877315:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x3:0x0] (0->5) req@ffff9b772a316300 x1872519648670464/t4294969979(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/448 e 0 to 0 dl 1785774992 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774981.877333:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a316300 with x1872519648670464 ext(0->5) 00002000:00010000:3.0:1785774981.877337:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b772a316300 00000100:00100000:3.0:1785774981.893987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.894139:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648670592 00000100:00100000:2.0:1785774981.894149:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648670592 00000100:00100000:2.0:1785774981.894240:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5359 00000100:00100000:2.0:1785774981.894250:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648670592:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774981.898004:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969979 is committed 00000100:00100000:2.0:1785774981.898510:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:2416:x1872519648670592:12345-192.168.202.31@tcp:16:bash.0 Request processed in 4256us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774981.898521:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5359 00000100:00100000:0.0:1785774981.905008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.905091:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648670848 00000100:00100000:1.0:1785774981.905101:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648670848 00000100:00100000:1.0:1785774981.905280:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5262 00000100:00100000:1.0:1785774981.905304:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+40:22206:x1872519648670848:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:1.0:1785774981.905513:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968602 00000100:00100000:1.0:1785774981.905630:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+42:22206:x1872519648670848:12345-192.168.202.31@tcp:35:bash.0 Request processed in 340us (629us total) trans 4294968603 rc 0/0 00000100:00100000:3.0:1785774981.913363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.913790:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648671104 00000100:00100000:2.0:1785774981.913800:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648671104 00000100:00100000:2.0:1785774981.913845:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24210 00000100:00100000:2.0:1785774981.913854:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:22206:x1872519648671104:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774981.913878:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.913903:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a20bd lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c73b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.914010:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a20c4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.914024:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a20c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.914037:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a20c4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774981.914049:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19e:0x0]: returning size 0 00010000:00010000:2.0:1785774981.914310:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745800/0x7b7109e1d0a20bd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c73b expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.914346:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a20c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c73b expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.914355:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:2.0:1785774981.914358:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774981.914361:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745400, rc 0) 00000100:00100000:2.0:1785774981.914421:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+45:22206:x1872519648671104:12345-192.168.202.31@tcp:101:bash.0 Request processed in 567us (1066us total) trans 4294968604 rc 0/0 00000100:00100000:2.0:1785774981.914428:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24210 00000100:00100000:1.0:1785774981.917138:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5262 00000020:00080000:1.0:1785774981.917147:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774981.922845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.923092:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648671232 00000100:00100000:1.0:1785774981.923112:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648671232 00000100:00100000:1.0:1785774981.923329:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1503 00000100:00100000:1.0:1785774981.923339:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:2419:x1872519648671232:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774981.923355:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774981.923376:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a20c4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c73b expref: 44 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774981.923392:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:1.0:1785774981.923397:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774981.923451:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:2419:x1872519648671232:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 114us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.923466:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1503 00000100:00100000:3.0:1785774981.927995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774981.928093:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648671360 00000100:00100000:2.0:1785774981.928102:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648671360 00000100:00100000:2.0:1785774981.928203:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5360 00000100:00100000:2.0:1785774981.928216:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22206:x1872519648671360:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774981.928233:0:14719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774981.928254:0:14719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d0a20d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c742 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774981.928284:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774981.928307:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1223s v=(0 0) 00010000:00010000:2.0:1785774981.928312:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774981.928541:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d0a20d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c742 expref: 9 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.928562:0:14719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e464bcf/0x7b7109e1d0a20d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c742 expref: 9 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774981.928576:0:14719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745800, rc 0) 00000100:00100000:2.0:1785774981.928633:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22206:x1872519648671360:12345-192.168.202.31@tcp:101:bash.0 Request processed in 418us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774981.928639:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5360 00010000:00010000:0.0:1785774981.929945:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774981.937405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.940870:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648671488 00000100:00100000:0.0:1785774981.940882:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648671488 00000100:00100000:0.0:1785774981.940938:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24211 00000100:00100000:0.0:1785774981.940946:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+43:22206:x1872519648671488:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774981.940967:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774981.940988:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a20d9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c749 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.941017:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a20e0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.941029:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a20e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.941039:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a20e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.941902:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c400/0x7b7109e1d0a20d9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c749 expref: 45 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.941925:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c600/0x7b7109e1d0a20e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c749 expref: 44 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774981.941933:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:0.0:1785774981.941935:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774981.941938:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c600, rc 0) 00000100:00100000:0.0:1785774981.942058:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:22206:x1872519648671488:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1112us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774981.942065:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24211 00000100:00100000:3.0:1785774981.960307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.963906:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648671616 00000100:00100000:0.0:1785774981.963920:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648671616 00002000:00100000:0.0:1785774981.963976:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->5) req@ffff9b773fb02680 x1872519648671616/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/0 e 0 to 0 dl 1785774992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774981.963986:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb02680 with x1872519648671616 ext(0->5) 00002000:00010000:0.0:1785774981.963992:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb02680 00000100:00100000:0.0:1785774981.964027:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 47 00000100:00100000:0.0:1785774981.964036:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648671616:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:1.0:1785774981.965947:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648671616:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1907us (5643us total) trans 4294969955 rc 0/0 00000100:00100000:1.0:1785774981.965957:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 47 00002000:00100000:1.0:1785774981.965965:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->5) req@ffff9b773fb02680 x1872519648671616/t4294969955(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:672/0 lens 496/448 e 0 to 0 dl 1785774992 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774981.965981:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb02680 with x1872519648671616 ext(0->5) 00002000:00010000:1.0:1785774981.965986:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb02680 00000100:00100000:2.0:1785774981.979475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774981.979872:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648671744 00000100:00100000:1.0:1785774981.979882:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648671744 00000100:00100000:1.0:1785774981.979978:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5361 00000100:00100000:1.0:1785774981.979988:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648671744:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774981.984248:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969955 is committed 00000100:00100000:1.0:1785774981.984474:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2419:x1872519648671744:12345-192.168.202.31@tcp:16:bash.0 Request processed in 4482us (5014us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774981.984485:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5361 00000100:00100000:3.0:1785774981.991351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774981.991548:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648672000 00000100:00100000:0.0:1785774981.991557:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648672000 00000100:00100000:0.0:1785774981.991622:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5263 00000100:00100000:0.0:1785774981.991633:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+44:22206:x1872519648672000:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774981.991848:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968605 00000100:00100000:0.0:1785774981.991956:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:22206:x1872519648672000:12345-192.168.202.31@tcp:35:bash.0 Request processed in 324us (612us total) trans 4294968606 rc 0/0 00000100:00100000:0.0:1785774981.991965:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5263 00000020:00080000:0.0:1785774981.991969:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774982.003813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.003926:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648672256 00000100:00100000:2.0:1785774982.003935:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648672256 00000100:00100000:2.0:1785774982.003988:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24212 00000100:00100000:2.0:1785774982.003997:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+46:22206:x1872519648672256:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.004021:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.004042:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a20e7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c750 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.004149:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a20ee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.004210:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a20ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.004222:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a20ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774982.004233:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19f:0x0]: returning size 0 00010000:00010000:2.0:1785774982.004552:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a20e7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c750 expref: 49 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.004575:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a20ee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c750 expref: 48 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.004584:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:2.0:1785774982.004587:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774982.004591:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc400, rc 0) 00000100:00100000:2.0:1785774982.004644:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:22206:x1872519648672256:12345-192.168.202.31@tcp:101:bash.0 Request processed in 648us (839us total) trans 4294968607 rc 0/0 00000100:00100000:2.0:1785774982.004651:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24212 00000100:00100000:3.0:1785774982.010202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.010240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.010316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648672512 00000100:00100000:1.0:1785774982.010332:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648672512 00000100:00100000:1.0:1785774982.010390:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1504 00000100:00100000:1.0:1785774982.010398:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7707d70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:2418:x1872519648672512:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774982.010411:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774982.010432:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a20ee lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c750 expref: 48 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.010449:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:1.0:1785774982.010463:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774982.010517:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7707d70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:2418:x1872519648672512:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 120us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.010526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1504 00000100:00100000:0.0:1785774982.010649:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648672384 00000100:00100000:0.0:1785774982.010653:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648672384 00000100:00100000:0.0:1785774982.010695:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5362 00000100:00100000:0.0:1785774982.010702:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+8:22206:x1872519648672384:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.010714:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.010729:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82ac659/0x7b7109e1d0a20fc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c757 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774982.010749:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774982.010764:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=1223s v=(0 0) 00010000:00010000:0.0:1785774982.010768:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774982.010784:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82ac659/0x7b7109e1d0a20fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c757 expref: 9 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.010798:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a82ac659/0x7b7109e1d0a20fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c757 expref: 9 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.010807:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9c400, rc 0) 00000100:00100000:0.0:1785774982.010837:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22206:x1872519648672384:12345-192.168.202.31@tcp:101:bash.0 Request processed in 137us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.010843:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5362 00000100:00100000:3.0:1785774982.019828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.019971:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648672640 00000100:00100000:2.0:1785774982.019981:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648672640 00000100:00100000:2.0:1785774982.020041:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24213 00000100:00100000:2.0:1785774982.020051:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:22206:x1872519648672640:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.020075:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.020095:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a2103 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c75e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.020144:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dca00/0x7b7109e1d0a210a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.020157:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dca00/0x7b7109e1d0a210a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.020202:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dca00/0x7b7109e1d0a210a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.020312:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a2103 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c75e expref: 49 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.020344:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dca00/0x7b7109e1d0a210a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c75e expref: 48 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.020352:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:2.0:1785774982.020355:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774982.020359:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dca00, rc 0) 00000100:00100000:2.0:1785774982.020413:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:22206:x1872519648672640:12345-192.168.202.31@tcp:101:bash.0 Request processed in 363us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.020420:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24213 00000100:00100000:3.0:1785774982.046051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.046247:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648672768 00000100:00100000:2.0:1785774982.046258:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648672768 00002000:00100000:2.0:1785774982.046304:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x4:0x0] (0->5) req@ffff9b773fb00e00 x1872519648672768/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.046315:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb00e00 with x1872519648672768 ext(0->5) 00002000:00010000:2.0:1785774982.046332:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fb00e00 00000100:00100000:2.0:1785774982.046364:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 48 00000100:00100000:2.0:1785774982.046373:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2417:x1872519648672768:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774982.047738:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648672768:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1362us (1692us total) trans 4294969980 rc 0/0 00000100:00100000:2.0:1785774982.047749:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 48 00002000:00100000:2.0:1785774982.047757:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x4:0x0] (0->5) req@ffff9b773fb00e00 x1872519648672768/t4294969980(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.047766:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb00e00 with x1872519648672768 ext(0->5) 00002000:00010000:2.0:1785774982.048668:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fb00e00 00000100:00100000:0.0:1785774982.067539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.067661:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648672896 00000100:00100000:1.0:1785774982.067671:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648672896 00000100:00100000:1.0:1785774982.067722:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5363 00000100:00100000:1.0:1785774982.067731:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2416:x1872519648672896:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774982.069059:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969980 is committed 00000100:00100000:1.0:1785774982.069429:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:2416:x1872519648672896:12345-192.168.202.31@tcp:16:bash.0 Request processed in 1697us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.069437:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5363 00000100:00100000:3.0:1785774982.077392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.077469:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648673152 00000100:00100000:0.0:1785774982.077477:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648673152 00000100:00100000:0.0:1785774982.077534:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5264 00000100:00100000:0.0:1785774982.077543:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:22206:x1872519648673152:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774982.077741:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968608 00000100:00100000:0.0:1785774982.079912:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:22206:x1872519648673152:12345-192.168.202.31@tcp:35:bash.0 Request processed in 2364us (2522us total) trans 4294968609 rc 0/0 00000100:00100000:0.0:1785774982.079924:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5264 00000020:00080000:0.0:1785774982.079930:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774982.093946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.094097:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648673408 00000100:00100000:2.0:1785774982.094116:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648673408 00000100:00100000:2.0:1785774982.094227:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24214 00000100:00100000:2.0:1785774982.094237:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:22206:x1872519648673408:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.094264:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.094289:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a2111 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c765 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.094404:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a2118 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.094419:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a2118 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.094431:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a2118 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774982.094442:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a0:0x0]: returning size 0 00010000:00010000:2.0:1785774982.094553:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418ddc00/0x7b7109e1d0a2111 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c765 expref: 53 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.094577:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a2118 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c765 expref: 52 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.094586:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:2.0:1785774982.094589:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774982.094593:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dd600, rc 0) 00000100:00100000:2.0:1785774982.094661:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:22206:x1872519648673408:12345-192.168.202.31@tcp:101:bash.0 Request processed in 425us (724us total) trans 4294968610 rc 0/0 00000100:00100000:2.0:1785774982.094669:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24214 00000100:00100000:1.0:1785774982.113155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.113251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.113336:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648673664 00000100:00100000:2.0:1785774982.113345:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648673664 00000100:00100000:2.0:1785774982.113392:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5364 00000100:00100000:2.0:1785774982.113400:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22206:x1872519648673664:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.113417:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.113436:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0207d49/0x7b7109e1d0a2126 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c76c expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774982.113490:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774982.113514:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1223s v=(0 0) 00010000:00010000:2.0:1785774982.113520:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774982.113528:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0207d49/0x7b7109e1d0a2126 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c76c expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.113545:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0207d49/0x7b7109e1d0a2126 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c76c expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.113559:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418ddc00, rc 0) 00000100:00100000:2.0:1785774982.113622:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:22206:x1872519648673664:12345-192.168.202.31@tcp:101:bash.0 Request processed in 222us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.113630:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5364 00000100:00100000:3.0:1785774982.113798:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648673536 00000100:00100000:3.0:1785774982.113803:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648673536 00000100:00100000:3.0:1785774982.113849:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1505 00000100:00100000:3.0:1785774982.113857:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:2417:x1872519648673536:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774982.113867:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774982.113889:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a2118 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c765 expref: 52 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774982.113906:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:3.0:1785774982.113910:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774982.113932:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:2417:x1872519648673536:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 77us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.113939:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1505 00000100:00100000:3.0:1785774982.130283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.130492:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648673792 00000100:00100000:1.0:1785774982.130501:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648673792 00000100:00100000:1.0:1785774982.130557:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24215 00000100:00100000:1.0:1785774982.130567:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:22206:x1872519648673792:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774982.130590:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774982.130612:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a212d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c773 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.130646:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a2134 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.130659:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a2134 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.130671:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a2134 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.130800:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a212d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c773 expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.130818:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9e00/0x7b7109e1d0a2134 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c773 expref: 52 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.130831:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774982.130834:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774982.130838:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9e00, rc 0) 00000100:00100000:1.0:1785774982.130898:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:22206:x1872519648673792:12345-192.168.202.31@tcp:101:bash.0 Request processed in 332us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.130904:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24215 00000100:00100000:1.0:1785774982.152331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.152419:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648673920 00000100:00100000:2.0:1785774982.152428:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648673920 00002000:00100000:2.0:1785774982.152485:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->5) req@ffff9b772a315f80 x1872519648673920/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.152495:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a315f80 with x1872519648673920 ext(0->5) 00002000:00010000:2.0:1785774982.152501:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a315f80 00000100:00100000:2.0:1785774982.152535:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 49 00000100:00100000:2.0:1785774982.152545:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2416:x1872519648673920:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774982.154577:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2416:x1872519648673920:12345-192.168.202.31@tcp:4:bash.0 Request processed in 2027us (2259us total) trans 4294969956 rc 0/0 00000100:00100000:3.0:1785774982.154588:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 49 00002000:00100000:3.0:1785774982.154598:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->5) req@ffff9b772a315f80 x1872519648673920/t4294969956(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774982.154607:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a315f80 with x1872519648673920 ext(0->5) 00002000:00010000:3.0:1785774982.154613:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a315f80 00000100:00100000:3.0:1785774982.175150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.175345:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648674048 00000100:00100000:2.0:1785774982.175355:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648674048 00000100:00100000:2.0:1785774982.175415:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5365 00000100:00100000:2.0:1785774982.175425:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648674048:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774982.178154:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969956 is committed 00000100:00100000:2.0:1785774982.186021:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2417:x1872519648674048:12345-192.168.202.31@tcp:16:bash.0 Request processed in 10589us (10870us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.186034:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5365 00000100:00100000:2.0:1785774982.198593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.202533:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648674304 00000100:00100000:0.0:1785774982.202548:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648674304 00000100:00100000:0.0:1785774982.204362:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5265 00000100:00100000:0.0:1785774982.204378:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+52:22206:x1872519648674304:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774982.204642:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968611 00000100:00100000:0.0:1785774982.204755:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22206:x1872519648674304:12345-192.168.202.31@tcp:35:bash.0 Request processed in 383us (6170us total) trans 4294968612 rc 0/0 00000100:00100000:0.0:1785774982.204763:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5265 00000020:00080000:0.0:1785774982.204767:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774982.217556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.219904:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648674560 00000100:00100000:2.0:1785774982.219916:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648674560 00000100:00100000:2.0:1785774982.219985:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24216 00000100:00100000:2.0:1785774982.219995:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22206:x1872519648674560:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.220023:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.220047:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc800/0x7b7109e1d0a213b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c77a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.220309:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2142 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.220378:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2142 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.220392:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2142 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774982.220406:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 0 00010000:00010000:2.0:1785774982.220520:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc800/0x7b7109e1d0a213b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c77a expref: 57 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.220543:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2142 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c77a expref: 56 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.220552:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:2.0:1785774982.220555:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774982.220558:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc600, rc 0) 00000100:00100000:2.0:1785774982.220662:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22206:x1872519648674560:12345-192.168.202.31@tcp:101:bash.0 Request processed in 667us (3219us total) trans 4294968613 rc 0/0 00000100:00100000:2.0:1785774982.220669:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24216 00000100:00100000:1.0:1785774982.229804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.229877:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648674688 00000100:00100000:2.0:1785774982.229885:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648674688 00000100:00100000:2.0:1785774982.229942:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1506 00000100:00100000:2.0:1785774982.229951:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:2418:x1872519648674688:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774982.229966:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774982.229990:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2142 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c77a expref: 56 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.230008:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:2.0:1785774982.230012:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774982.230066:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:2418:x1872519648674688:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.230073:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1506 00000100:00100000:2.0:1785774982.252260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.252343:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648674816 00000100:00100000:3.0:1785774982.252352:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648674816 00000100:00100000:3.0:1785774982.252402:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5366 00000100:00100000:3.0:1785774982.252411:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+9:22206:x1872519648674816:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774982.252427:0:14719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774982.252446:0:14719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a2150 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c781 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774982.252489:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774982.252509:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:3.0:1785774982.252513:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774982.252521:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a2150 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c781 expref: 10 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774982.252539:0:14719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f205f2b5/0x7b7109e1d0a2150 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c781 expref: 10 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774982.252552:0:14719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce200, rc 0) 00000100:00100000:3.0:1785774982.252609:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:22206:x1872519648674816:12345-192.168.202.31@tcp:101:bash.0 Request processed in 198us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.252616:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5366 00000100:00100000:3.0:1785774982.275725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.275869:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648674944 00000100:00100000:2.0:1785774982.275877:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648674944 00000100:00100000:2.0:1785774982.275932:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24217 00000100:00100000:2.0:1785774982.275941:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:22206:x1872519648674944:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.275961:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.275979:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2157 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c788 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.276008:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc800/0x7b7109e1d0a215e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.276021:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc800/0x7b7109e1d0a215e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.276030:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc800/0x7b7109e1d0a215e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.276156:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2157 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c788 expref: 57 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.276212:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc800/0x7b7109e1d0a215e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c788 expref: 56 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.276220:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:2.0:1785774982.276223:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774982.276226:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc800, rc 0) 00000100:00100000:2.0:1785774982.276287:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22206:x1872519648674944:12345-192.168.202.31@tcp:101:bash.0 Request processed in 347us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.276293:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24217 00000100:00100000:1.0:1785774982.299469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.299587:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648675072 00000100:00100000:3.0:1785774982.299595:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648675072 00002000:00100000:3.0:1785774982.299640:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x5:0x0] (0->5) req@ffff9b772a314a80 x1872519648675072/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774982.299651:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314a80 with x1872519648675072 ext(0->5) 00002000:00010000:3.0:1785774982.299656:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b772a314a80 00000100:00100000:3.0:1785774982.299690:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 50 00000100:00100000:3.0:1785774982.299698:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2419:x1872519648675072:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774982.300590:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2419:x1872519648675072:12345-192.168.202.31@tcp:4:bash.0 Request processed in 891us (1139us total) trans 4294969981 rc 0/0 00000100:00100000:3.0:1785774982.300599:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 50 00002000:00100000:3.0:1785774982.300606:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x5:0x0] (0->5) req@ffff9b772a314a80 x1872519648675072/t4294969981(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774982.300614:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314a80 with x1872519648675072 ext(0->5) 00002000:00010000:3.0:1785774982.300617:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b772a314a80 00000100:00100000:2.0:1785774982.311260:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76037f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671386496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774982.311590:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774982.311717:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671386496 00000100:00100000:0.0:1785774982.311724:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671386496 00000100:00100000:0.0:1785774982.311787:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:0.0:1785774982.311796:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671386496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1785774982.311833:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443889152 avail 1297649664 00000100:00100000:0.0:1785774982.311878:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:3655:x1872519671386496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.311885:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000100:00100000:3.0:1785774982.312307:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671386880:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312430:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671386624:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312474:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774982.312496:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671387136:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312521:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774982.312540:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671387648:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312562:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774982.312579:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1785774982.312584:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671387008:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312611:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774982.312625:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671387520:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312649:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774982.312663:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388032:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312703:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774982.312727:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387008 00000100:00100000:0.0:1785774982.312731:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387008 00000100:00100000:0.0:1785774982.312753:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:0.0:1785774982.312758:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671387008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312803:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671387008:12345-0@lo:400:kworker.0 Request processed in 44us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.312809:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000100:00100000:0.0:1785774982.312825:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387520 00000100:00100000:0.0:1785774982.312828:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387520 00000100:00100000:0.0:1785774982.312854:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671388032 00000100:00100000:0.0:1785774982.312856:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671388032 00000100:00100000:0.0:1785774982.312871:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1785774982.312876:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671387520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312906:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671387520:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.312911:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1785774982.312920:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1785774982.312925:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.312943:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388032:12345-0@lo:400:kworker.0 Request processed in 19us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.312949:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00080000:0.0:1785774982.312962:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774982.312966:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774982.312992:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671387008:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.313001:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671387520:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.313009:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388032:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.313032:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387136 00000100:00100000:0.0:1785774982.313034:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387136 00000100:00080000:0.0:1785774982.313047:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774982.313069:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387648 00000100:00100000:0.0:1785774982.313072:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387648 00000100:00080000:0.0:1785774982.313082:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774982.313091:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1785774982.313097:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671387136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.313143:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1872519671387136:12345-0@lo:400:kworker.0 Request processed in 45us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.313149:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1785774982.313193:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1872519671387136:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.313226:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1785774982.313232:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671387648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.313265:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1872519671387648:12345-0@lo:400:kworker.0 Request processed in 33us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.313271:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1785774982.313292:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1872519671387648:0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.313516:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671386752:0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.313547:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774982.313574:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671387264:0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.313597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774982.313611:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671387776:0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.313632:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774982.313660:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671386624 00000100:00100000:1.0:1785774982.313664:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671386624 00000100:00100000:1.0:1785774982.313691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1785774982.313697:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671386624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.313729:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3656:x1872519671386624:12345-0@lo:400:kworker.0 Request processed in 32us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.313735:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1785774982.313839:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774982.313857:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671387392:0@lo:400:kworker.0 00000100:00100000:3.0:1785774982.313878:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774982.313897:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671387904:0@lo:400:kworker.0 00000100:00100000:3.0:1785774982.313929:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774982.313953:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387392 00000100:00100000:3.0:1785774982.313956:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387392 00000100:00100000:3.0:1785774982.313982:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387904 00000100:00100000:3.0:1785774982.313983:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387904 00000100:00100000:3.0:1785774982.313999:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1785774982.314004:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671387392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774982.314042:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671387392:12345-0@lo:400:kworker.0 Request processed in 38us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.314048:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1785774982.314058:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1785774982.314064:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671387904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.314217:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671386752 00000100:00100000:1.0:1785774982.314222:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671386752 00000100:00100000:1.0:1785774982.314238:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387264 00000100:00100000:1.0:1785774982.314240:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387264 00000100:00100000:1.0:1785774982.314251:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671387776 00000100:00100000:1.0:1785774982.314253:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671387776 00000100:00100000:1.0:1785774982.314265:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1785774982.314271:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671386752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774982.314363:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76037f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671386496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774982.314381:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671386880 00000100:00100000:2.0:1785774982.314383:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671386880 00000100:00100000:2.0:1785774982.314399:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1785774982.314403:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671387264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774982.314478:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671387904:12345-0@lo:400:kworker.0 Request processed in 388us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.314485:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00080000:3.0:1785774982.314505:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1785774982.314508:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774982.314510:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774982.314527:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671387392:0@lo:400:kworker.0 00000100:00100000:3.0:1785774982.314536:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671387904:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.315189:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed609441-cebf-42ae-a19c-5d7643dc37b0:3656:1872519671386624:0@lo:400:kworker.0 00000100:00100000:0.0:1785774982.315214:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1785774982.315223:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671387776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774982.315293:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1785774982.315300:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671386880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.319745:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1872519671386752:12345-0@lo:400:kworker.0 Request processed in 5464us (6186us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.319759:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1785774982.319833:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1872519671386752:0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.320076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.322882:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648675200 00000100:00100000:2.0:1785774982.322894:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648675200 00000100:00100000:2.0:1785774982.322957:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5367 00000100:00100000:2.0:1785774982.322966:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648675200:12345-192.168.202.31@tcp:16:bash.0 00000100:00100000:0.0:1785774982.323931:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1872519671387776:12345-0@lo:400:kworker.0 Request processed in 8706us (10293us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.323942:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1785774982.324903:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1872519671387264:12345-0@lo:400:kworker.0 Request processed in 10497us (11303us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.324912:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1785774982.325399:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671386880:12345-0@lo:400:kworker.0 Request processed in 10097us (11557us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.325406:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1785774982.325608:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671386880:0@lo:400:kworker.0 00000001:00080000:3.0:1785774982.325685:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969981 is committed 00000100:00100000:2.0:1785774982.325877:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:2418:x1872519648675200:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2910us (5802us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.325885:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5367 00000100:00100000:3.0:1785774982.329024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.329236:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648675456 00000100:00100000:2.0:1785774982.329245:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648675456 00000100:00100000:2.0:1785774982.329296:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5266 00000100:00100000:2.0:1785774982.329305:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22206:x1872519648675456:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:2.0:1785774982.329682:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968614 00000100:00100000:2.0:1785774982.329882:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22206:x1872519648675456:12345-192.168.202.31@tcp:35:bash.0 Request processed in 577us (863us total) trans 4294968615 rc 0/0 00000100:00100000:2.0:1785774982.329889:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5266 00000020:00080000:2.0:1785774982.329894:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774982.332235:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1872519671387776:0@lo:400:kworker.0 00000100:00100000:1.0:1785774982.332305:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1872519671387264:0@lo:400:kworker.0 00000100:00100000:3.0:1785774982.344562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.345209:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648675712 00000100:00100000:1.0:1785774982.345220:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648675712 00000100:00100000:1.0:1785774982.345283:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24218 00000100:00100000:1.0:1785774982.345293:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22206:x1872519648675712:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774982.345328:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774982.345353:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a2165 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c78f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.345473:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a216c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.345488:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a216c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.345503:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a216c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774982.345515:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a2:0x0]: returning size 0 00010000:00010000:1.0:1785774982.345624:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a2165 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c78f expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.345649:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a216c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c78f expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.345658:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:1.0:1785774982.345660:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774982.345663:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8200, rc 0) 00000100:00100000:1.0:1785774982.345732:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22206:x1872519648675712:12345-192.168.202.31@tcp:101:bash.0 Request processed in 441us (1180us total) trans 4294968616 rc 0/0 00000100:00100000:1.0:1785774982.345739:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24218 00000100:00100000:0.0:1785774982.367059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.367196:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648675840 00000100:00100000:2.0:1785774982.367206:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648675840 00000100:00100000:2.0:1785774982.367270:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1507 00000100:00100000:2.0:1785774982.367279:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:2418:x1872519648675840:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774982.367294:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774982.367326:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a216c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c78f expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.367347:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:2.0:1785774982.367351:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774982.367402:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:2418:x1872519648675840:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 124us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.367410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1507 00000100:00100000:2.0:1785774982.377823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.377986:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648675968 00000100:00100000:3.0:1785774982.377994:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648675968 00000100:00100000:3.0:1785774982.378047:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5368 00000100:00100000:3.0:1785774982.378056:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:22206:x1872519648675968:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774982.378075:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774982.378096:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7958a52/0x7b7109e1d0a217a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c796 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774982.378131:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774982.378204:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:3.0:1785774982.378210:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774982.378219:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7958a52/0x7b7109e1d0a217a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c796 expref: 11 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774982.378237:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7958a52/0x7b7109e1d0a217a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c796 expref: 11 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774982.378255:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce000, rc 0) 00000100:00100000:3.0:1785774982.378306:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22206:x1872519648675968:12345-192.168.202.31@tcp:101:bash.0 Request processed in 251us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.378313:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5368 00000100:00100000:1.0:1785774982.388703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.388782:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648676096 00000100:00100000:0.0:1785774982.388791:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648676096 00000100:00100000:0.0:1785774982.388850:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24219 00000100:00100000:0.0:1785774982.388861:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:22206:x1872519648676096:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.388886:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.388908:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a2181 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c79d expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.388943:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a2188 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.388957:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a2188 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.388969:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a2188 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.389082:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a2181 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c79d expref: 61 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.389099:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6a00/0x7b7109e1d0a2188 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c79d expref: 60 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.389108:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:0.0:1785774982.389111:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774982.389115:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea6a00, rc 0) 00000100:00100000:0.0:1785774982.389416:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22206:x1872519648676096:12345-192.168.202.31@tcp:101:bash.0 Request processed in 557us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.389423:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24219 00000100:00100000:1.0:1785774982.403227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.403477:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648676224 00000100:00100000:2.0:1785774982.403488:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648676224 00002000:00100000:2.0:1785774982.403537:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->5) req@ffff9b772a317480 x1872519648676224/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.403548:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a317480 with x1872519648676224 ext(0->5) 00002000:00010000:2.0:1785774982.403553:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a317480 00000100:00100000:2.0:1785774982.403587:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 51 00000100:00100000:2.0:1785774982.403597:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2418:x1872519648676224:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774982.404522:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2418:x1872519648676224:12345-192.168.202.31@tcp:4:bash.0 Request processed in 924us (1300us total) trans 4294969957 rc 0/0 00000100:00100000:2.0:1785774982.404531:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 51 00002000:00100000:2.0:1785774982.404539:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->5) req@ffff9b772a317480 x1872519648676224/t4294969957(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.404548:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a317480 with x1872519648676224 ext(0->5) 00002000:00010000:2.0:1785774982.404552:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a317480 00000100:00100000:3.0:1785774982.414056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.414198:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648676352 00000100:00100000:0.0:1785774982.414208:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648676352 00000100:00100000:0.0:1785774982.414269:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5369 00000100:00100000:0.0:1785774982.414280:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648676352:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774982.423309:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969957 is committed 00000100:00100000:0.0:1785774982.425428:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648676352:12345-192.168.202.31@tcp:16:bash.0 Request processed in 11141us (11372us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.425442:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5369 00000100:00100000:1.0:1785774982.429740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.429819:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648676608 00000100:00100000:0.0:1785774982.429828:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648676608 00000100:00100000:0.0:1785774982.429881:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5267 00000100:00100000:0.0:1785774982.429890:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22206:x1872519648676608:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774982.430080:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968617 00000100:00100000:0.0:1785774982.430222:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:22206:x1872519648676608:12345-192.168.202.31@tcp:35:bash.0 Request processed in 332us (488us total) trans 4294968618 rc 0/0 00000100:00100000:0.0:1785774982.430230:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5267 00000020:00080000:0.0:1785774982.430234:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774982.439768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.439851:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648676864 00000100:00100000:2.0:1785774982.439860:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648676864 00000100:00100000:2.0:1785774982.439911:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24220 00000100:00100000:2.0:1785774982.439919:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:22206:x1872519648676864:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.439942:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.439964:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a218f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7a4 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.440077:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2196 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.440092:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2196 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.440241:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2196 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774982.440255:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a3:0x0]: returning size 0 00010000:00010000:2.0:1785774982.440499:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a218f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7a4 expref: 65 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.440520:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2196 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7a4 expref: 64 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.440527:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:2.0:1785774982.440530:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774982.440533:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc600, rc 0) 00000100:00100000:2.0:1785774982.440627:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:22206:x1872519648676864:12345-192.168.202.31@tcp:101:bash.0 Request processed in 708us (866us total) trans 4294968619 rc 0/0 00000100:00100000:2.0:1785774982.440634:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24220 00000100:00100000:3.0:1785774982.453617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.453822:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648676992 00000100:00100000:2.0:1785774982.453831:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648676992 00000100:00100000:2.0:1785774982.453893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1508 00000100:00100000:2.0:1785774982.453902:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:2418:x1872519648676992:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774982.453917:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774982.453939:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2196 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7a4 expref: 64 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.453958:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:2.0:1785774982.453962:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774982.454011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:2418:x1872519648676992:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.454018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1508 00000100:00100000:1.0:1785774982.462534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.462612:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648677120 00000100:00100000:0.0:1785774982.462621:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648677120 00000100:00100000:0.0:1785774982.462679:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5370 00000100:00100000:0.0:1785774982.462689:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+10:22206:x1872519648677120:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.462706:0:14530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.462726:0:14530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c68df1d6/0x7b7109e1d0a21a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7ab expref: -99 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774982.462749:0:14530:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774982.462769:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:0.0:1785774982.462773:0:14530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774982.462781:0:14530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c68df1d6/0x7b7109e1d0a21a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ab expref: 11 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.462796:0:14530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c68df1d6/0x7b7109e1d0a21a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ab expref: 11 pid: 14530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.462808:0:14530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7400, rc 0) 00000100:00100000:0.0:1785774982.462865:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22206:x1872519648677120:12345-192.168.202.31@tcp:101:bash.0 Request processed in 177us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.462872:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5370 00000100:00100000:0.0:1785774982.467065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.467209:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648677248 00000100:00100000:1.0:1785774982.467218:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648677248 00000100:00100000:1.0:1785774982.467277:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24221 00000100:00100000:1.0:1785774982.467287:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22206:x1872519648677248:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774982.467311:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774982.467341:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a21ab lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.467374:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a21b2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.467388:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a21b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.467400:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a21b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.467519:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a21ab lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7b2 expref: 65 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.467539:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8800/0x7b7109e1d0a21b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7b2 expref: 64 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.467547:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:1.0:1785774982.467551:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774982.467554:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8800, rc 0) 00000100:00100000:1.0:1785774982.467612:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:22206:x1872519648677248:12345-192.168.202.31@tcp:101:bash.0 Request processed in 326us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.467619:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24221 00000100:00100000:3.0:1785774982.488938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.489072:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648677376 00000100:00100000:2.0:1785774982.489082:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648677376 00002000:00100000:2.0:1785774982.489138:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x6:0x0] (0->5) req@ffff9b773fba3b80 x1872519648677376/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.489150:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba3b80 with x1872519648677376 ext(0->5) 00002000:00010000:2.0:1785774982.489156:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fba3b80 00000100:00100000:2.0:1785774982.489226:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 52 00000100:00100000:2.0:1785774982.489237:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2417:x1872519648677376:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774982.490942:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648677376:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1703us (2006us total) trans 4294969982 rc 0/0 00000100:00100000:2.0:1785774982.490952:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 52 00002000:00100000:2.0:1785774982.490961:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x6:0x0] (0->5) req@ffff9b773fba3b80 x1872519648677376/t4294969982(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.490971:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba3b80 with x1872519648677376 ext(0->5) 00002000:00010000:2.0:1785774982.490976:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fba3b80 00000100:00100000:3.0:1785774982.506844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.506998:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648677504 00000100:00100000:1.0:1785774982.507008:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648677504 00000100:00100000:1.0:1785774982.507065:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5371 00000100:00100000:1.0:1785774982.507076:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2419:x1872519648677504:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774982.511578:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969982 is committed 00000100:00100000:1.0:1785774982.511766:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:2419:x1872519648677504:12345-192.168.202.31@tcp:16:bash.0 Request processed in 4687us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.511779:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5371 00000100:00100000:0.0:1785774982.531890:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.532396:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648677760 00000100:00100000:3.0:1785774982.532405:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648677760 00000100:00100000:3.0:1785774982.532483:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5268 00000100:00100000:3.0:1785774982.532492:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:22206:x1872519648677760:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:3.0:1785774982.533781:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968620 00000100:00100000:3.0:1785774982.533950:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:22206:x1872519648677760:12345-192.168.202.31@tcp:35:bash.0 Request processed in 1457us (2066us total) trans 4294968621 rc 0/0 00000100:00100000:3.0:1785774982.533960:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5268 00000020:00080000:3.0:1785774982.533965:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774982.555607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.555921:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648678016 00000100:00100000:0.0:1785774982.555931:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648678016 00000100:00100000:0.0:1785774982.555989:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24222 00000100:00100000:0.0:1785774982.556000:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:22206:x1872519648678016:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.556025:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.556049:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a21b9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7b9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.556204:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a21c0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.556218:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a21c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.556229:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a21c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774982.556240:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a4:0x0]: returning size 0 00010000:00010000:0.0:1785774982.556434:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a21b9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7b9 expref: 69 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.556465:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a21c0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7b9 expref: 68 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.556473:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:0.0:1785774982.556476:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774982.556478:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7e00, rc 0) 00000100:00100000:0.0:1785774982.556591:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22206:x1872519648678016:12345-192.168.202.31@tcp:101:bash.0 Request processed in 593us (993us total) trans 4294968622 rc 0/0 00000100:00100000:0.0:1785774982.556598:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24222 00000100:00100000:1.0:1785774982.571433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.571514:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648678144 00000100:00100000:0.0:1785774982.571525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648678144 00000100:00100000:0.0:1785774982.571593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1509 00000100:00100000:0.0:1785774982.571603:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:2419:x1872519648678144:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774982.571618:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774982.571643:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a21c0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7b9 expref: 68 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.571661:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:0.0:1785774982.571666:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774982.571735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+67:2419:x1872519648678144:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 133us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.571742:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1509 00000100:00100000:2.0:1785774982.584016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.592600:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648678272 00000100:00100000:3.0:1785774982.592616:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648678272 00000100:00100000:1.0:1785774982.592780:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5372 00000100:00100000:1.0:1785774982.592793:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22206:x1872519648678272:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774982.592810:0:14719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774982.592831:0:14719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a21ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7c0 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774982.592854:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774982.592873:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:1.0:1785774982.592877:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774982.592884:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a21ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7c0 expref: 12 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.592898:0:14719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e82d9d3/0x7b7109e1d0a21ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7c0 expref: 12 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.592909:0:14719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e8e00, rc 0) 00000100:00100000:1.0:1785774982.592983:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22206:x1872519648678272:12345-192.168.202.31@tcp:101:bash.0 Request processed in 194us (8977us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.592989:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5372 00000100:00100000:3.0:1785774982.601397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.601764:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648678400 00000100:00100000:2.0:1785774982.601773:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648678400 00000100:00100000:2.0:1785774982.601835:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24223 00000100:00100000:2.0:1785774982.601844:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+67:22206:x1872519648678400:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.601866:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.601884:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a21d5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7c7 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.601918:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a21dc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.601931:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a21dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.601944:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a21dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.602051:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a21d5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7c7 expref: 69 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.602069:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc400/0x7b7109e1d0a21dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7c7 expref: 68 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.602077:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:2.0:1785774982.602080:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774982.602083:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc400, rc 0) 00000100:00100000:2.0:1785774982.603506:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22206:x1872519648678400:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1658us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.603516:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24223 00000100:00100000:0.0:1785774982.629445:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.630060:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648678528 00000100:00100000:3.0:1785774982.630070:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648678528 00002000:00100000:3.0:1785774982.630132:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (0->6) req@ffff9b773fba4700 x1872519648678528/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774982.630143:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba4700 with x1872519648678528 ext(0->6) 00002000:00010000:3.0:1785774982.630150:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fba4700 00000100:00100000:3.0:1785774982.630213:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 53 00000100:00100000:3.0:1785774982.630222:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648678528:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774982.631279:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648678528:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1055us (1841us total) trans 4294969958 rc 0/0 00000100:00100000:3.0:1785774982.631287:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 53 00002000:00100000:3.0:1785774982.631295:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7:0x0] (0->6) req@ffff9b773fba4700 x1872519648678528/t4294969958(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774982.631407:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba4700 with x1872519648678528 ext(0->6) 00002000:00010000:3.0:1785774982.631412:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fba4700 00000100:00100000:0.0:1785774982.655871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.658431:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648678656 00000100:00100000:2.0:1785774982.658443:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648678656 00000100:00100000:2.0:1785774982.658520:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5373 00000100:00100000:2.0:1785774982.658531:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648678656:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774982.662435:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969958 is committed 00000100:00100000:1.0:1785774982.677540:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648678656:12345-192.168.202.31@tcp:16:bash.0 Request processed in 19002us (21669us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.677553:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5373 00000100:00100000:0.0:1785774982.697842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.697922:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648678912 00000100:00100000:1.0:1785774982.697932:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648678912 00000100:00100000:1.0:1785774982.697987:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5269 00000100:00100000:1.0:1785774982.697998:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22206:x1872519648678912:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:1.0:1785774982.698382:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968623 00000100:00100000:1.0:1785774982.698649:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:22206:x1872519648678912:12345-192.168.202.31@tcp:35:bash.0 Request processed in 652us (814us total) trans 4294968624 rc 0/0 00000100:00100000:1.0:1785774982.698657:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5269 00000020:00080000:1.0:1785774982.698661:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774982.706985:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.707080:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648679168 00000100:00100000:0.0:1785774982.707089:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648679168 00000100:00100000:0.0:1785774982.707215:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24224 00000100:00100000:0.0:1785774982.707225:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:22206:x1872519648679168:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.707250:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.707273:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a21e3 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.707390:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a21ea lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.707408:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a21ea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.707419:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a21ea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774982.707430:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a5:0x0]: returning size 0 00010000:00010000:0.0:1785774982.707542:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7000/0x7b7109e1d0a21e3 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ce expref: 73 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.707565:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a21ea lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ce expref: 72 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.707574:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:0.0:1785774982.707576:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774982.707579:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7200, rc 0) 00000100:00100000:0.0:1785774982.707639:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22206:x1872519648679168:12345-192.168.202.31@tcp:101:bash.0 Request processed in 416us (662us total) trans 4294968625 rc 0/0 00000100:00100000:0.0:1785774982.707647:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24224 00000100:00100000:3.0:1785774982.729063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.729499:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648679296 00000100:00100000:2.0:1785774982.729508:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648679296 00000100:00100000:2.0:1785774982.729578:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1510 00000100:00100000:2.0:1785774982.729588:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:2419:x1872519648679296:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774982.729604:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774982.729628:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7200/0x7b7109e1d0a21ea lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ce expref: 72 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.729647:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:2.0:1785774982.729652:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774982.729709:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:2419:x1872519648679296:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 122us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.729716:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1510 00000100:00100000:3.0:1785774982.742778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.742888:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648679424 00000100:00100000:0.0:1785774982.742897:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648679424 00000100:00100000:0.0:1785774982.742956:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5374 00000100:00100000:0.0:1785774982.742967:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+11:22206:x1872519648679424:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.742985:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.743005:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b37f6377/0x7b7109e1d0a21f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7d5 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774982.743036:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774982.743056:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:0.0:1785774982.743061:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774982.743069:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b37f6377/0x7b7109e1d0a21f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7d5 expref: 12 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.743086:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b37f6377/0x7b7109e1d0a21f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7d5 expref: 12 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.743115:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7000, rc 0) 00000100:00100000:0.0:1785774982.743222:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22206:x1872519648679424:12345-192.168.202.31@tcp:101:bash.0 Request processed in 256us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.743229:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5374 00000100:00100000:1.0:1785774982.750695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.751128:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648679552 00000100:00100000:0.0:1785774982.751137:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648679552 00000100:00100000:0.0:1785774982.751466:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24225 00000100:00100000:0.0:1785774982.751478:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:22206:x1872519648679552:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.751505:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.751526:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a21ff lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7dc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.751562:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a2206 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.751576:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a2206 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.751589:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a2206 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.751700:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a21ff lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7dc expref: 73 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.751718:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7600/0x7b7109e1d0a2206 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7dc expref: 72 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.751728:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:0.0:1785774982.751732:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774982.751735:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7600, rc 0) 00000100:00100000:0.0:1785774982.751797:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22206:x1872519648679552:12345-192.168.202.31@tcp:101:bash.0 Request processed in 322us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.751804:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24225 00000100:00100000:3.0:1785774982.763286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.763511:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648679680 00000100:00100000:2.0:1785774982.763521:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648679680 00002000:00100000:2.0:1785774982.763570:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x7:0x0] (0->6) req@ffff9b773fba0a80 x1872519648679680/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.763581:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba0a80 with x1872519648679680 ext(0->6) 00002000:00010000:2.0:1785774982.763586:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fba0a80 00000100:00100000:2.0:1785774982.763623:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00100000:2.0:1785774982.763633:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2418:x1872519648679680:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774982.764868:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2418:x1872519648679680:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1234us (1587us total) trans 4294969983 rc 0/0 00000100:00100000:2.0:1785774982.764881:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 54 00002000:00100000:2.0:1785774982.764890:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x7:0x0] (0->6) req@ffff9b773fba0a80 x1872519648679680/t4294969983(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.764899:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba0a80 with x1872519648679680 ext(0->6) 00002000:00010000:2.0:1785774982.764903:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fba0a80 00000100:00100000:3.0:1785774982.773713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.773795:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648679808 00000100:00100000:0.0:1785774982.773806:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648679808 00000100:00100000:0.0:1785774982.773867:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5375 00000100:00100000:0.0:1785774982.773878:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648679808:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774982.777799:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969983 is committed 00000100:00100000:0.0:1785774982.777973:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:2417:x1872519648679808:12345-192.168.202.31@tcp:16:bash.0 Request processed in 4092us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.777984:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5375 00000100:00100000:2.0:1785774982.787490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.787528:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.787618:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648680064 00000100:00100000:0.0:1785774982.787629:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648680064 00000100:00100000:0.0:1785774982.787710:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1279 00000100:00100000:0.0:1785774982.787721:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648680064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774982.787799:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648680064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.787807:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1279 00000100:00080000:2.0:1785774982.788673:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774982.788777:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648679936 00000100:00100000:3.0:1785774982.788784:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648679936 00000100:00100000:3.0:1785774982.788824:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 621 00000100:00100000:3.0:1785774982.788832:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648679936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774982.788877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648679936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 46us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.788885:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 621 00000100:00100000:2.0:1785774982.800238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.800465:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648680320 00000100:00100000:3.0:1785774982.800474:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648680320 00000100:00100000:3.0:1785774982.800525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5270 00000100:00100000:3.0:1785774982.800533:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22206:x1872519648680320:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:3.0:1785774982.800720:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968626 00000100:00100000:3.0:1785774982.800828:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:22206:x1872519648680320:12345-192.168.202.31@tcp:35:bash.0 Request processed in 295us (598us total) trans 4294968627 rc 0/0 00000100:00100000:3.0:1785774982.800836:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5270 00000020:00080000:3.0:1785774982.800841:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774982.809229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.809396:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648680576 00000100:00100000:1.0:1785774982.809406:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648680576 00000100:00100000:1.0:1785774982.809473:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24226 00000100:00100000:1.0:1785774982.809483:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:22206:x1872519648680576:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774982.809505:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774982.809528:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a220d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7e3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.809641:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2214 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.809656:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2214 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.809668:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2214 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774982.809680:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a6:0x0]: returning size 0 00010000:00010000:1.0:1785774982.809789:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a220d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7e3 expref: 77 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.809812:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2214 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7e3 expref: 76 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.809822:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:1.0:1785774982.809825:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774982.809828:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9600, rc 0) 00000100:00100000:1.0:1785774982.809889:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22206:x1872519648680576:12345-192.168.202.31@tcp:101:bash.0 Request processed in 407us (669us total) trans 4294968628 rc 0/0 00000100:00100000:1.0:1785774982.809897:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24226 00000100:00100000:0.0:1785774982.818290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.818423:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648680704 00000100:00100000:1.0:1785774982.818433:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648680704 00000100:00100000:1.0:1785774982.818504:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1511 00000100:00100000:1.0:1785774982.818515:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:2419:x1872519648680704:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774982.818532:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774982.818556:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2214 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7e3 expref: 76 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.818576:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:1.0:1785774982.818581:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774982.818640:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:2419:x1872519648680704:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 127us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.818648:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1511 00000100:00100000:2.0:1785774982.831921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774982.831995:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648680832 00000100:00100000:0.0:1785774982.832005:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648680832 00000100:00100000:0.0:1785774982.832060:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5376 00000100:00100000:0.0:1785774982.832071:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773c2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22206:x1872519648680832:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774982.832087:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774982.832122:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f74530/0x7b7109e1d0a2222 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7ea expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774982.832149:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774982.832215:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:0.0:1785774982.832221:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774982.832230:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f74530/0x7b7109e1d0a2222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ea expref: 13 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.832247:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4f74530/0x7b7109e1d0a2222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ea expref: 13 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774982.832258:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea6400, rc 0) 00000100:00100000:0.0:1785774982.832321:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773c2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22206:x1872519648680832:12345-192.168.202.31@tcp:101:bash.0 Request processed in 240us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774982.832329:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5376 00000100:00100000:3.0:1785774982.844058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.845226:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648680960 00000100:00100000:1.0:1785774982.845239:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648680960 00000100:00100000:1.0:1785774982.845297:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24227 00000100:00100000:1.0:1785774982.845306:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:22206:x1872519648680960:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774982.845338:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774982.845356:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a2229 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7f1 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.845387:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2230 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.845399:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2230 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.845409:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2230 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.845527:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8200/0x7b7109e1d0a2229 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7f1 expref: 77 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.845545:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9600/0x7b7109e1d0a2230 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7f1 expref: 76 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.845554:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:1.0:1785774982.845557:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774982.845560:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9600, rc 0) 00000100:00100000:1.0:1785774982.845623:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22206:x1872519648680960:12345-192.168.202.31@tcp:101:bash.0 Request processed in 317us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.845631:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24227 00000100:00100000:1.0:1785774982.864721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.864806:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648681088 00000100:00100000:3.0:1785774982.864815:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648681088 00002000:00100000:3.0:1785774982.864858:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->6) req@ffff9b773fea9180 x1872519648681088/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774982.864869:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fea9180 with x1872519648681088 ext(0->6) 00002000:00010000:3.0:1785774982.864875:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fea9180 00000100:00100000:3.0:1785774982.864905:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00100000:3.0:1785774982.864913:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648681088:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774982.868519:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648681088:12345-192.168.202.31@tcp:4:bash.0 Request processed in 3595us (3795us total) trans 4294969959 rc 0/0 00000100:00100000:3.0:1785774982.868533:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 55 00002000:00100000:3.0:1785774982.868546:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->6) req@ffff9b773fea9180 x1872519648681088/t4294969959(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774982.868555:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fea9180 with x1872519648681088 ext(0->6) 00002000:00010000:3.0:1785774982.868561:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fea9180 00000100:00100000:2.0:1785774982.886329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.886443:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648681216 00000100:00100000:1.0:1785774982.886461:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648681216 00000100:00100000:1.0:1785774982.886520:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5377 00000100:00100000:1.0:1785774982.886530:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2418:x1872519648681216:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774982.888016:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969959 is committed 00000100:00100000:1.0:1785774982.888206:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2418:x1872519648681216:12345-192.168.202.31@tcp:16:bash.0 Request processed in 1675us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.888216:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5377 00000100:00100000:0.0:1785774982.900627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.900727:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648681472 00000100:00100000:2.0:1785774982.900736:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648681472 00000100:00100000:2.0:1785774982.900790:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5271 00000100:00100000:2.0:1785774982.900800:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22206:x1872519648681472:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:2.0:1785774982.901018:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968629 00000100:00100000:2.0:1785774982.901304:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22206:x1872519648681472:12345-192.168.202.31@tcp:35:bash.0 Request processed in 503us (685us total) trans 4294968630 rc 0/0 00000100:00100000:2.0:1785774982.901313:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5271 00000020:00080000:2.0:1785774982.901379:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774982.917986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.918134:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648681728 00000100:00100000:2.0:1785774982.918143:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648681728 00000100:00100000:2.0:1785774982.918220:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24228 00000100:00100000:2.0:1785774982.918229:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22206:x1872519648681728:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774982.918254:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774982.918276:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a2237 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7f8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.918386:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a223e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.918398:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a223e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.918407:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a223e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774982.918417:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a7:0x0]: returning size 0 00010000:00010000:2.0:1785774982.918523:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a2237 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7f8 expref: 81 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.918546:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a223e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7f8 expref: 80 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.918555:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:2.0:1785774982.918558:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774982.918561:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc600, rc 0) 00000100:00100000:2.0:1785774982.918621:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22206:x1872519648681728:12345-192.168.202.31@tcp:101:bash.0 Request processed in 392us (653us total) trans 4294968631 rc 0/0 00000100:00100000:2.0:1785774982.918629:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24228 00000100:00100000:1.0:1785774982.922850:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.922918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648681856 00000100:00100000:2.0:1785774982.922926:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648681856 00000100:00100000:2.0:1785774982.922987:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1512 00000100:00100000:2.0:1785774982.922996:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:2418:x1872519648681856:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774982.923013:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774982.923033:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a223e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7f8 expref: 80 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774982.923050:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:2.0:1785774982.923053:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774982.923116:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:2418:x1872519648681856:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774982.923124:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1512 00000100:00100000:0.0:1785774982.932391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774982.932524:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648681984 00000100:00100000:3.0:1785774982.932534:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648681984 00000100:00100000:3.0:1785774982.932595:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5378 00000100:00100000:3.0:1785774982.932605:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+12:22206:x1872519648681984:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774982.932624:0:14730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774982.932646:0:14730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfaadf8/0x7b7109e1d0a224c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c7ff expref: -99 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774982.932671:0:14730:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774982.932693:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:3.0:1785774982.932698:0:14730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774982.932705:0:14730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfaadf8/0x7b7109e1d0a224c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ff expref: 13 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774982.932721:0:14730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdfaadf8/0x7b7109e1d0a224c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c7ff expref: 13 pid: 14730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774982.932734:0:14730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf000, rc 0) 00000100:00100000:3.0:1785774982.932796:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22206:x1872519648681984:12345-192.168.202.31@tcp:101:bash.0 Request processed in 193us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774982.932804:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5378 00010000:00010000:2.0:1785774982.949317:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774982.953063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.953206:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648682112 00000100:00100000:1.0:1785774982.953217:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648682112 00000100:00100000:1.0:1785774982.953280:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24229 00000100:00100000:1.0:1785774982.953290:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:22206:x1872519648682112:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774982.953325:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774982.953346:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a2253 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c806 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.953381:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a225a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.953394:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a225a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.953405:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a225a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.953528:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a2253 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c806 expref: 81 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.953547:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9400/0x7b7109e1d0a225a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c806 expref: 80 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774982.953561:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:1.0:1785774982.953564:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774982.953568:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9400, rc 0) 00000100:00100000:1.0:1785774982.953629:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22206:x1872519648682112:12345-192.168.202.31@tcp:101:bash.0 Request processed in 340us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774982.953636:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24229 00000100:00100000:1.0:1785774982.972497:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774982.972754:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648682240 00000100:00100000:2.0:1785774982.972766:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648682240 00002000:00100000:2.0:1785774982.972814:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x8:0x0] (0->6) req@ffff9b772a315180 x1872519648682240/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/0 e 0 to 0 dl 1785774993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.972825:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a315180 with x1872519648682240 ext(0->6) 00002000:00010000:2.0:1785774982.972831:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b772a315180 00000100:00100000:2.0:1785774982.972865:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 56 00000100:00100000:2.0:1785774982.972875:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2417:x1872519648682240:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774982.974256:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648682240:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1378us (1764us total) trans 4294969984 rc 0/0 00000100:00100000:2.0:1785774982.974265:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 56 00002000:00100000:2.0:1785774982.974275:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x8:0x0] (0->6) req@ffff9b772a315180 x1872519648682240/t4294969984(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:673/0 lens 496/448 e 0 to 0 dl 1785774993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774982.974284:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a315180 with x1872519648682240 ext(0->6) 00002000:00010000:2.0:1785774982.974289:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b772a315180 00000100:00100000:3.0:1785774982.987854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774982.987954:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648682368 00000100:00100000:1.0:1785774982.987966:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648682368 00000100:00100000:1.0:1785774982.988035:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5379 00000100:00100000:1.0:1785774982.988045:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648682368:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774982.993651:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969984 is committed 00000100:00100000:1.0:1785774983.001316:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:2416:x1872519648682368:12345-192.168.202.31@tcp:16:bash.0 Request processed in 13254us (13454us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.001333:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5379 00000100:00100000:3.0:1785774983.007697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.012423:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648682624 00000100:00100000:1.0:1785774983.012436:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648682624 00000100:00100000:2.0:1785774983.015125:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5272 00000100:00100000:2.0:1785774983.015140:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22206:x1872519648682624:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:2.0:1785774983.015508:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968632 00000100:00100000:2.0:1785774983.015636:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:22206:x1872519648682624:12345-192.168.202.31@tcp:35:bash.0 Request processed in 498us (7946us total) trans 4294968633 rc 0/0 00000100:00100000:2.0:1785774983.015645:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5272 00000020:00080000:2.0:1785774983.015649:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1785774983.022527:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774983.024535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.025052:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648682880 00000100:00100000:1.0:1785774983.025062:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648682880 00000100:00100000:1.0:1785774983.025130:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24230 00000100:00100000:1.0:1785774983.025140:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:22206:x1872519648682880:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774983.025202:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774983.025227:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a2261 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c80d expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.025342:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a2268 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.025355:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a2268 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.025365:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a2268 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774983.025375:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a8:0x0]: returning size 0 00010000:00010000:1.0:1785774983.025480:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9000/0x7b7109e1d0a2261 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c80d expref: 85 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.025501:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a2268 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c80d expref: 84 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.025510:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:1.0:1785774983.025513:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774983.025516:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76045e9800, rc 0) 00000100:00100000:1.0:1785774983.025582:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:22206:x1872519648682880:12345-192.168.202.31@tcp:101:bash.0 Request processed in 444us (1054us total) trans 4294968634 rc 0/0 00000100:00100000:1.0:1785774983.025590:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24230 00000100:00100000:1.0:1785774983.031273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.031883:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648683008 00000100:00100000:0.0:1785774983.031893:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648683008 00000100:00100000:0.0:1785774983.031964:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5380 00000100:00100000:0.0:1785774983.031972:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22206:x1872519648683008:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.032130:0:14729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.032152:0:14729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4e12e1/0x7b7109e1d0a2276 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c814 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774983.032195:0:14729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774983.032217:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:0.0:1785774983.032222:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774983.032230:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4e12e1/0x7b7109e1d0a2276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c814 expref: 14 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.032248:0:14729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb4e12e1/0x7b7109e1d0a2276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c814 expref: 14 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.032260:0:14729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7200, rc 0) 00000100:00100000:0.0:1785774983.032320:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22206:x1872519648683008:12345-192.168.202.31@tcp:101:bash.0 Request processed in 347us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.032327:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5380 00000100:00100000:0.0:1785774983.032371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.032393:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648683136 00000100:00100000:0.0:1785774983.032396:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648683136 00000100:00100000:0.0:1785774983.032425:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1513 00000100:00100000:0.0:1785774983.032431:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:2418:x1872519648683136:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774983.032454:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1785774983.034217:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785774983.034333:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9800/0x7b7109e1d0a2268 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c80d expref: 84 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.034360:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:0.0:1785774983.034364:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774983.034411:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:2418:x1872519648683136:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1977us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.034419:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1513 00000100:00100000:1.0:1785774983.043885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.043968:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648683264 00000100:00100000:2.0:1785774983.043987:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648683264 00000100:00100000:2.0:1785774983.044045:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24231 00000100:00100000:2.0:1785774983.044055:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:22206:x1872519648683264:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774983.044082:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774983.044120:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a227d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c81b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.044157:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2284 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.044202:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2284 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.044214:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2284 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.044336:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a227d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c81b expref: 85 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.044355:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dc600/0x7b7109e1d0a2284 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c81b expref: 84 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.044363:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:2.0:1785774983.044366:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774983.044370:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dc600, rc 0) 00000100:00100000:2.0:1785774983.044429:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:22206:x1872519648683264:12345-192.168.202.31@tcp:101:bash.0 Request processed in 376us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.044435:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24231 00000100:00100000:0.0:1785774983.058328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.058417:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648683392 00000100:00100000:2.0:1785774983.058426:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648683392 00002000:00100000:2.0:1785774983.058479:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x9:0x0] (0->6) req@ffff9b773fba7800 x1872519648683392/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.058491:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba7800 with x1872519648683392 ext(0->6) 00002000:00010000:2.0:1785774983.058496:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fba7800 00000100:00100000:2.0:1785774983.058524:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 57 00000100:00100000:2.0:1785774983.058533:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648683392:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774983.059403:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648683392:12345-192.168.202.31@tcp:4:bash.0 Request processed in 869us (1091us total) trans 4294969960 rc 0/0 00000100:00100000:2.0:1785774983.059412:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 57 00002000:00100000:2.0:1785774983.059420:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x9:0x0] (0->6) req@ffff9b773fba7800 x1872519648683392/t4294969960(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.059428:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba7800 with x1872519648683392 ext(0->6) 00002000:00010000:2.0:1785774983.059432:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fba7800 00000100:00100000:3.0:1785774983.069525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.070503:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648683520 00000100:00100000:0.0:1785774983.070514:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648683520 00000100:00100000:0.0:1785774983.070579:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5381 00000100:00100000:0.0:1785774983.070590:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648683520:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774983.073692:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969960 is committed 00000100:00100000:0.0:1785774983.073844:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648683520:12345-192.168.202.31@tcp:16:bash.0 Request processed in 3252us (4323us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.073855:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5381 00000100:00100000:1.0:1785774983.080040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774983.080254:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648683776 00000100:00100000:3.0:1785774983.080264:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648683776 00000100:00100000:3.0:1785774983.080322:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5273 00000100:00100000:3.0:1785774983.080332:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:22206:x1872519648683776:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:3.0:1785774983.080544:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968635 00000100:00100000:3.0:1785774983.080650:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:22206:x1872519648683776:12345-192.168.202.31@tcp:35:bash.0 Request processed in 319us (618us total) trans 4294968636 rc 0/0 00000100:00100000:3.0:1785774983.080658:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5273 00000020:00080000:3.0:1785774983.080662:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774983.088584:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.088678:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648684032 00000100:00100000:1.0:1785774983.088688:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648684032 00000100:00100000:1.0:1785774983.088746:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24232 00000100:00100000:1.0:1785774983.088756:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:22206:x1872519648684032:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774983.088779:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774983.088799:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a228b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c822 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.088918:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a2292 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.088930:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a2292 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.088941:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a2292 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774983.088951:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a9:0x0]: returning size 0 00010000:00010000:1.0:1785774983.089602:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a228b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c822 expref: 89 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.089629:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a2292 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c822 expref: 88 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.089637:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:1.0:1785774983.089640:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774983.089643:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045600, rc 0) 00000100:00100000:1.0:1785774983.089757:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22206:x1872519648684032:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1001us (1182us total) trans 4294968637 rc 0/0 00000100:00100000:1.0:1785774983.089765:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24232 00000100:00100000:1.0:1785774983.103725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.103799:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774983.104433:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648684160 00000100:00100000:3.0:1785774983.104452:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648684160 00000100:00100000:3.0:1785774983.104520:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5382 00000100:00100000:3.0:1785774983.104528:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+13:22206:x1872519648684160:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774983.104547:0:14722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774983.104566:0:14722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069262142/0x7b7109e1d0a22a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c829 expref: -99 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774983.104592:0:14722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774983.104614:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=1224s v=(0 0) 00010000:00010000:3.0:1785774983.104619:0:14722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774983.104626:0:14722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069262142/0x7b7109e1d0a22a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c829 expref: 14 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774983.104641:0:14722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069262142/0x7b7109e1d0a22a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c829 expref: 14 pid: 14722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774983.104653:0:14722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cea00, rc 0) 00000100:00100000:3.0:1785774983.104714:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22206:x1872519648684160:12345-192.168.202.31@tcp:101:bash.0 Request processed in 186us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774983.104722:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5382 00000100:00080000:1.0:1785774983.104788:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774983.105310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648684288 00000100:00100000:0.0:1785774983.105315:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648684288 00000100:00100000:0.0:1785774983.105357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1514 00000100:00100000:0.0:1785774983.105364:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:2416:x1872519648684288:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774983.105374:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774983.105394:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a2292 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c822 expref: 88 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.105412:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:0.0:1785774983.105416:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774983.105437:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:2416:x1872519648684288:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 74us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.105455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1514 00000100:00100000:3.0:1785774983.122323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.122586:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648684416 00000100:00100000:0.0:1785774983.122595:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648684416 00000100:00100000:0.0:1785774983.122653:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24233 00000100:00100000:0.0:1785774983.122663:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:22206:x1872519648684416:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.122686:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.122707:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a22a7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c830 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.122742:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a22ae lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.122756:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a22ae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.122767:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a22ae lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.122875:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7e00/0x7b7109e1d0a22a7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c830 expref: 89 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.122891:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6600/0x7b7109e1d0a22ae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c830 expref: 88 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.122900:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:0.0:1785774983.122903:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774983.122907:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea6600, rc 0) 00000100:00100000:0.0:1785774983.122970:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22206:x1872519648684416:12345-192.168.202.31@tcp:101:bash.0 Request processed in 308us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.122977:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24233 00000100:00100000:0.0:1785774983.145430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.145588:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648684544 00000100:00100000:2.0:1785774983.145600:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648684544 00002000:00100000:2.0:1785774983.145651:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x9:0x0] (0->6) req@ffff9b773fba6300 x1872519648684544/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.145661:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba6300 with x1872519648684544 ext(0->6) 00002000:00010000:2.0:1785774983.145667:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fba6300 00000100:00100000:2.0:1785774983.145700:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 58 00000100:00100000:2.0:1785774983.145709:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2416:x1872519648684544:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774983.148745:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648684544:12345-192.168.202.31@tcp:4:bash.0 Request processed in 3030us (3317us total) trans 4294969985 rc 0/0 00000100:00100000:2.0:1785774983.148757:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 58 00002000:00100000:2.0:1785774983.148770:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x9:0x0] (0->6) req@ffff9b773fba6300 x1872519648684544/t4294969985(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.148779:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fba6300 with x1872519648684544 ext(0->6) 00002000:00010000:2.0:1785774983.148785:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fba6300 00000100:00100000:3.0:1785774983.160074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.160196:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648684672 00000100:00100000:1.0:1785774983.160206:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648684672 00000100:00100000:1.0:1785774983.160269:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5383 00000100:00100000:1.0:1785774983.160279:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648684672:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:2.0:1785774983.166477:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969985 is committed 00000100:00100000:1.0:1785774983.166662:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:2417:x1872519648684672:12345-192.168.202.31@tcp:16:bash.0 Request processed in 6379us (6591us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.166673:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5383 00000100:00100000:3.0:1785774983.176282:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.176431:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648684928 00000100:00100000:0.0:1785774983.176450:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648684928 00000100:00100000:0.0:1785774983.176511:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5274 00000100:00100000:0.0:1785774983.176522:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22206:x1872519648684928:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774983.176744:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968638 00000100:00100000:0.0:1785774983.176849:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:22206:x1872519648684928:12345-192.168.202.31@tcp:35:bash.0 Request processed in 329us (574us total) trans 4294968639 rc 0/0 00000100:00100000:0.0:1785774983.176857:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5274 00000020:00080000:0.0:1785774983.176861:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774983.198064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.198205:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648685184 00000100:00100000:2.0:1785774983.198214:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648685184 00000100:00100000:2.0:1785774983.198266:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24234 00000100:00100000:2.0:1785774983.198275:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:22206:x1872519648685184:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774983.198298:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774983.198329:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a22b5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c837 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.198432:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a22bc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.198463:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a22bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.198476:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a22bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774983.198487:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1aa:0x0]: returning size 0 00010000:00010000:2.0:1785774983.198593:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b77418dd600/0x7b7109e1d0a22b5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c837 expref: 93 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.198616:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a22bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c837 expref: 92 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.198623:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:2.0:1785774983.198626:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774983.198629:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7711745400, rc 0) 00000100:00100000:2.0:1785774983.198690:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:22206:x1872519648685184:12345-192.168.202.31@tcp:101:bash.0 Request processed in 415us (633us total) trans 4294968640 rc 0/0 00000100:00100000:2.0:1785774983.198697:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24234 00000100:00100000:1.0:1785774983.218478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.218520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.218691:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648685312 00000100:00100000:2.0:1785774983.218701:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648685312 00000100:00100000:2.0:1785774983.218761:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5384 00000100:00100000:2.0:1785774983.218771:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22206:x1872519648685312:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774983.218791:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774983.218812:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb839966/0x7b7109e1d0a22ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c83e expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774983.218844:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774983.218864:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=1225s v=(0 0) 00010000:00010000:2.0:1785774983.218869:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774983.218878:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb839966/0x7b7109e1d0a22ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c83e expref: 15 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.218896:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb839966/0x7b7109e1d0a22ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c83e expref: 15 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.218908:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b77418dd600, rc 0) 00000100:00100000:2.0:1785774983.218979:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22206:x1872519648685312:12345-192.168.202.31@tcp:101:bash.0 Request processed in 201us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.218986:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5384 00000100:00100000:3.0:1785774983.219547:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648685440 00000100:00100000:3.0:1785774983.219553:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648685440 00000100:00100000:3.0:1785774983.219597:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1515 00000100:00100000:3.0:1785774983.219606:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:2418:x1872519648685440:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774983.219616:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774983.219637:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745400/0x7b7109e1d0a22bc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c837 expref: 92 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774983.219653:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:3.0:1785774983.219658:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774983.219691:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+91:2418:x1872519648685440:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 87us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774983.219698:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1515 00000100:00100000:1.0:1785774983.240826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.240914:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648685568 00000100:00100000:0.0:1785774983.240923:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648685568 00000100:00100000:0.0:1785774983.240984:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24235 00000100:00100000:0.0:1785774983.240993:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+91:22206:x1872519648685568:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.241015:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.241034:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a22d1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c845 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.241070:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a22d8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.241085:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a22d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.241104:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a22d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.243706:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a22d1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c845 expref: 93 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.243733:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6200/0x7b7109e1d0a22d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c845 expref: 92 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.243743:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:0.0:1785774983.243746:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774983.243749:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea6200, rc 0) 00000100:00100000:0.0:1785774983.243819:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:22206:x1872519648685568:12345-192.168.202.31@tcp:101:bash.0 Request processed in 2826us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.243827:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24235 00000100:00100000:1.0:1785774983.266563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.266670:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648685696 00000100:00100000:2.0:1785774983.266691:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648685696 00002000:00100000:2.0:1785774983.266741:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa:0x0] (0->6) req@ffff9b773ff05f80 x1872519648685696/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.266752:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff05f80 with x1872519648685696 ext(0->6) 00002000:00010000:2.0:1785774983.266758:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773ff05f80 00000100:00100000:2.0:1785774983.266786:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 59 00000100:00100000:2.0:1785774983.266795:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648685696:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:2.0:1785774983.267704:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648685696:12345-192.168.202.31@tcp:4:bash.0 Request processed in 908us (1149us total) trans 4294969961 rc 0/0 00000100:00100000:2.0:1785774983.267713:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 59 00002000:00100000:2.0:1785774983.267720:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa:0x0] (0->6) req@ffff9b773ff05f80 x1872519648685696/t4294969961(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.267729:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff05f80 with x1872519648685696 ext(0->6) 00002000:00010000:2.0:1785774983.267732:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773ff05f80 00000100:00100000:1.0:1785774983.277278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.277431:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648685824 00000100:00100000:2.0:1785774983.277453:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648685824 00000100:00100000:2.0:1785774983.277515:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5385 00000100:00100000:2.0:1785774983.277525:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648685824:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774983.283743:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969961 is committed 00000100:00100000:2.0:1785774983.283911:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648685824:12345-192.168.202.31@tcp:16:bash.0 Request processed in 6381us (6635us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.283922:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5385 00000100:00100000:1.0:1785774983.293431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.293555:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648686080 00000100:00100000:2.0:1785774983.293564:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648686080 00000100:00100000:2.0:1785774983.293661:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5275 00000100:00100000:2.0:1785774983.293672:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:22206:x1872519648686080:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:2.0:1785774983.293881:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968641 00000100:00100000:2.0:1785774983.293987:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:22206:x1872519648686080:12345-192.168.202.31@tcp:35:bash.0 Request processed in 316us (563us total) trans 4294968642 rc 0/0 00000100:00100000:2.0:1785774983.293996:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5275 00000020:00080000:2.0:1785774983.294000:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774983.299917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.299990:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648686336 00000100:00100000:0.0:1785774983.300000:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648686336 00000100:00100000:0.0:1785774983.300053:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24236 00000100:00100000:0.0:1785774983.300062:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:22206:x1872519648686336:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.300088:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.300124:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a22df lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c84c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.300419:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a22e6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.300433:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a22e6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.300455:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a22e6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774983.300465:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ab:0x0]: returning size 0 00010000:00010000:0.0:1785774983.300571:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a22df lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c84c expref: 97 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.300591:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a22e6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c84c expref: 96 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.300600:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:0.0:1785774983.300602:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774983.300605:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7800, rc 0) 00000100:00100000:0.0:1785774983.300658:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:22206:x1872519648686336:12345-192.168.202.31@tcp:101:bash.0 Request processed in 596us (749us total) trans 4294968643 rc 0/0 00000100:00100000:0.0:1785774983.300666:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24236 00000100:00100000:1.0:1785774983.310791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.310865:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648686464 00000100:00100000:0.0:1785774983.310875:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648686464 00000100:00100000:0.0:1785774983.310935:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5386 00000100:00100000:0.0:1785774983.310944:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+14:22206:x1872519648686464:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.310965:0:14729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.310986:0:14729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a22f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c853 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774983.311010:0:14729:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774983.311030:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=1225s v=(0 0) 00010000:00010000:0.0:1785774983.311035:0:14729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774983.311043:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a22f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c853 expref: 15 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.311061:0:14729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008835c54e/0x7b7109e1d0a22f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c853 expref: 15 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.311074:0:14729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7e00, rc 0) 00000100:00100000:0.0:1785774983.311145:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22206:x1872519648686464:12345-192.168.202.31@tcp:101:bash.0 Request processed in 201us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.311152:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5386 00000100:00100000:3.0:1785774983.318694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.318913:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648686592 00000100:00100000:0.0:1785774983.318921:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648686592 00000100:00100000:0.0:1785774983.319021:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1516 00000100:00100000:0.0:1785774983.319031:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:2418:x1872519648686592:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774983.319045:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774983.319068:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a22e6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c84c expref: 96 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.319086:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:0.0:1785774983.319098:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774983.319157:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:2418:x1872519648686592:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 128us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.319203:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1516 00000100:00100000:3.0:1785774983.324388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.324532:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648686720 00000100:00100000:2.0:1785774983.324542:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648686720 00000100:00100000:2.0:1785774983.324594:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24237 00000100:00100000:2.0:1785774983.324604:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:22206:x1872519648686720:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774983.324629:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774983.324651:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a22fb lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c85a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.324687:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a2302 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.324700:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a2302 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.324712:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a2302 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.324823:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a22fb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c85a expref: 97 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.324841:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1600/0x7b7109e1d0a2302 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c85a expref: 96 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.324850:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:2.0:1785774983.324853:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774983.324856:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1600, rc 0) 00000100:00100000:2.0:1785774983.324914:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:22206:x1872519648686720:12345-192.168.202.31@tcp:101:bash.0 Request processed in 311us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.324921:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24237 00000100:00100000:2.0:1785774983.330119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774983.330428:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648686848 00000100:00100000:3.0:1785774983.330438:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648686848 00002000:00100000:3.0:1785774983.330494:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xa:0x0] (0->6) req@ffff9b7735aa9500 x1872519648686848/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774983.330505:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735aa9500 with x1872519648686848 ext(0->6) 00002000:00010000:3.0:1785774983.330511:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7735aa9500 00000100:00100000:3.0:1785774983.330544:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 60 00000100:00100000:3.0:1785774983.330554:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2416:x1872519648686848:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774983.331755:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648686848:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1198us (1639us total) trans 4294969986 rc 0/0 00000100:00100000:3.0:1785774983.331765:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 60 00002000:00100000:3.0:1785774983.331775:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xa:0x0] (0->6) req@ffff9b7735aa9500 x1872519648686848/t4294969986(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774983.331784:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735aa9500 with x1872519648686848 ext(0->6) 00002000:00010000:3.0:1785774983.331788:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7735aa9500 00000100:00100000:1.0:1785774983.334105:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785774983.334200:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774983.334267:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671388160 00000100:00100000:1.0:1785774983.334274:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671388160 00000100:00100000:1.0:1785774983.334428:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1785774983.334437:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774983.334466:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 159946432 pending 0 free 3923456000 avail 3691905024 00000100:00100000:3.0:1785774983.339822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.340224:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774983.340246:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671388288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774983.340300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774983.340477:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671388288 00000100:00100000:2.0:1785774983.340485:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671388288 00000100:00100000:2.0:1785774983.340526:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1785774983.340535:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671388288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785774983.340559:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 159946432 pending 0 free 3923456000 avail 3691905024 00000100:00100000:1.0:1785774983.340687:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6248us (6484us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.340696:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1785774983.340756:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774983.341549:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671388288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1014us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.341556:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1785774983.348474:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7603081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671388288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774983.352812:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648686976 00000100:00100000:0.0:1785774983.352825:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648686976 00000100:00100000:0.0:1785774983.352894:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5387 00000100:00100000:0.0:1785774983.352904:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648686976:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:2.0:1785774983.354484:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969986 is committed 00000100:00100000:0.0:1785774983.357922:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:2417:x1872519648686976:12345-192.168.202.31@tcp:16:bash.0 Request processed in 5009us (18099us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.357942:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5387 00000100:00100000:0.0:1785774983.364433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.364574:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648687232 00000100:00100000:2.0:1785774983.364583:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648687232 00000100:00100000:2.0:1785774983.364630:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5276 00000100:00100000:2.0:1785774983.364639:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:22206:x1872519648687232:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:2.0:1785774983.364856:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968644 00000100:00100000:2.0:1785774983.364971:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:22206:x1872519648687232:12345-192.168.202.31@tcp:35:bash.0 Request processed in 331us (546us total) trans 4294968645 rc 0/0 00000100:00100000:2.0:1785774983.364978:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5276 00000020:00080000:2.0:1785774983.364983:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774983.378921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.379308:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648687488 00000100:00100000:0.0:1785774983.379375:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648687488 00000100:00100000:0.0:1785774983.379447:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24238 00000100:00100000:0.0:1785774983.379458:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:22206:x1872519648687488:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.379482:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.379504:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2309 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c861 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.379608:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a2310 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.379622:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a2310 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.379635:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a2310 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774983.379650:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ac:0x0]: returning size 0 00010000:00010000:0.0:1785774983.379753:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2309 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c861 expref: 101 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.379776:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a2310 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c861 expref: 100 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.379785:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:0.0:1785774983.379788:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774983.379791:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea6000, rc 0) 00000100:00100000:0.0:1785774983.379931:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+100:22206:x1872519648687488:12345-192.168.202.31@tcp:101:bash.0 Request processed in 475us (1019us total) trans 4294968646 rc 0/0 00000100:00100000:0.0:1785774983.379939:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24238 00000100:00100000:0.0:1785774983.392653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.393210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.393473:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648687744 00000100:00100000:1.0:1785774983.393482:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648687744 00000100:00100000:1.0:1785774983.393581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1517 00000100:00100000:1.0:1785774983.393591:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+100:2418:x1872519648687744:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774983.393607:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774983.393630:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a2310 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c861 expref: 100 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.393649:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:1.0:1785774983.393654:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774983.393712:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:2418:x1872519648687744:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.393719:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1517 00000100:00100000:3.0:1785774983.395490:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648687616 00000100:00100000:3.0:1785774983.395500:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648687616 00000100:00100000:3.0:1785774983.395553:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5388 00000100:00100000:3.0:1785774983.395562:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22206:x1872519648687616:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774983.395581:0:14719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774983.395603:0:14719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022738ef5/0x7b7109e1d0a231e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c868 expref: -99 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785774983.395630:0:14719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1785774983.395649:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=1225s v=(0 0) 00010000:00010000:3.0:1785774983.395654:0:14719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785774983.395674:0:14719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022738ef5/0x7b7109e1d0a231e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c868 expref: 16 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774983.395697:0:14719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022738ef5/0x7b7109e1d0a231e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c868 expref: 16 pid: 14719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774983.395710:0:14719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf200, rc 0) 00000100:00100000:3.0:1785774983.395753:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22206:x1872519648687616:12345-192.168.202.31@tcp:101:bash.0 Request processed in 192us (3109us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774983.395760:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5388 00000100:00100000:2.0:1785774983.414966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.415057:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648687872 00000100:00100000:0.0:1785774983.415066:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648687872 00000100:00100000:0.0:1785774983.415129:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24239 00000100:00100000:0.0:1785774983.415139:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:22206:x1872519648687872:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.415197:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.415218:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a2325 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c86f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.415250:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a232c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.415263:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a232c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.415273:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a232c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.415374:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a2325 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c86f expref: 101 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.415389:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6c00/0x7b7109e1d0a232c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c86f expref: 100 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.415396:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:0.0:1785774983.415399:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774983.415402:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea6c00, rc 0) 00000100:00100000:0.0:1785774983.415475:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+100:22206:x1872519648687872:12345-192.168.202.31@tcp:101:bash.0 Request processed in 338us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.415482:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24239 00000100:00100000:1.0:1785774983.423632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774983.423717:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648688000 00000100:00100000:3.0:1785774983.423726:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648688000 00002000:00100000:3.0:1785774983.423772:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->6) req@ffff9b7604e00700 x1872519648688000/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774983.423782:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e00700 with x1872519648688000 ext(0->6) 00002000:00010000:3.0:1785774983.423788:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e00700 00000100:00100000:3.0:1785774983.423823:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 61 00000100:00100000:3.0:1785774983.423832:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648688000:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:3.0:1785774983.425894:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648688000:12345-192.168.202.31@tcp:4:bash.0 Request processed in 2057us (2264us total) trans 4294969962 rc 0/0 00000100:00100000:3.0:1785774983.425904:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 61 00002000:00100000:3.0:1785774983.425913:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->6) req@ffff9b7604e00700 x1872519648688000/t4294969962(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774983.425923:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e00700 with x1872519648688000 ext(0->6) 00002000:00010000:3.0:1785774983.425927:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e00700 00000100:00100000:3.0:1785774983.444340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.444535:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648688128 00000100:00100000:1.0:1785774983.444544:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648688128 00000100:00100000:1.0:1785774983.444605:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5389 00000100:00100000:1.0:1785774983.444615:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648688128:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:0.0:1785774983.446063:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969962 is committed 00000100:00100000:1.0:1785774983.447269:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648688128:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2652us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.447280:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5389 00000100:00100000:2.0:1785774983.460875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.460982:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648688384 00000100:00100000:0.0:1785774983.460991:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648688384 00000100:00100000:0.0:1785774983.461046:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5277 00000100:00100000:0.0:1785774983.461056:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+100:22206:x1872519648688384:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774983.461323:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968647 00000100:00100000:0.0:1785774983.461431:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+102:22206:x1872519648688384:12345-192.168.202.31@tcp:35:bash.0 Request processed in 376us (564us total) trans 4294968648 rc 0/0 00000100:00100000:0.0:1785774983.461450:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5277 00000020:00080000:0.0:1785774983.461456:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774983.476984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.477350:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648688640 00000100:00100000:0.0:1785774983.477359:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648688640 00000100:00100000:0.0:1785774983.477415:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24240 00000100:00100000:0.0:1785774983.477423:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+102:22206:x1872519648688640:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.477475:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.477499:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a2333 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c876 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.477603:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a233a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.477616:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a233a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.477628:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a233a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774983.477639:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ad:0x0]: returning size 0 00010000:00010000:0.0:1785774983.477947:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7c00/0x7b7109e1d0a2333 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c876 expref: 105 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.477970:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a233a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c876 expref: 104 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.477979:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:0.0:1785774983.477982:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774983.477985:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea6e00, rc 0) 00000100:00100000:0.0:1785774983.478099:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+104:22206:x1872519648688640:12345-192.168.202.31@tcp:101:bash.0 Request processed in 667us (1114us total) trans 4294968649 rc 0/0 00000100:00100000:0.0:1785774983.478106:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24240 00000100:00100000:3.0:1785774983.505690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774983.505737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.505829:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648688768 00000100:00100000:0.0:1785774983.505838:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648688768 00000100:00100000:0.0:1785774983.505896:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5390 00000100:00100000:0.0:1785774983.505905:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+15:22206:x1872519648688768:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774983.505923:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.505944:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066af5039/0x7b7109e1d0a2348 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c87d expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774983.505968:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774983.505988:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=1225s v=(0 0) 00010000:00010000:0.0:1785774983.505993:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774983.506000:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066af5039/0x7b7109e1d0a2348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c87d expref: 16 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.506015:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066af5039/0x7b7109e1d0a2348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c87d expref: 16 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.506027:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7c00, rc 0) 00000100:00100000:0.0:1785774983.506085:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22206:x1872519648688768:12345-192.168.202.31@tcp:101:bash.0 Request processed in 181us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.506276:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5390 00000100:00100000:1.0:1785774983.508571:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648688896 00000100:00100000:1.0:1785774983.508582:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648688896 00000100:00100000:1.0:1785774983.508638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1518 00000100:00100000:1.0:1785774983.508647:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+104:2418:x1872519648688896:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774983.508660:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774983.508683:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a233a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c876 expref: 104 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.508707:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:1.0:1785774983.508712:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774983.508766:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+103:2418:x1872519648688896:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 119us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.508773:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1518 00000100:00100000:3.0:1785774983.520431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.520632:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648689024 00000100:00100000:2.0:1785774983.520641:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648689024 00000100:00100000:2.0:1785774983.520699:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24241 00000100:00100000:2.0:1785774983.520708:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+103:22206:x1872519648689024:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774983.520731:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774983.520751:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d0a234f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c884 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.520790:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d0a2356 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.520803:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d0a2356 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.520815:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d0a2356 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.520922:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1a00/0x7b7109e1d0a234f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c884 expref: 105 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.520939:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1c00/0x7b7109e1d0a2356 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c884 expref: 104 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.520948:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:2.0:1785774983.520951:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785774983.520954:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1c00, rc 0) 00000100:00100000:2.0:1785774983.521007:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+104:22206:x1872519648689024:12345-192.168.202.31@tcp:101:bash.0 Request processed in 301us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.521014:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24241 00000100:00100000:2.0:1785774983.544705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.544842:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648689152 00000100:00100000:0.0:1785774983.544851:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648689152 00002000:00100000:0.0:1785774983.544903:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (0->6) req@ffff9b773fb4a300 x1872519648689152/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774983.544913:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb4a300 with x1872519648689152 ext(0->6) 00002000:00010000:0.0:1785774983.544919:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fb4a300 00000100:00100000:0.0:1785774983.544950:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 62 00000100:00100000:0.0:1785774983.544959:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648689152:12345-192.168.202.31@tcp:4:bash.0 00000100:00100000:0.0:1785774983.546013:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648689152:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1052us (1314us total) trans 4294969987 rc 0/0 00000100:00100000:0.0:1785774983.546023:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 62 00002000:00100000:0.0:1785774983.546032:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (0->6) req@ffff9b773fb4a300 x1872519648689152/t4294969987(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 496/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774983.546040:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb4a300 with x1872519648689152 ext(0->6) 00002000:00010000:0.0:1785774983.546045:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773fb4a300 00000100:00100000:3.0:1785774983.549975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.551430:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648689280 00000100:00100000:2.0:1785774983.551449:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648689280 00000100:00100000:2.0:1785774983.551511:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5391 00000100:00100000:2.0:1785774983.551520:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648689280:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774983.552914:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969987 is committed 00000100:00100000:2.0:1785774983.553062:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648689280:12345-192.168.202.31@tcp:16:bash.0 Request processed in 1540us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.553071:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5391 00000100:00100000:3.0:1785774983.571747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.573194:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648689536 00000100:00100000:0.0:1785774983.573213:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648689536 00000100:00100000:0.0:1785774983.573279:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5278 00000100:00100000:0.0:1785774983.573288:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+104:22206:x1872519648689536:12345-192.168.202.31@tcp:35:bash.0 00000001:00080000:0.0:1785774983.573499:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968650 00000100:00100000:0.0:1785774983.573615:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+106:22206:x1872519648689536:12345-192.168.202.31@tcp:35:bash.0 Request processed in 327us (1878us total) trans 4294968651 rc 0/0 00000100:00100000:0.0:1785774983.573624:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5278 00000020:00080000:0.0:1785774983.573629:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774983.754351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.754548:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648689792 00000100:00100000:0.0:1785774983.754558:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648689792 00000100:00100000:0.0:1785774983.754625:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24242 00000100:00100000:0.0:1785774983.754635:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+106:22375:x1872519648689792:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774983.754659:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.754683:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a235d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c88b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.754792:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.754806:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.754817:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.754830:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.754837:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.754844:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785774983.755231:0:6529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc:0x0], index 0: 0 00010000:00010000:0.0:1785774983.755734:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755744:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755752:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755780:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755792:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755799:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755805:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755812:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774983.755816:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755823:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755834:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95600) 00010000:00010000:0.0:1785774983.755836:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774983.755841:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755848:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a2364 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785774983.755860:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4862b10 reply state 00000000689fcf8c transno 4294968652 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755871:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755877:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95e00) 00010000:00010000:0.0:1785774983.755880:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774983.755882:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785774983.755905:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a235d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 109 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755922:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 108 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.755929:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774983.755931:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774983.755933:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7800, rc 0) 00000100:00100000:0.0:1785774983.755998:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+109:22375:x1872519648689792:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1363us (1654us total) trans 4294968652 rc 0/0 00000100:00100000:0.0:1785774983.756006:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24242 00000100:00100000:3.0:1785774983.775921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.776019:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648689920 00000100:00100000:2.0:1785774983.776030:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648689920 00000100:00100000:2.0:1785774983.776099:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5392 00000100:00100000:2.0:1785774983.776109:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22375:x1872519648689920:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774983.776127:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774983.776147:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023490bb6/0x7b7109e1d0a2380 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c892 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785774983.776214:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1785774983.776237:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=1225s v=(0 0) 00010000:00010000:2.0:1785774983.776242:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785774983.776252:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023490bb6/0x7b7109e1d0a2380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c892 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.776268:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023490bb6/0x7b7109e1d0a2380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c892 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.776282:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1a00, rc 0) 00000100:00100000:2.0:1785774983.776350:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22375:x1872519648689920:12345-192.168.202.31@tcp:101:dd.0 Request processed in 243us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.776357:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5392 00000100:00100000:3.0:1785774983.802113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.803236:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648690048 00000100:00100000:2.0:1785774983.803247:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648690048 00002000:00100000:2.0:1785774983.803293:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b7603c5f100 x1872519648690048/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 8680/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.803411:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603c5f100 with x1872519648690048 ext(0->8191) 00002000:00010000:2.0:1785774983.803418:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603c5f100 00000100:00100000:2.0:1785774983.803472:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:2.0:1785774983.803482:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648690048:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774983.807571:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648690048:12345-192.168.202.31@tcp:4:dd.0 Request processed in 4081us (5457us total) trans 4294969963 rc 0/0 00000100:00100000:2.0:1785774983.807587:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 63 00002000:00100000:2.0:1785774983.807599:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b7603c5f100 x1872519648690048/t4294969963(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 8680/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.807611:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603c5f100 with x1872519648690048 ext(0->8191) 00002000:00010000:2.0:1785774983.807617:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603c5f100 00000100:00100000:0.0:1785774983.822046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774983.822145:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648690176 00000100:00100000:3.0:1785774983.822156:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648690176 00000100:00100000:3.0:1785774983.822240:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24243 00000100:00100000:3.0:1785774983.822250:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+109:22375:x1872519648690176:12345-192.168.202.31@tcp:44:dd.0 00000001:00080000:1.0:1785774983.829986:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968652 is committed 00010000:00010000:0.0:1785774983.830279:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.830293:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.830311:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.830318:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774983.830323:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.830330:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.830351:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95e00) 00010000:00010000:0.0:1785774983.830354:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774983.830359:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.830365:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a236b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774983.830641:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:22375:x1872519648690176:12345-192.168.202.31@tcp:44:dd.0 Request processed in 8387us (8599us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774983.830652:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24243 00000100:00100000:3.0:1785774983.834239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.834407:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648690304 00000100:00100000:0.0:1785774983.834418:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648690304 00000100:00100000:0.0:1785774983.834485:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5393 00000100:00100000:0.0:1785774983.834495:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648690304:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774983.835809:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969963 is committed 00000100:00100000:2.0:1785774983.835955:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648690304:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1459us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774983.835965:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5393 00000100:00100000:0.0:1785774983.852099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.852228:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648690560 00000100:00100000:2.0:1785774983.852238:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648690560 00000100:00100000:2.0:1785774983.852297:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5279 00000100:00100000:2.0:1785774983.852317:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+47:22375:x1872519648690560:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774983.852611:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:22375:x1872519648690560:12345-192.168.202.31@tcp:35:dd.0 Request processed in 295us (530us total) trans 4294968653 rc 0/0 00000100:00100000:2.0:1785774983.852618:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5279 00000100:00100000:0.0:1785774983.872239:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.872494:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648690816 00000100:00100000:2.0:1785774983.872504:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648690816 00000100:00100000:2.0:1785774983.872565:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24244 00000100:00100000:2.0:1785774983.872575:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+48:22376:x1872519648690816:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774983.872598:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774983.872618:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2387 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c899 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.872735:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.872748:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 49 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.872756:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.872786:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 49 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774983.872798:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 49 pid: 6529 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774983.872811:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671388416:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774983.872899:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770383b900 going to sleep for 11 seconds 00000100:00100000:2.0:1785774983.875483:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671388416:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774983.875516:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774983.884145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.884482:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648690944 00000100:00100000:1.0:1785774983.884492:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648690944 00010000:00010000:1.0:1785774983.884532:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 50 pid: 6529 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774983.884566:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1680 00000100:00100000:1.0:1785774983.884575:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:2417:x1872519648690944:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774983.884590:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774983.884596:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 50 pid: 6529 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.884609:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 50 pid: 6529 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.884631:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a2372 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c88b expref: 50 pid: 6529 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.884648:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774983.884653:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.884663:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.884670:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.884704:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774983.884756:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:2417:x1872519648690944:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 182us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.884765:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1680 00010000:00010000:0.0:1785774983.885426:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.885444:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774983.885462:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774983.885594:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2387 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 50 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.885619:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 49 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.885632:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774983.885635:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1785774983.885638:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:0.0:1785774983.885678:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:22376:x1872519648690816:12345-192.168.202.31@tcp:101:dd.0 Request processed in 13105us (13449us total) trans 4294968654 rc 0/0 00000100:00100000:0.0:1785774983.885685:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24244 00000100:00100000:0.0:1785774983.898666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774983.898749:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648691072 00000100:00100000:1.0:1785774983.898759:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648691072 00000100:00100000:1.0:1785774983.898816:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24245 00000100:00100000:1.0:1785774983.898826:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+49:22376:x1872519648691072:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774983.898850:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774983.898870:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a239c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8a0 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.898922:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a239c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8a0 expref: 50 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.898939:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045600/0x7b7109e1d0a239c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8a0 expref: 50 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774983.898956:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774983.898960:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785774983.898963:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045600, rc 0) 00000100:00100000:1.0:1785774983.899021:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:22376:x1872519648691072:12345-192.168.202.31@tcp:101:dd.0 Request processed in 196us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774983.899029:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24245 00000100:00100000:3.0:1785774983.911550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.911663:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648691200 00000100:00100000:0.0:1785774983.911671:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648691200 00000100:00100000:0.0:1785774983.911737:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24246 00000100:00100000:0.0:1785774983.911746:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+50:22376:x1872519648691200:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774983.911766:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.911784:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a23a3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8a7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.911815:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a23aa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.911828:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a23aa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.911838:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a23aa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.911942:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a23a3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8a7 expref: 52 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.911965:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7800/0x7b7109e1d0a23aa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8a7 expref: 51 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.911973:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774983.911976:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785774983.911979:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7800, rc 0) 00000100:00100000:0.0:1785774983.912040:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:22376:x1872519648691200:12345-192.168.202.31@tcp:101:dd.0 Request processed in 295us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.912047:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24246 00000100:00100000:3.0:1785774983.936133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.936324:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648691328 00000100:00100000:2.0:1785774983.936333:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648691328 00002000:00100000:2.0:1785774983.936375:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b760275ad80 x1872519648691328/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 8680/0 e 0 to 0 dl 1785774994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.936385:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760275ad80 with x1872519648691328 ext(0->8191) 00002000:00010000:2.0:1785774983.936389:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760275ad80 00000100:00100000:2.0:1785774983.936420:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 64 00000100:00100000:2.0:1785774983.936428:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648691328:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774983.937138:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648691328:12345-192.168.202.31@tcp:4:dd.0 Request processed in 709us (1011us total) trans 4294969964 rc 0/0 00000100:00100000:2.0:1785774983.937147:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 64 00002000:00100000:2.0:1785774983.937153:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b760275ad80 x1872519648691328/t4294969964(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:674/0 lens 8680/448 e 0 to 0 dl 1785774994 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774983.937181:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760275ad80 with x1872519648691328 ext(0->8191) 00002000:00010000:2.0:1785774983.937185:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760275ad80 00000100:00100000:1.0:1785774983.947988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.948067:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648691456 00000100:00100000:0.0:1785774983.948077:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648691456 00000100:00100000:0.0:1785774983.948139:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5394 00000100:00100000:0.0:1785774983.948150:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648691456:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774983.950060:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969964 is committed 00000100:00100000:0.0:1785774983.950243:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648691456:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2092us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774983.950252:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5394 00010000:00010000:0.0:1785774983.973667:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774983.982847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774983.982954:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648691712 00000100:00100000:0.0:1785774983.982964:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648691712 00000100:00100000:0.0:1785774983.983025:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24247 00000100:00100000:0.0:1785774983.983036:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+51:22377:x1872519648691712:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774983.983056:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774983.983079:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a23b1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8ae expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983382:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983396:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983407:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983421:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983428:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983444:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983500:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a23c6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983510:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a23c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983517:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a23c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774983.983527:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774983.983601:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983612:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983618:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983624:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983630:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774983.983634:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983640:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983651:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95e00) 00010000:00010000:0.0:1785774983.983654:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774983.983658:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983663:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6800/0x7b7109e1d0a23b8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983676:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983681:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983687:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983693:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ea6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774983.983695:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983701:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983707:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95600) 00010000:00010000:0.0:1785774983.983709:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774983.983711:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983716:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6e00/0x7b7109e1d0a23bf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983756:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea6000/0x7b7109e1d0a23b1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ae expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983771:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ea7a00/0x7b7109e1d0a23c6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ae expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774983.983778:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774983.983781:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774983.983783:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ea7a00, rc 0) 00000100:00100000:0.0:1785774983.983834:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:22377:x1872519648691712:12345-192.168.202.31@tcp:101:dd.0 Request processed in 800us (996us total) trans 4294968655 rc 0/0 00000100:00100000:0.0:1785774983.983841:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24247 00000100:00100000:3.0:1785774983.989933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774983.990030:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648691968 00000100:00100000:2.0:1785774983.990040:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648691968 00000100:00100000:2.0:1785774983.990100:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5280 00000100:00100000:2.0:1785774983.990110:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:22377:x1872519648691968:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774983.990630:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22377:x1872519648691968:12345-192.168.202.31@tcp:35:dd.0 Request processed in 520us (704us total) trans 4294968656 rc 0/0 00000100:00100000:2.0:1785774983.990638:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5280 00000100:00100000:1.0:1785774984.025733:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.025812:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648692096 00000100:00100000:3.0:1785774984.025821:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648692096 00002000:00100000:3.0:1785774984.025864:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b7604e01880 x1872519648692096/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.025873:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e01880 with x1872519648692096 ext(0->8191) 00002000:00010000:3.0:1785774984.025879:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e01880 00000100:00100000:3.0:1785774984.025911:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 65 00000100:00100000:3.0:1785774984.025919:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648692096:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774984.027539:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648692096:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1615us (1808us total) trans 4294969965 rc 0/0 00000100:00100000:3.0:1785774984.027550:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 65 00002000:00100000:3.0:1785774984.027559:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b7604e01880 x1872519648692096/t4294969965(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.027569:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e01880 with x1872519648692096 ext(0->8191) 00002000:00010000:3.0:1785774984.027574:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e01880 00000100:00100000:0.0:1785774984.039383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.039531:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648692224 00000100:00100000:1.0:1785774984.039540:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648692224 00000100:00100000:1.0:1785774984.039602:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5395 00000100:00100000:1.0:1785774984.039612:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648692224:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1785774984.049031:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969965 is committed 00000100:00100000:0.0:1785774984.055076:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648692224:12345-192.168.202.31@tcp:16:dd.0 Request processed in 15457us (15693us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.055141:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5395 00000100:00100000:0.0:1785774984.085103:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.086034:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648692480 00000100:00100000:1.0:1785774984.086044:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648692480 00000100:00100000:1.0:1785774984.086110:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24248 00000100:00100000:1.0:1785774984.086118:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22378:x1872519648692480:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774984.086140:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774984.086214:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a23d4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8b5 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086461:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086476:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086487:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086500:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086513:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086520:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086576:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a23e9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086585:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a23e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086592:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a23e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774984.086600:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:1.0:1785774984.086670:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086677:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086683:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086688:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.086692:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086698:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086711:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe900) 00010000:00010000:1.0:1785774984.086713:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.086717:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086722:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a23db lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086733:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086738:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086742:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086747:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.086749:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086754:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086759:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfe800) 00010000:00010000:1.0:1785774984.086761:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.086763:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086767:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a23e2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086807:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a23d4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8b5 expref: 57 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086820:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a23e9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8b5 expref: 56 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.086827:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774984.086828:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774984.086831:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044e00, rc 0) 00000100:00100000:1.0:1785774984.087009:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22378:x1872519648692480:12345-192.168.202.31@tcp:101:dd.0 Request processed in 892us (1924us total) trans 4294968657 rc 0/0 00000100:00100000:1.0:1785774984.087017:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24248 00000100:00100000:1.0:1785774984.118979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.119014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.119205:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648692864 00000100:00100000:2.0:1785774984.119214:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648692864 00000100:00100000:2.0:1785774984.119268:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1519 00000100:00100000:2.0:1785774984.119277:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:2418:x1872519648692864:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.119293:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.119329:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a23e9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8b5 expref: 56 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.119349:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.119353:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.119403:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:2418:x1872519648692864:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 128us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.119410:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1519 00000100:00100000:0.0:1785774984.119884:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648692736 00000100:00100000:0.0:1785774984.119889:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648692736 00000100:00100000:0.0:1785774984.119933:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5281 00000100:00100000:0.0:1785774984.119940:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:22378:x1872519648692736:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774984.120223:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22378:x1872519648692736:12345-192.168.202.31@tcp:35:dd.0 Request processed in 282us (1251us total) trans 4294968658 rc 0/0 00000100:00100000:0.0:1785774984.120231:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5281 00000100:00100000:1.0:1785774984.128383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.128477:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648692992 00000100:00100000:0.0:1785774984.128487:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648692992 00002000:00100000:0.0:1785774984.128536:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b7604e02300 x1872519648692992/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774984.128548:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e02300 with x1872519648692992 ext(0->8191) 00002000:00010000:0.0:1785774984.128553:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e02300 00000100:00100000:0.0:1785774984.128584:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 66 00000100:00100000:0.0:1785774984.128594:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648692992:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774984.129266:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648692992:12345-192.168.202.31@tcp:4:dd.0 Request processed in 671us (890us total) trans 4294969966 rc 0/0 00000100:00100000:0.0:1785774984.129274:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 66 00002000:00100000:0.0:1785774984.129280:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b7604e02300 x1872519648692992/t4294969966(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774984.129288:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e02300 with x1872519648692992 ext(0->8191) 00002000:00010000:0.0:1785774984.129292:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e02300 00000100:00100000:3.0:1785774984.133324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.133496:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648693120 00000100:00100000:0.0:1785774984.133506:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648693120 00000100:00100000:0.0:1785774984.133565:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5396 00000100:00100000:0.0:1785774984.133574:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648693120:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1785774984.134949:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969966 is committed 00000100:00100000:0.0:1785774984.135548:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648693120:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1969us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.135559:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5396 00000100:00100000:3.0:1785774984.147348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.147422:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648693376 00000100:00100000:0.0:1785774984.147430:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648693376 00000100:00100000:0.0:1785774984.147496:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24249 00000100:00100000:0.0:1785774984.147506:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22379:x1872519648693376:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.147531:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.147555:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a23f7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8bc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147659:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147673:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147686:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147697:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147705:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147712:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147760:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a240c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147769:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a240c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147776:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a240c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.147784:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774984.147850:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147857:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147863:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147870:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147875:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.147879:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147886:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147901:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95900) 00010000:00010000:0.0:1785774984.147904:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.147908:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147915:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a23fe lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147928:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147933:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147938:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147943:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.147946:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147952:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147958:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95600) 00010000:00010000:0.0:1785774984.147961:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.147964:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.147970:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2405 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.148011:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a23f7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8bc expref: 59 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.148025:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a240c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8bc expref: 58 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.148033:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.148035:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774984.148037:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154e00, rc 0) 00000100:00100000:0.0:1785774984.148113:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22379:x1872519648693376:12345-192.168.202.31@tcp:101:dd.0 Request processed in 608us (772us total) trans 4294968659 rc 0/0 00000100:00100000:0.0:1785774984.148120:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24249 00000100:00100000:1.0:1785774984.153370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.153460:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648693632 00000100:00100000:3.0:1785774984.153470:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648693632 00000100:00100000:3.0:1785774984.153517:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5282 00000100:00100000:3.0:1785774984.153527:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22379:x1872519648693632:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1785774984.153735:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:22379:x1872519648693632:12345-192.168.202.31@tcp:35:dd.0 Request processed in 208us (374us total) trans 4294968660 rc 0/0 00000100:00100000:3.0:1785774984.153742:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5282 00000100:00100000:1.0:1785774984.164029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.164212:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648693760 00000100:00100000:0.0:1785774984.164222:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648693760 00000100:00100000:0.0:1785774984.164288:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1520 00000100:00100000:0.0:1785774984.164308:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:2416:x1872519648693760:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774984.164325:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774984.164351:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a240c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8bc expref: 59 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.164370:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.164375:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774984.164446:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:2416:x1872519648693760:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 149us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.164454:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1520 00000100:00100000:1.0:1785774984.170831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.170922:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648693888 00000100:00100000:2.0:1785774984.170932:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648693888 00002000:00100000:2.0:1785774984.170978:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b772a314000 x1872519648693888/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.170989:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314000 with x1872519648693888 ext(0->8191) 00002000:00010000:2.0:1785774984.170994:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a314000 00000100:00100000:2.0:1785774984.171020:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 67 00000100:00100000:2.0:1785774984.171029:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648693888:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.172574:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648693888:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1543us (1749us total) trans 4294969967 rc 0/0 00000100:00100000:2.0:1785774984.172583:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 67 00002000:00100000:2.0:1785774984.172592:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b772a314000 x1872519648693888/t4294969967(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.172600:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314000 with x1872519648693888 ext(0->8191) 00002000:00010000:2.0:1785774984.172605:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a314000 00000100:00100000:2.0:1785774984.178446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.178804:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648694016 00000100:00100000:0.0:1785774984.178813:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648694016 00000100:00100000:0.0:1785774984.178894:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5397 00000100:00100000:0.0:1785774984.178903:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648694016:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1785774984.183925:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969967 is committed 00000100:00100000:0.0:1785774984.184114:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648694016:12345-192.168.202.31@tcp:16:dd.0 Request processed in 5206us (5681us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.184126:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5397 00000100:00100000:1.0:1785774984.204645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.204732:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648694272 00000100:00100000:0.0:1785774984.204741:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648694272 00000100:00100000:0.0:1785774984.204795:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24250 00000100:00100000:0.0:1785774984.204804:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22380:x1872519648694272:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.204827:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.204848:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a241a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8c3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.204948:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.204962:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.204974:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.204986:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.204993:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.205003:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.205064:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a242f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.205072:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a242f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.205078:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a242f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.205448:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1785774984.205583:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205591:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205596:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205601:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205605:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.205608:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205614:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205625:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95900) 00010000:00010000:2.0:1785774984.205628:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.205632:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205637:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2421 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205647:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205652:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205661:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205665:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.205667:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205671:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205676:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95600) 00010000:00010000:2.0:1785774984.205678:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.205680:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205685:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2428 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205717:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a241a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8c3 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205729:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a242f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8c3 expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.205735:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.205737:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774984.205739:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154800, rc 0) 00000100:00100000:2.0:1785774984.205842:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22380:x1872519648694272:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1039us (1205us total) trans 4294968661 rc 0/0 00000100:00100000:2.0:1785774984.205852:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24250 00000100:00100000:1.0:1785774984.211929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.212005:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648694528 00000100:00100000:2.0:1785774984.212016:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648694528 00000100:00100000:2.0:1785774984.212077:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5283 00000100:00100000:2.0:1785774984.212092:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22380:x1872519648694528:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774984.212622:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:22380:x1872519648694528:12345-192.168.202.31@tcp:35:dd.0 Request processed in 530us (701us total) trans 4294968662 rc 0/0 00000100:00100000:2.0:1785774984.212631:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5283 00000100:00100000:1.0:1785774984.223536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.223697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648694656 00000100:00100000:2.0:1785774984.223706:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648694656 00000100:00100000:2.0:1785774984.223767:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1521 00000100:00100000:2.0:1785774984.223776:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:2417:x1872519648694656:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.223790:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.223812:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a242f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8c3 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.223832:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.223837:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.223895:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:2417:x1872519648694656:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 120us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.223902:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1521 00000100:00100000:1.0:1785774984.231912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.231993:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648694784 00000100:00100000:2.0:1785774984.232003:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648694784 00002000:00100000:2.0:1785774984.232061:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76044bf480 x1872519648694784/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.232076:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bf480 with x1872519648694784 ext(0->8191) 00002000:00010000:2.0:1785774984.232088:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044bf480 00000100:00100000:2.0:1785774984.232119:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 68 00000100:00100000:2.0:1785774984.232129:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648694784:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.233211:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648694784:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1081us (1306us total) trans 4294969968 rc 0/0 00000100:00100000:2.0:1785774984.233219:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 68 00002000:00100000:2.0:1785774984.233227:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76044bf480 x1872519648694784/t4294969968(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.233235:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bf480 with x1872519648694784 ext(0->8191) 00002000:00010000:2.0:1785774984.233239:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044bf480 00000100:00100000:1.0:1785774984.240856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.242049:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648694912 00000100:00100000:3.0:1785774984.242058:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648694912 00000100:00100000:3.0:1785774984.242308:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5398 00000100:00100000:3.0:1785774984.242319:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648694912:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1785774984.243604:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969968 is committed 00000100:00100000:3.0:1785774984.243747:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648694912:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1429us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774984.243755:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5398 00000100:00100000:1.0:1785774984.262793:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.262888:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648695168 00000100:00100000:0.0:1785774984.262899:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648695168 00000100:00100000:0.0:1785774984.262964:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24251 00000100:00100000:0.0:1785774984.262975:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22381:x1872519648695168:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.263001:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.263022:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a243d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8ca expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263140:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263153:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263207:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263225:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263233:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263239:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263291:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2452 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263312:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2452 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263319:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2452 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.263327:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774984.263393:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263399:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263405:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263410:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.263414:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263423:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263445:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95e00) 00010000:00010000:0.0:1785774984.263448:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.263452:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263479:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2444 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263491:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263496:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263501:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263505:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.263507:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263512:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263517:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95500) 00010000:00010000:0.0:1785774984.263519:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.263521:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263527:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a244b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263561:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a243d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ca expref: 63 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263573:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2452 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ca expref: 62 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.263579:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.263581:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774984.263583:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154000, rc 0) 00000100:00100000:0.0:1785774984.263628:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:22381:x1872519648695168:12345-192.168.202.31@tcp:101:dd.0 Request processed in 656us (844us total) trans 4294968663 rc 0/0 00000100:00100000:0.0:1785774984.263634:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24251 00000100:00100000:1.0:1785774984.271357:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.271400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.271477:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648695424 00000100:00100000:0.0:1785774984.271487:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648695424 00000100:00100000:0.0:1785774984.271548:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5284 00000100:00100000:0.0:1785774984.271559:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:22381:x1872519648695424:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774984.271778:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22381:x1872519648695424:12345-192.168.202.31@tcp:35:dd.0 Request processed in 221us (429us total) trans 4294968664 rc 0/0 00000100:00100000:0.0:1785774984.271786:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5284 00000100:00100000:2.0:1785774984.272633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648695552 00000100:00100000:2.0:1785774984.272640:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648695552 00000100:00100000:2.0:1785774984.272684:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1522 00000100:00100000:2.0:1785774984.272691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:2418:x1872519648695552:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.272701:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.272720:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2452 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ca expref: 63 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.272735:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.272739:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.272770:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:2418:x1872519648695552:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 80us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.272781:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1522 00000100:00100000:1.0:1785774984.286612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.286704:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648695680 00000100:00100000:2.0:1785774984.286713:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648695680 00002000:00100000:2.0:1785774984.286755:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b771f712300 x1872519648695680/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.286765:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712300 with x1872519648695680 ext(0->8191) 00002000:00010000:2.0:1785774984.286771:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f712300 00000100:00100000:2.0:1785774984.286800:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 69 00000100:00100000:2.0:1785774984.286808:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648695680:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.288001:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648695680:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1189us (1393us total) trans 4294969969 rc 0/0 00000100:00100000:2.0:1785774984.288012:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 69 00002000:00100000:2.0:1785774984.288021:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b771f712300 x1872519648695680/t4294969969(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.288030:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712300 with x1872519648695680 ext(0->8191) 00002000:00010000:2.0:1785774984.288034:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f712300 00000100:00100000:1.0:1785774984.292059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.292481:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648695808 00000100:00100000:2.0:1785774984.292490:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648695808 00000100:00100000:2.0:1785774984.292542:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5399 00000100:00100000:2.0:1785774984.292550:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648695808:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774984.293809:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969969 is committed 00000100:00100000:2.0:1785774984.294064:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648695808:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1511us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.294072:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5399 00000100:00100000:1.0:1785774984.316401:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.316683:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648696064 00000100:00100000:0.0:1785774984.316693:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648696064 00000100:00100000:0.0:1785774984.316753:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24252 00000100:00100000:0.0:1785774984.316763:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:22382:x1872519648696064:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.316788:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.316832:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2460 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8d1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.316956:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.316969:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.316979:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.316989:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.316995:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317000:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317063:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2475 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317071:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2475 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317077:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2475 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.317111:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774984.317221:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317229:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317236:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317243:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317249:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.317254:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317261:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317273:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95000) 00010000:00010000:0.0:1785774984.317276:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.317280:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317286:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2467 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317313:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317323:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317328:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317332:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.317334:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317339:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317344:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95500) 00010000:00010000:0.0:1785774984.317346:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.317348:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317353:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a246e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317386:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2460 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8d1 expref: 65 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317399:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2475 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8d1 expref: 64 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.317408:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.317410:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774984.317413:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155800, rc 0) 00000100:00100000:0.0:1785774984.317477:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:22382:x1872519648696064:12345-192.168.202.31@tcp:101:dd.0 Request processed in 714us (1085us total) trans 4294968665 rc 0/0 00000100:00100000:0.0:1785774984.317483:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24252 00000100:00100000:1.0:1785774984.323345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.323381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.323581:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648696320 00000100:00100000:2.0:1785774984.323590:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648696320 00000100:00100000:2.0:1785774984.323645:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5285 00000100:00100000:2.0:1785774984.323653:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:22382:x1872519648696320:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774984.323851:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:22382:x1872519648696320:12345-192.168.202.31@tcp:35:dd.0 Request processed in 199us (515us total) trans 4294968666 rc 0/0 00000100:00100000:2.0:1785774984.323859:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5285 00000100:00100000:0.0:1785774984.324786:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648696448 00000100:00100000:0.0:1785774984.324792:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648696448 00000100:00100000:0.0:1785774984.324835:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1523 00000100:00100000:0.0:1785774984.324843:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:2417:x1872519648696448:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774984.324854:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774984.324875:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2475 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8d1 expref: 65 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.324894:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.324899:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774984.324936:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:2417:x1872519648696448:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 94us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.324942:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1523 00000100:00100000:1.0:1785774984.336653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.337533:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648696576 00000100:00100000:0.0:1785774984.337544:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648696576 00002000:00100000:2.0:1785774984.337690:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b771f713b80 x1872519648696576/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.337702:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f713b80 with x1872519648696576 ext(0->8191) 00002000:00010000:2.0:1785774984.337708:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f713b80 00000100:00100000:2.0:1785774984.337775:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 70 00000100:00100000:2.0:1785774984.337784:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648696576:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.338495:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648696576:12345-192.168.202.31@tcp:4:dd.0 Request processed in 711us (1848us total) trans 4294969970 rc 0/0 00000100:00100000:2.0:1785774984.338503:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 70 00002000:00100000:2.0:1785774984.338511:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b771f713b80 x1872519648696576/t4294969970(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.338520:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f713b80 with x1872519648696576 ext(0->8191) 00002000:00010000:2.0:1785774984.338523:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f713b80 00000100:00100000:0.0:1785774984.342918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.343000:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648696704 00000100:00100000:1.0:1785774984.343009:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648696704 00000100:00100000:1.0:1785774984.343069:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5400 00000100:00100000:1.0:1785774984.343077:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648696704:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774984.344411:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969970 is committed 00000100:00100000:1.0:1785774984.344550:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648696704:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1472us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774984.344559:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5400 00000100:00100000:2.0:1785774984.356498:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774984.356523:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671388544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774984.356590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774984.356770:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671388544 00000100:00100000:1.0:1785774984.356778:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671388544 00000100:00100000:1.0:1785774984.356836:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1785774984.356845:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671388544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1785774984.356866:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218216128 pending 0 free 3923492864 avail 3691913216 00000100:00100000:1.0:1785774984.356910:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671388544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774984.356918:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1785774984.356962:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671388544:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1785774984.357311:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785774984.357387:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774984.357397:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774984.357427:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774984.357505:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671388672 00000100:00100000:0.0:1785774984.357509:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671388672 00000100:00100000:0.0:1785774984.357544:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:0.0:1785774984.357551:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760275b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774984.357574:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445052416 avail 1298812928 00000100:00100000:0.0:1785774984.357626:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760275b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.357632:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:3.0:1785774984.357751:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774984.362249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.362518:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648696960 00000100:00100000:2.0:1785774984.362526:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648696960 00000100:00100000:2.0:1785774984.362584:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24253 00000100:00100000:2.0:1785774984.362593:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:22384:x1872519648696960:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774984.362614:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774984.362634:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2483 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8d8 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362735:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362747:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362757:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362768:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362773:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362779:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362823:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2498 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362831:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2498 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362838:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2498 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774984.362852:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1785774984.362921:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362928:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362935:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362941:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362947:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.362951:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362958:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362971:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39800) 00010000:00010000:2.0:1785774984.362974:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.362978:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362985:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a248a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.362998:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363007:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363013:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363018:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.363021:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363026:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363033:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7604f39200) 00010000:00010000:2.0:1785774984.363036:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.363038:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363056:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2491 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363420:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2483 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8d8 expref: 67 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363449:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2498 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8d8 expref: 66 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.363458:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.363461:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774984.363464:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:2.0:1785774984.363525:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:22384:x1872519648696960:12345-192.168.202.31@tcp:101:dd.0 Request processed in 933us (1283us total) trans 4294968667 rc 0/0 00000100:00100000:2.0:1785774984.363534:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24253 00000100:00100000:3.0:1785774984.368073:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.368311:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648697088 00000100:00100000:2.0:1785774984.368320:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648697088 00000100:00100000:2.0:1785774984.368372:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1524 00000100:00100000:2.0:1785774984.368380:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:2416:x1872519648697088:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.368394:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.368415:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2498 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8d8 expref: 66 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.368444:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.368449:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.368505:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:2416:x1872519648697088:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 124us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.368513:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1524 00000100:00100000:3.0:1785774984.371220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.371698:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648697344 00000100:00100000:1.0:1785774984.371706:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648697344 00000100:00100000:1.0:1785774984.371753:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5286 00000100:00100000:1.0:1785774984.371761:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:22384:x1872519648697344:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:1.0:1785774984.371944:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:22384:x1872519648697344:12345-192.168.202.31@tcp:35:dd.0 Request processed in 183us (730us total) trans 4294968668 rc 0/0 00000100:00100000:1.0:1785774984.371952:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5286 00000100:00100000:3.0:1785774984.380140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.380771:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648697472 00000100:00100000:1.0:1785774984.380781:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648697472 00002000:00100000:1.0:1785774984.380827:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fb00a80 x1872519648697472/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774984.380838:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb00a80 with x1872519648697472 ext(0->8191) 00002000:00010000:1.0:1785774984.380843:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb00a80 00000100:00100000:1.0:1785774984.380879:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 71 00000100:00100000:1.0:1785774984.380889:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648697472:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:1.0:1785774984.382285:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648697472:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1394us (2150us total) trans 4294969971 rc 0/0 00000100:00100000:1.0:1785774984.382360:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 71 00002000:00100000:1.0:1785774984.382370:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fb00a80 x1872519648697472/t4294969971(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774984.382379:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb00a80 with x1872519648697472 ext(0->8191) 00002000:00010000:1.0:1785774984.382383:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb00a80 00000100:00100000:3.0:1785774984.390958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.391057:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648697600 00000100:00100000:0.0:1785774984.391066:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648697600 00000100:00100000:0.0:1785774984.391125:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5401 00000100:00100000:0.0:1785774984.391134:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648697600:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.393591:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969971 is committed 00000100:00100000:0.0:1785774984.393727:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648697600:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2592us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.393736:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5401 00000100:00100000:0.0:1785774984.410807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.410907:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648697856 00000100:00100000:1.0:1785774984.410916:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648697856 00000100:00100000:1.0:1785774984.410969:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24254 00000100:00100000:1.0:1785774984.410978:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:22385:x1872519648697856:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774984.411001:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774984.411023:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a24a6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8df expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411453:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411468:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411480:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411493:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411501:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411507:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411561:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a24bb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411570:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a24bb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411577:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a24bb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774984.411587:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:1.0:1785774984.411659:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411670:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411676:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411682:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.411685:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411692:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411703:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfea00) 00010000:00010000:1.0:1785774984.411706:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.411710:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411717:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ad lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411730:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411735:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411741:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411744:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.411747:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411753:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411758:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfe800) 00010000:00010000:1.0:1785774984.411760:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.411762:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411767:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a24b4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411804:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a24a6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8df expref: 69 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411817:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a24bb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8df expref: 68 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.411823:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774984.411825:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774984.411827:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044000, rc 0) 00000100:00100000:1.0:1785774984.412014:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22385:x1872519648697856:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1035us (1212us total) trans 4294968669 rc 0/0 00000100:00100000:1.0:1785774984.412021:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24254 00000100:00100000:3.0:1785774984.420973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.421199:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648698112 00000100:00100000:0.0:1785774984.421209:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648698112 00000100:00100000:0.0:1785774984.421262:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5287 00000100:00100000:0.0:1785774984.421272:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22385:x1872519648698112:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774984.421515:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+69:22385:x1872519648698112:12345-192.168.202.31@tcp:35:dd.0 Request processed in 244us (549us total) trans 4294968670 rc 0/0 00000100:00100000:0.0:1785774984.421523:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5287 00000100:00100000:3.0:1785774984.425722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.430096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648698240 00000100:00100000:0.0:1785774984.430109:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648698240 00000100:00100000:0.0:1785774984.430235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1525 00000100:00100000:0.0:1785774984.430247:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+69:2417:x1872519648698240:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774984.430265:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774984.430290:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a24bb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8df expref: 69 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.430321:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.430327:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774984.430397:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:2417:x1872519648698240:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 152us (4681us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.430406:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1525 00000100:00100000:3.0:1785774984.438149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.438544:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648698368 00000100:00100000:2.0:1785774984.438554:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648698368 00002000:00100000:2.0:1785774984.438595:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fb03b80 x1872519648698368/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.438604:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb03b80 with x1872519648698368 ext(0->8191) 00002000:00010000:2.0:1785774984.438609:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb03b80 00000100:00100000:2.0:1785774984.438643:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 72 00000100:00100000:2.0:1785774984.438650:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648698368:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.439613:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648698368:12345-192.168.202.31@tcp:4:dd.0 Request processed in 960us (1470us total) trans 4294969972 rc 0/0 00000100:00100000:2.0:1785774984.439622:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 72 00002000:00100000:2.0:1785774984.439631:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fb03b80 x1872519648698368/t4294969972(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.439639:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb03b80 with x1872519648698368 ext(0->8191) 00002000:00010000:2.0:1785774984.439643:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb03b80 00000100:00100000:3.0:1785774984.444565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.444679:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648698496 00000100:00100000:0.0:1785774984.444689:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648698496 00000100:00100000:0.0:1785774984.444748:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5402 00000100:00100000:0.0:1785774984.444757:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648698496:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.446274:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969972 is committed 00000100:00100000:0.0:1785774984.446409:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648698496:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1651us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.446418:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5402 00000100:00100000:3.0:1785774984.466346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.466481:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648698752 00000100:00100000:0.0:1785774984.466492:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648698752 00000100:00100000:0.0:1785774984.466553:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24255 00000100:00100000:0.0:1785774984.466563:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22386:x1872519648698752:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.466588:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.466613:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a24c9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8e6 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466733:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466746:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466759:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466773:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466781:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466788:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466845:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a24de lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466855:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a24de lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466863:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a24de lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.466872:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774984.466947:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466954:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466960:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466967:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466973:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.466977:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.466987:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467000:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95e00) 00010000:00010000:0.0:1785774984.467003:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.467008:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467014:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a24d0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467026:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467031:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467036:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467040:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.467042:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467046:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467052:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95500) 00010000:00010000:0.0:1785774984.467054:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.467056:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467064:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a24d7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467102:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a24c9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8e6 expref: 71 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467115:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a24de lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8e6 expref: 70 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.467122:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.467123:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774984.467126:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155200, rc 0) 00000100:00100000:0.0:1785774984.467256:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:22386:x1872519648698752:12345-192.168.202.31@tcp:101:dd.0 Request processed in 695us (921us total) trans 4294968671 rc 0/0 00000100:00100000:0.0:1785774984.467263:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24255 00000100:00100000:3.0:1785774984.489391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.489438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.489530:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648699008 00000100:00100000:2.0:1785774984.489538:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648699008 00000100:00100000:2.0:1785774984.489590:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5288 00000100:00100000:2.0:1785774984.489598:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:22386:x1872519648699008:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774984.489797:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:22386:x1872519648699008:12345-192.168.202.31@tcp:35:dd.0 Request processed in 200us (413us total) trans 4294968672 rc 0/0 00000100:00100000:2.0:1785774984.489805:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5288 00000100:00100000:1.0:1785774984.489954:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648699136 00000100:00100000:1.0:1785774984.489959:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648699136 00000100:00100000:1.0:1785774984.490000:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1526 00000100:00100000:1.0:1785774984.490008:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:2416:x1872519648699136:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774984.490019:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774984.490041:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a24de lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8e6 expref: 71 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.490058:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774984.490063:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774984.490094:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:2416:x1872519648699136:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 88us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774984.490101:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1526 00000100:00100000:1.0:1785774984.504271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.504508:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648699264 00000100:00100000:2.0:1785774984.504517:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648699264 00002000:00100000:2.0:1785774984.504563:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f6a00 x1872519648699264/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.504573:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f6a00 with x1872519648699264 ext(0->8191) 00002000:00010000:2.0:1785774984.504577:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f6a00 00000100:00100000:2.0:1785774984.504753:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 73 00000100:00100000:2.0:1785774984.504762:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648699264:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.505373:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648699264:12345-192.168.202.31@tcp:4:dd.0 Request processed in 611us (1108us total) trans 4294969973 rc 0/0 00000100:00100000:2.0:1785774984.505381:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 73 00002000:00100000:2.0:1785774984.505388:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f6a00 x1872519648699264/t4294969973(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.505396:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f6a00 with x1872519648699264 ext(0->8191) 00002000:00010000:2.0:1785774984.505399:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f6a00 00000100:00100000:3.0:1785774984.509807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.509888:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648699392 00000100:00100000:0.0:1785774984.509897:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648699392 00000100:00100000:0.0:1785774984.509954:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5403 00000100:00100000:0.0:1785774984.509964:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648699392:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.511402:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969973 is committed 00000100:00100000:0.0:1785774984.511765:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648699392:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1801us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.511774:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5403 00000100:00100000:0.0:1785774984.530075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.533370:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648699648 00000100:00100000:1.0:1785774984.533384:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648699648 00000100:00100000:1.0:1785774984.533564:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24256 00000100:00100000:1.0:1785774984.533575:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:22387:x1872519648699648:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774984.533599:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774984.533623:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ec lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8ed expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533727:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533742:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533753:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533770:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533777:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533784:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533838:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2501 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533848:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2501 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533856:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2501 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774984.533866:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:1.0:1785774984.533940:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533948:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533954:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533961:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533967:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.533971:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533978:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.533990:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfea00) 00010000:00010000:1.0:1785774984.533992:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.533996:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534002:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a24f3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534012:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534017:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534022:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534026:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.534028:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534033:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534038:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfe800) 00010000:00010000:1.0:1785774984.534050:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.534053:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534059:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a24fa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534105:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a24ec lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ed expref: 73 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534118:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2501 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ed expref: 72 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.534124:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774984.534126:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774984.534128:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045000, rc 0) 00000100:00100000:1.0:1785774984.534254:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22387:x1872519648699648:12345-192.168.202.31@tcp:101:dd.0 Request processed in 680us (4186us total) trans 4294968673 rc 0/0 00000100:00100000:1.0:1785774984.534260:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24256 00000100:00100000:0.0:1785774984.539366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.539402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.539464:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648700032 00000100:00100000:0.0:1785774984.539472:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648700032 00000100:00100000:0.0:1785774984.539524:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1527 00000100:00100000:0.0:1785774984.539532:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:2418:x1872519648700032:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774984.539545:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774984.539566:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2501 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8ed expref: 72 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.539585:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.539589:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774984.539640:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:2418:x1872519648700032:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.539646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1527 00000100:00100000:3.0:1785774984.540083:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648699904 00000100:00100000:3.0:1785774984.540088:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648699904 00000100:00100000:3.0:1785774984.540122:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5289 00000100:00100000:3.0:1785774984.540128:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:22387:x1872519648699904:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1785774984.540350:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22387:x1872519648699904:12345-192.168.202.31@tcp:35:dd.0 Request processed in 222us (990us total) trans 4294968674 rc 0/0 00000100:00100000:3.0:1785774984.540356:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5289 00000100:00100000:0.0:1785774984.557415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.557564:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648700160 00000100:00100000:2.0:1785774984.557574:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648700160 00002000:00100000:2.0:1785774984.557621:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fea8e00 x1872519648700160/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.557632:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fea8e00 with x1872519648700160 ext(0->8191) 00002000:00010000:2.0:1785774984.557638:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fea8e00 00000100:00100000:2.0:1785774984.557670:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 74 00000100:00100000:2.0:1785774984.557679:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648700160:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.558659:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648700160:12345-192.168.202.31@tcp:4:dd.0 Request processed in 978us (1250us total) trans 4294969974 rc 0/0 00000100:00100000:2.0:1785774984.558668:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 74 00002000:00100000:2.0:1785774984.558675:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fea8e00 x1872519648700160/t4294969974(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.558685:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fea8e00 with x1872519648700160 ext(0->8191) 00002000:00010000:2.0:1785774984.558688:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fea8e00 00000100:00100000:3.0:1785774984.562743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.562822:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648700288 00000100:00100000:0.0:1785774984.562831:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648700288 00000100:00100000:0.0:1785774984.562880:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5404 00000100:00100000:0.0:1785774984.562888:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648700288:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.564376:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969974 is committed 00000100:00100000:0.0:1785774984.564632:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648700288:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1741us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.564642:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5404 00000100:00100000:0.0:1785774984.586958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.587208:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648700544 00000100:00100000:2.0:1785774984.587218:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648700544 00000100:00100000:2.0:1785774984.587281:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24257 00000100:00100000:2.0:1785774984.587292:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22388:x1872519648700544:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774984.587326:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774984.587349:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a250f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587482:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587498:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587510:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587524:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587532:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587539:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587590:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2524 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587599:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2524 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587606:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2524 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774984.587616:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1785774984.587694:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587707:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587714:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587720:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587725:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.587729:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587736:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587747:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39800) 00010000:00010000:2.0:1785774984.587750:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.587754:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587760:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2516 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587773:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587779:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587785:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587791:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.587794:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587799:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587806:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7604f39200) 00010000:00010000:2.0:1785774984.587808:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.587811:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587817:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a251d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587859:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a250f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8f4 expref: 75 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587876:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2524 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8f4 expref: 74 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.587884:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.587887:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774984.587889:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:2.0:1785774984.587951:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:22388:x1872519648700544:12345-192.168.202.31@tcp:101:dd.0 Request processed in 661us (1000us total) trans 4294968675 rc 0/0 00000100:00100000:2.0:1785774984.587958:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24257 00000100:00100000:1.0:1785774984.601712:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.601747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.601835:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648700800 00000100:00100000:0.0:1785774984.601844:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648700800 00000100:00100000:0.0:1785774984.601893:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5290 00000100:00100000:0.0:1785774984.601902:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:22388:x1872519648700800:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774984.602128:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:22388:x1872519648700800:12345-192.168.202.31@tcp:35:dd.0 Request processed in 226us (422us total) trans 4294968676 rc 0/0 00000100:00100000:0.0:1785774984.602137:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5290 00000100:00100000:2.0:1785774984.609710:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648700928 00000100:00100000:2.0:1785774984.609723:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648700928 00000100:00100000:2.0:1785774984.609792:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1528 00000100:00100000:2.0:1785774984.609801:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:2416:x1872519648700928:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.609817:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.609839:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2524 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8f4 expref: 75 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.609859:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.609864:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.609926:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:2416:x1872519648700928:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 126us (8177us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.609933:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1528 00000100:00100000:1.0:1785774984.614398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.614499:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648701056 00000100:00100000:3.0:1785774984.614510:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648701056 00002000:00100000:3.0:1785774984.614555:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f4700 x1872519648701056/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.614566:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f4700 with x1872519648701056 ext(0->8191) 00002000:00010000:3.0:1785774984.614571:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f4700 00000100:00100000:3.0:1785774984.614599:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 75 00000100:00100000:3.0:1785774984.614608:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648701056:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774984.615414:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648701056:12345-192.168.202.31@tcp:4:dd.0 Request processed in 804us (1020us total) trans 4294969975 rc 0/0 00000100:00100000:3.0:1785774984.615422:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 75 00002000:00100000:3.0:1785774984.615439:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f4700 x1872519648701056/t4294969975(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.615447:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f4700 with x1872519648701056 ext(0->8191) 00002000:00010000:3.0:1785774984.615458:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f4700 00000100:00100000:3.0:1785774984.620139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.620323:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648701184 00000100:00100000:2.0:1785774984.620331:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648701184 00000100:00100000:2.0:1785774984.620382:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5405 00000100:00100000:2.0:1785774984.620390:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648701184:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.622740:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969975 is committed 00000100:00100000:2.0:1785774984.622894:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648701184:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2501us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.622904:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5405 00000100:00100000:1.0:1785774984.637512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.637597:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648701440 00000100:00100000:0.0:1785774984.637606:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648701440 00000100:00100000:0.0:1785774984.637659:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24258 00000100:00100000:0.0:1785774984.637667:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:22389:x1872519648701440:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.637692:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.637713:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a2532 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c8fb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637814:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637828:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637839:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637850:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637856:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637861:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637907:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2547 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637918:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2547 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.637925:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2547 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.637934:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774984.638009:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638017:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638023:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638030:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638036:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.638040:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638048:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638062:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95e00) 00010000:00010000:0.0:1785774984.638065:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.638069:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638076:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a2539 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638104:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638111:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638117:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638122:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.638125:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638130:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638137:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95500) 00010000:00010000:0.0:1785774984.638139:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.638142:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638148:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2540 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638247:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a2532 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8fb expref: 77 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638267:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2547 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8fb expref: 76 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.638281:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.638284:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774984.638287:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155400, rc 0) 00000100:00100000:0.0:1785774984.638337:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22389:x1872519648701440:12345-192.168.202.31@tcp:101:dd.0 Request processed in 671us (834us total) trans 4294968677 rc 0/0 00000100:00100000:0.0:1785774984.638344:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24258 00000100:00100000:1.0:1785774984.642875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.643002:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648701696 00000100:00100000:0.0:1785774984.643010:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648701696 00000100:00100000:0.0:1785774984.643065:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5291 00000100:00100000:0.0:1785774984.643084:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22389:x1872519648701696:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774984.643571:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:22389:x1872519648701696:12345-192.168.202.31@tcp:35:dd.0 Request processed in 497us (703us total) trans 4294968678 rc 0/0 00000100:00100000:0.0:1785774984.643580:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5291 00000100:00100000:1.0:1785774984.654100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.654199:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648701824 00000100:00100000:2.0:1785774984.654209:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648701824 00000100:00100000:2.0:1785774984.654274:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1529 00000100:00100000:2.0:1785774984.654284:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:2417:x1872519648701824:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.654311:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.654335:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2547 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c8fb expref: 77 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.654360:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.654364:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.654418:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:2417:x1872519648701824:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 136us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.654425:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1529 00000100:00100000:1.0:1785774984.658498:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.658831:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648701952 00000100:00100000:3.0:1785774984.658840:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648701952 00002000:00100000:3.0:1785774984.658880:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f4000 x1872519648701952/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.658892:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f4000 with x1872519648701952 ext(0->8191) 00002000:00010000:3.0:1785774984.658897:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f4000 00000100:00100000:3.0:1785774984.658921:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 76 00000100:00100000:3.0:1785774984.658929:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648701952:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.659944:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648701952:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1013us (1450us total) trans 4294969976 rc 0/0 00000100:00100000:2.0:1785774984.659954:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 76 00002000:00100000:2.0:1785774984.659961:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f4000 x1872519648701952/t4294969976(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.659969:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f4000 with x1872519648701952 ext(0->8191) 00002000:00010000:2.0:1785774984.659975:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f4000 00000100:00100000:1.0:1785774984.664252:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.664363:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648702080 00000100:00100000:0.0:1785774984.664372:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648702080 00000100:00100000:0.0:1785774984.664422:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5406 00000100:00100000:0.0:1785774984.664441:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648702080:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.665839:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969976 is committed 00000100:00100000:0.0:1785774984.665962:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648702080:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1529us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.665971:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5406 00000100:00100000:1.0:1785774984.677700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.677783:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648702336 00000100:00100000:2.0:1785774984.677791:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648702336 00000100:00100000:2.0:1785774984.677846:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24259 00000100:00100000:2.0:1785774984.677854:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22390:x1872519648702336:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774984.677876:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774984.677897:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2555 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c902 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.677996:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678009:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678025:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678037:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678054:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678062:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678116:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a256a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678125:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a256a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678132:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a256a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774984.678140:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1785774984.678250:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678256:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678262:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678267:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678273:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.678277:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678283:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678293:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39800) 00010000:00010000:2.0:1785774984.678295:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.678298:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678303:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a255c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678314:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678319:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678325:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678329:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.678331:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678335:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678344:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7604f39200) 00010000:00010000:2.0:1785774984.678346:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.678348:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678353:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2563 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678387:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2555 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c902 expref: 79 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678400:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a256a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c902 expref: 78 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.678408:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.678410:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774984.678412:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0800, rc 0) 00000100:00100000:2.0:1785774984.678479:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22390:x1872519648702336:12345-192.168.202.31@tcp:101:dd.0 Request processed in 625us (787us total) trans 4294968679 rc 0/0 00000100:00100000:2.0:1785774984.678487:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24259 00000100:00100000:1.0:1785774984.683933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.684093:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648702592 00000100:00100000:3.0:1785774984.684104:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648702592 00000100:00100000:3.0:1785774984.684196:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5292 00000100:00100000:3.0:1785774984.684207:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22390:x1872519648702592:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1785774984.684772:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:22390:x1872519648702592:12345-192.168.202.31@tcp:35:dd.0 Request processed in 567us (846us total) trans 4294968680 rc 0/0 00000100:00100000:3.0:1785774984.684779:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5292 00000100:00100000:0.0:1785774984.694598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.694689:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648702720 00000100:00100000:2.0:1785774984.694697:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648702720 00000100:00100000:2.0:1785774984.694758:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1530 00000100:00100000:2.0:1785774984.694774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:2418:x1872519648702720:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.694791:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.694813:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a256a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c902 expref: 79 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.694837:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.694841:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.694890:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:2418:x1872519648702720:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 117us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.694897:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1530 00000100:00100000:1.0:1785774984.697334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.697404:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648702848 00000100:00100000:3.0:1785774984.697412:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648702848 00002000:00100000:3.0:1785774984.697465:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76045ab100 x1872519648702848/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.697475:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76045ab100 with x1872519648702848 ext(0->8191) 00002000:00010000:3.0:1785774984.697480:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76045ab100 00000100:00100000:3.0:1785774984.697506:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 77 00000100:00100000:3.0:1785774984.697515:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648702848:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774984.698736:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648702848:12345-192.168.202.31@tcp:4:dd.0 Request processed in 972us (1158us total) trans 4294969977 rc 0/0 00000100:00100000:3.0:1785774984.698745:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 77 00002000:00100000:3.0:1785774984.698752:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76045ab100 x1872519648702848/t4294969977(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.698760:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76045ab100 with x1872519648702848 ext(0->8191) 00002000:00010000:3.0:1785774984.698850:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76045ab100 00000100:00100000:0.0:1785774984.703030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.703219:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648702976 00000100:00100000:3.0:1785774984.703228:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648702976 00000100:00100000:3.0:1785774984.703281:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5407 00000100:00100000:3.0:1785774984.703290:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648702976:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.704845:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969977 is committed 00000100:00100000:3.0:1785774984.705033:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7602759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648702976:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1741us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774984.705043:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5407 00000100:00100000:0.0:1785774984.715880:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.715971:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648703232 00000100:00100000:2.0:1785774984.715981:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648703232 00000100:00100000:2.0:1785774984.716045:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24260 00000100:00100000:2.0:1785774984.716055:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22391:x1872519648703232:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774984.716139:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774984.716348:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2578 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c909 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716473:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716487:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716499:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716512:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716518:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716530:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716583:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a258d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716592:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a258d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716599:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a258d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774984.716608:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1785774984.716684:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716691:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716698:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716704:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716711:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.716715:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716722:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716737:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39800) 00010000:00010000:2.0:1785774984.716740:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.716744:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716749:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a257f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716762:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716767:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716773:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716778:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.716781:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716787:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716794:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7604f39200) 00010000:00010000:2.0:1785774984.716796:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.716799:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716804:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2586 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716849:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2578 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c909 expref: 81 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716865:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a258d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c909 expref: 80 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.716872:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.716874:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774984.716876:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:2.0:1785774984.717027:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22391:x1872519648703232:12345-192.168.202.31@tcp:101:dd.0 Request processed in 972us (1153us total) trans 4294968681 rc 0/0 00000100:00100000:2.0:1785774984.717034:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24260 00000100:00100000:1.0:1785774984.723555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.723594:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.723650:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648703616 00000100:00100000:2.0:1785774984.723659:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648703616 00000100:00100000:2.0:1785774984.723719:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1531 00000100:00100000:2.0:1785774984.723727:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:2417:x1872519648703616:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774984.723742:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774984.723765:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a258d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c909 expref: 80 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.723783:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.723787:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774984.723835:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:2417:x1872519648703616:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 108us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.723842:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1531 00000100:00100000:0.0:1785774984.724827:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648703488 00000100:00100000:0.0:1785774984.724835:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648703488 00000100:00100000:0.0:1785774984.724877:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5293 00000100:00100000:0.0:1785774984.724884:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+79:22391:x1872519648703488:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774984.725104:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22391:x1872519648703488:12345-192.168.202.31@tcp:35:dd.0 Request processed in 219us (1557us total) trans 4294968682 rc 0/0 00000100:00100000:0.0:1785774984.725110:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5293 00000100:00100000:1.0:1785774984.734776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.735057:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648703744 00000100:00100000:2.0:1785774984.735067:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648703744 00002000:00100000:2.0:1785774984.735124:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76045a8700 x1872519648703744/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.735134:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76045a8700 with x1872519648703744 ext(0->8191) 00002000:00010000:2.0:1785774984.735140:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76045a8700 00000100:00100000:2.0:1785774984.735205:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 78 00000100:00100000:2.0:1785774984.735215:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648703744:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.736412:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648703744:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1195us (1640us total) trans 4294969978 rc 0/0 00000100:00100000:2.0:1785774984.736421:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 78 00002000:00100000:2.0:1785774984.736440:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76045a8700 x1872519648703744/t4294969978(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.736449:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76045a8700 with x1872519648703744 ext(0->8191) 00002000:00010000:2.0:1785774984.736453:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76045a8700 00000100:00100000:2.0:1785774984.740713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.740797:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648703872 00000100:00100000:0.0:1785774984.740806:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648703872 00000100:00100000:0.0:1785774984.740857:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5408 00000100:00100000:0.0:1785774984.740866:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648703872:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.742057:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969978 is committed 00000100:00100000:0.0:1785774984.742270:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648703872:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1404us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.742277:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5408 00000100:00100000:1.0:1785774984.752407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.752867:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648704128 00000100:00100000:0.0:1785774984.752877:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648704128 00000100:00100000:0.0:1785774984.752965:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24261 00000100:00100000:0.0:1785774984.752974:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22392:x1872519648704128:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.752998:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.753019:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a259b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c910 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753257:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753270:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753280:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753317:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753324:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753330:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753377:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a25b0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753385:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a25b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753392:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a25b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.753400:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774984.753485:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753492:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753499:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753506:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753513:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.753517:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753524:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753536:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95e00) 00010000:00010000:0.0:1785774984.753539:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.753543:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753550:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25a2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753563:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753570:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753576:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753583:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.753586:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753591:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753598:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95500) 00010000:00010000:0.0:1785774984.753600:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.753602:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753607:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a25a9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753646:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a259b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c910 expref: 83 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753661:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a25b0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c910 expref: 82 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.753668:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.753671:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774984.753673:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154000, rc 0) 00000100:00100000:0.0:1785774984.753736:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:22392:x1872519648704128:12345-192.168.202.31@tcp:101:dd.0 Request processed in 762us (1335us total) trans 4294968683 rc 0/0 00000100:00100000:0.0:1785774984.753744:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24261 00000100:00100000:1.0:1785774984.758923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.758961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.759184:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648704384 00000100:00100000:1.0:1785774984.759344:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648704512 00000100:00100000:1.0:1785774984.759352:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648704512 00000100:00100000:1.0:1785774984.759409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1532 00000100:00100000:1.0:1785774984.759418:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:2418:x1872519648704512:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774984.759442:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774984.759466:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a25b0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c910 expref: 82 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.759484:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774984.759489:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774984.759538:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:2418:x1872519648704512:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 121us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774984.759546:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1532 00000100:00100000:3.0:1785774984.760711:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648704384 00000100:00100000:2.0:1785774984.760800:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5294 00000100:00100000:2.0:1785774984.760807:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:22392:x1872519648704384:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774984.760990:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:22392:x1872519648704384:12345-192.168.202.31@tcp:35:dd.0 Request processed in 182us (2074us total) trans 4294968684 rc 0/0 00000100:00100000:2.0:1785774984.760997:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5294 00000100:00100000:1.0:1785774984.770423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.770509:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648704640 00000100:00100000:2.0:1785774984.770520:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648704640 00002000:00100000:2.0:1785774984.770564:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b77012a9180 x1872519648704640/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.770579:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b77012a9180 with x1872519648704640 ext(0->8191) 00002000:00010000:2.0:1785774984.770585:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b77012a9180 00000100:00100000:2.0:1785774984.770615:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 79 00000100:00100000:2.0:1785774984.770623:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648704640:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.771622:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648704640:12345-192.168.202.31@tcp:4:dd.0 Request processed in 997us (1203us total) trans 4294969979 rc 0/0 00000100:00100000:2.0:1785774984.771632:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 79 00002000:00100000:2.0:1785774984.771641:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b77012a9180 x1872519648704640/t4294969979(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.771650:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b77012a9180 with x1872519648704640 ext(0->8191) 00002000:00010000:2.0:1785774984.771654:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b77012a9180 00000100:00100000:2.0:1785774984.776027:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.776119:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648704768 00000100:00100000:0.0:1785774984.776128:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648704768 00000100:00100000:0.0:1785774984.776215:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5409 00000100:00100000:0.0:1785774984.776225:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648704768:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774984.777461:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969979 is committed 00000100:00100000:1.0:1785774984.777602:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648704768:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1376us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774984.777614:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5409 00000100:00100000:1.0:1785774984.788356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.788481:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648705024 00000100:00100000:2.0:1785774984.788489:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648705024 00000100:00100000:2.0:1785774984.788542:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24262 00000100:00100000:2.0:1785774984.788552:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:22393:x1872519648705024:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774984.788574:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774984.788596:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a25be lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c917 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788695:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788709:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788725:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788737:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788744:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788750:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788795:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a25d3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788801:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a25d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788806:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a25d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774984.788814:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1785774984.788878:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788885:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788890:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788895:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788902:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.788905:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788912:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788922:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39800) 00010000:00010000:2.0:1785774984.788924:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.788928:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788933:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a25c5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788944:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788950:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788956:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788961:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774984.788964:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788970:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788980:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7604f39200) 00010000:00010000:2.0:1785774984.788982:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774984.788984:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.788989:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a25cc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.789029:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a25be lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c917 expref: 85 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.789044:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a25d3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c917 expref: 84 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774984.789051:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774984.789053:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774984.789056:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:2.0:1785774984.789616:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:22393:x1872519648705024:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1064us (1267us total) trans 4294968685 rc 0/0 00000100:00100000:2.0:1785774984.789623:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24262 00000100:00100000:0.0:1785774984.793915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.794002:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648705280 00000100:00100000:1.0:1785774984.794011:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648705280 00000100:00100000:1.0:1785774984.794066:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5295 00000100:00100000:1.0:1785774984.794086:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:22393:x1872519648705280:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:1.0:1785774984.794660:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:22393:x1872519648705280:12345-192.168.202.31@tcp:35:dd.0 Request processed in 585us (751us total) trans 4294968686 rc 0/0 00000100:00100000:1.0:1785774984.794668:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5295 00000100:00100000:2.0:1785774984.796997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.797139:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648705408 00000100:00100000:1.0:1785774984.797146:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648705408 00000100:00100000:1.0:1785774984.797225:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1533 00000100:00100000:1.0:1785774984.797234:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:2418:x1872519648705408:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774984.797246:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774984.797267:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a25d3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c917 expref: 85 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.797282:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774984.797286:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774984.797323:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:2418:x1872519648705408:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774984.797330:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1533 00000100:00100000:0.0:1785774984.807666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.807774:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648705536 00000100:00100000:3.0:1785774984.807783:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648705536 00002000:00100000:3.0:1785774984.807824:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fb02d80 x1872519648705536/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.807833:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb02d80 with x1872519648705536 ext(0->8191) 00002000:00010000:3.0:1785774984.807838:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb02d80 00000100:00100000:3.0:1785774984.807868:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 80 00000100:00100000:3.0:1785774984.807876:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648705536:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774984.808540:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648705536:12345-192.168.202.31@tcp:4:dd.0 Request processed in 662us (879us total) trans 4294969980 rc 0/0 00000100:00100000:3.0:1785774984.808549:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 80 00002000:00100000:3.0:1785774984.808556:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b773fb02d80 x1872519648705536/t4294969980(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.808564:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb02d80 with x1872519648705536 ext(0->8191) 00002000:00010000:3.0:1785774984.808567:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb02d80 00000100:00100000:0.0:1785774984.813566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.813654:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648705664 00000100:00100000:3.0:1785774984.813662:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648705664 00000100:00100000:3.0:1785774984.813713:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5410 00000100:00100000:3.0:1785774984.813722:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648705664:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.814913:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969980 is committed 00000100:00100000:0.0:1785774984.815046:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648705664:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1323us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.815058:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5410 00000100:00100000:1.0:1785774984.831060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.831205:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648705920 00000100:00100000:0.0:1785774984.831215:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648705920 00000100:00100000:0.0:1785774984.831276:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24263 00000100:00100000:0.0:1785774984.831286:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+84:22394:x1872519648705920:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774984.831569:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774984.831593:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25e1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c91e expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831702:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831716:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831727:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831740:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831747:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831753:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831808:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a25f6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831821:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a25f6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831827:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a25f6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774984.831836:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:0.0:1785774984.831911:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831920:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831926:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831933:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.831937:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831944:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831956:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605f95e00) 00010000:00010000:0.0:1785774984.831959:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.831963:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831970:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a25e8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831987:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.831994:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832000:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832005:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774984.832008:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832013:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832019:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95500) 00010000:00010000:0.0:1785774984.832022:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774984.832024:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832030:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a25ef lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832067:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a25e1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c91e expref: 87 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832092:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a25f6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c91e expref: 86 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.832106:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.832108:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774984.832110:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154600, rc 0) 00000100:00100000:0.0:1785774984.832264:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:22394:x1872519648705920:12345-192.168.202.31@tcp:101:dd.0 Request processed in 979us (1211us total) trans 4294968687 rc 0/0 00000100:00100000:0.0:1785774984.832271:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24263 00000100:00100000:1.0:1785774984.838103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.838139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.838232:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648706304 00000100:00100000:3.0:1785774984.838241:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648706304 00000100:00100000:3.0:1785774984.838307:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1534 00000100:00100000:3.0:1785774984.838316:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:2418:x1872519648706304:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774984.838330:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774984.838352:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a25f6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c91e expref: 86 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.838368:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774984.838373:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774984.838434:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:2418:x1872519648706304:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774984.838442:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1534 00000100:00100000:0.0:1785774984.838581:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648706176 00000100:00100000:0.0:1785774984.838586:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648706176 00000100:00100000:0.0:1785774984.838626:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5296 00000100:00100000:0.0:1785774984.838632:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:22394:x1872519648706176:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774984.838812:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:22394:x1872519648706176:12345-192.168.202.31@tcp:35:dd.0 Request processed in 179us (716us total) trans 4294968688 rc 0/0 00000100:00100000:0.0:1785774984.838819:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5296 00000100:00100000:2.0:1785774984.846961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.847044:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648706432 00000100:00100000:3.0:1785774984.847053:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648706432 00002000:00100000:3.0:1785774984.847106:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f6300 x1872519648706432/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.847117:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f6300 with x1872519648706432 ext(0->8191) 00002000:00010000:3.0:1785774984.847122:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f6300 00000100:00100000:3.0:1785774984.847150:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 81 00000100:00100000:3.0:1785774984.847194:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648706432:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774984.848033:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648706432:12345-192.168.202.31@tcp:4:dd.0 Request processed in 873us (1079us total) trans 4294969981 rc 0/0 00000100:00100000:3.0:1785774984.848042:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 81 00002000:00100000:3.0:1785774984.848049:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b76037f6300 x1872519648706432/t4294969981(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.848064:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76037f6300 with x1872519648706432 ext(0->8191) 00002000:00010000:3.0:1785774984.848068:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76037f6300 00000100:00100000:2.0:1785774984.852638:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.852724:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648706560 00000100:00100000:0.0:1785774984.852733:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648706560 00000100:00100000:0.0:1785774984.852790:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5411 00000100:00100000:0.0:1785774984.852800:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648706560:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774984.854468:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969981 is committed 00000100:00100000:0.0:1785774984.854634:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76037f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648706560:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1831us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.854645:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5411 00000100:00100000:3.0:1785774984.869918:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774984.869992:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774984.870203:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671388800 00000100:00100000:2.0:1785774984.870211:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671388800 00000100:00100000:2.0:1785774984.870272:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1785774984.870281:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388800:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785774984.870375:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1785774984.870496:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218216128 pending 0 free 3923492864 avail 3691913216 00000100:00100000:1.0:1785774984.871918:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.871978:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648706816 00000100:00100000:3.0:1785774984.871983:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648706816 00000100:00100000:3.0:1785774984.872026:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24264 00000100:00100000:3.0:1785774984.872033:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:22395:x1872519648706816:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774984.872052:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774984.872072:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a2604 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c925 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872208:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872221:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872232:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872244:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872250:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872256:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872649:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2619 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872661:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2619 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872669:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2619 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774984.872678:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:3.0:1785774984.872747:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872755:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872762:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872768:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872774:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774984.872778:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872786:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872797:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b76032eea00) 00010000:00010000:3.0:1785774984.872800:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774984.872804:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872811:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a260b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872822:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872828:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872834:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872840:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774984.872843:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872849:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872855:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b76032ee000) 00010000:00010000:3.0:1785774984.872857:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774984.872860:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872865:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2612 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872900:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a2604 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c925 expref: 89 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872919:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2619 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c925 expref: 88 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774984.872927:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774984.872930:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1785774984.872932:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:3.0:1785774984.872974:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22395:x1872519648706816:12345-192.168.202.31@tcp:101:dd.0 Request processed in 941us (1059us total) trans 4294968689 rc 0/0 00000100:00100000:3.0:1785774984.872980:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24264 00000100:00100000:2.0:1785774984.873824:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671388800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3542us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774984.873833:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1785774984.878369:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b77012a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671388800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774984.880487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.880901:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648707072 00000100:00100000:1.0:1785774984.880909:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648707072 00000100:00100000:1.0:1785774984.880962:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5297 00000100:00100000:1.0:1785774984.880972:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22395:x1872519648707072:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:1.0:1785774984.881374:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:22395:x1872519648707072:12345-192.168.202.31@tcp:35:dd.0 Request processed in 402us (891us total) trans 4294968690 rc 0/0 00000100:00100000:1.0:1785774984.881381:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5297 00000100:00100000:2.0:1785774984.881610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.881678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648707200 00000100:00100000:0.0:1785774984.881682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648707200 00000100:00100000:0.0:1785774984.881723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1535 00000100:00100000:0.0:1785774984.881730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:2418:x1872519648707200:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774984.881741:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774984.881763:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2619 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c925 expref: 89 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.881780:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.881784:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774984.881804:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:2418:x1872519648707200:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.881810:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1535 00000100:00100000:2.0:1785774984.890038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.890435:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648707328 00000100:00100000:3.0:1785774984.890446:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648707328 00002000:00100000:3.0:1785774984.890491:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b771f712a00 x1872519648707328/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.890501:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712a00 with x1872519648707328 ext(0->8191) 00002000:00010000:3.0:1785774984.890507:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f712a00 00000100:00100000:3.0:1785774984.890541:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 82 00000100:00100000:3.0:1785774984.890551:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648707328:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774984.891457:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648707328:12345-192.168.202.31@tcp:4:dd.0 Request processed in 906us (1426us total) trans 4294969982 rc 0/0 00000100:00100000:3.0:1785774984.891466:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 82 00002000:00100000:3.0:1785774984.891472:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->8191) req@ffff9b771f712a00 x1872519648707328/t4294969982(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774984.891480:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712a00 with x1872519648707328 ext(0->8191) 00002000:00010000:3.0:1785774984.891484:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f712a00 00000100:00100000:1.0:1785774984.899006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.899379:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648707456 00000100:00100000:0.0:1785774984.899388:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648707456 00000100:00100000:1.0:1785774984.899550:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5412 00000100:00100000:1.0:1785774984.899560:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648707456:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774984.900615:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969982 is committed 00000100:00100000:1.0:1785774984.900744:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648707456:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1184us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774984.900753:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5412 00000100:00100000:2.0:1785774984.975823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774984.975927:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648707712 00000100:00100000:1.0:1785774984.975937:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648707712 00000100:00100000:1.0:1785774984.975998:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24265 00000100:00100000:1.0:1785774984.976008:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22402:x1872519648707712:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774984.976030:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774984.976051:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2627 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c92c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976202:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976220:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976231:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976245:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976253:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976259:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976317:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a263c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976325:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a263c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976332:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a263c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774984.976341:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:1.0:1785774984.976405:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976413:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976419:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976437:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976444:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.976448:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976456:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976467:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfea00) 00010000:00010000:1.0:1785774984.976471:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.976475:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976481:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a262e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976494:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976500:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976507:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976512:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774984.976515:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976526:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976532:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfe800) 00010000:00010000:1.0:1785774984.976534:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774984.976537:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976543:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2635 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976577:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2627 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c92c expref: 91 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976591:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a263c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c92c expref: 90 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774984.976598:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774984.976600:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774984.976602:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044c00, rc 0) 00000100:00100000:1.0:1785774984.976661:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:22402:x1872519648707712:12345-192.168.202.31@tcp:101:dd.0 Request processed in 655us (846us total) trans 4294968691 rc 0/0 00000100:00100000:1.0:1785774984.976668:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24265 00000100:00100000:3.0:1785774984.983365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774984.983404:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774984.983488:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648708096 00000100:00100000:0.0:1785774984.983496:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648708096 00000100:00100000:0.0:1785774984.983557:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1536 00000100:00100000:0.0:1785774984.983565:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:2419:x1872519648708096:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774984.983580:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774984.983602:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a263c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c92c expref: 90 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774984.983620:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774984.983623:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774984.983693:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:2419:x1872519648708096:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 129us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774984.983699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1536 00000100:00100000:2.0:1785774984.983962:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648707968 00000100:00100000:2.0:1785774984.983966:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648707968 00000100:00100000:2.0:1785774984.983999:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5298 00000100:00100000:2.0:1785774984.984006:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:22402:x1872519648707968:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774984.984221:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:22402:x1872519648707968:12345-192.168.202.31@tcp:35:dd.0 Request processed in 215us (863us total) trans 4294968692 rc 0/0 00000100:00100000:2.0:1785774984.984227:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5298 00010000:00010000:3.0:1785774984.996576:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774984.998439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774984.998555:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648708224 00000100:00100000:2.0:1785774984.998565:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648708224 00002000:00100000:2.0:1785774984.998606:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (4096->12287) req@ffff9b76044b3800 x1872519648708224/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/0 e 0 to 0 dl 1785774995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.998616:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b3800 with x1872519648708224 ext(4096->12287) 00002000:00010000:2.0:1785774984.998621:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b3800 00000100:00100000:2.0:1785774984.998650:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 83 00000100:00100000:2.0:1785774984.998657:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648708224:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774984.999941:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648708224:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1281us (1516us total) trans 4294969984 rc 0/0 00000100:00100000:2.0:1785774984.999954:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 83 00002000:00100000:2.0:1785774984.999963:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (4096->12287) req@ffff9b76044b3800 x1872519648708224/t4294969984(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:675/0 lens 8680/448 e 0 to 0 dl 1785774995 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774984.999972:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b3800 with x1872519648708224 ext(4096->12287) 00002000:00010000:2.0:1785774984.999976:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b3800 00000100:00100000:0.0:1785774985.003981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.004052:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648708352 00000100:00100000:3.0:1785774985.004060:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648708352 00000100:00100000:3.0:1785774985.004143:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5413 00000100:00100000:3.0:1785774985.004153:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773c2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648708352:12345-192.168.202.31@tcp:16:dd.0 00000100:00080000:0.0:1785774985.005094:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1785774985.005710:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969984 is committed 00000100:00100000:3.0:1785774985.005834:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773c2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648708352:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1680us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774985.005843:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5413 00000100:00100000:1.0:1785774985.017835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.018052:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648708608 00000100:00100000:2.0:1785774985.018063:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648708608 00000100:00080000:0.0:1785774985.018185:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774985.018314:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24266 00000100:00100000:2.0:1785774985.018325:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:22403:x1872519648708608:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774985.018349:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774985.018371:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a264a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c933 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018492:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018506:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018517:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018530:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018538:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018549:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018599:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a265f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018609:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a265f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018617:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a265f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774985.018626:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 8192 00010000:00010000:2.0:1785774985.018696:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018704:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018710:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018716:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018722:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.018726:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018733:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018747:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605fce100) 00010000:00010000:2.0:1785774985.018750:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.018754:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018761:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2651 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018774:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018780:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018786:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018791:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.018794:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018801:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018807:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7604f39300) 00010000:00010000:2.0:1785774985.018810:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.018812:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018817:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2658 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018860:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a264a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c933 expref: 93 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018877:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a265f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c933 expref: 92 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.018884:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.018886:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774985.018889:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:2.0:1785774985.018938:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:22403:x1872519648708608:12345-192.168.202.31@tcp:101:dd.0 Request processed in 616us (1113us total) trans 4294968693 rc 0/0 00000100:00100000:2.0:1785774985.018945:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24266 00000100:00100000:3.0:1785774985.022366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.022513:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648708864 00000100:00100000:0.0:1785774985.022522:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648708864 00000100:00100000:0.0:1785774985.022578:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5299 00000100:00100000:0.0:1785774985.022588:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:22403:x1872519648708864:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:0.0:1785774985.022796:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968694 00000100:00100000:0.0:1785774985.022906:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:22403:x1872519648708864:12345-192.168.202.31@tcp:35:dd.0 Request processed in 319us (547us total) trans 4294968695 rc 0/0 00000100:00100000:0.0:1785774985.022913:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5299 00000020:00080000:0.0:1785774985.022918:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774985.025818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.025900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648708992 00000100:00100000:3.0:1785774985.025907:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648708992 00000100:00100000:3.0:1785774985.025961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1537 00000100:00100000:3.0:1785774985.025969:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:2418:x1872519648708992:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774985.025983:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774985.026004:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a265f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c933 expref: 94 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774985.026020:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774985.026024:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774985.026067:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:2418:x1872519648708992:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774985.026088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1537 00000100:00100000:0.0:1785774985.035589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.035749:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648709120 00000100:00100000:2.0:1785774985.035759:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648709120 00002000:00100000:2.0:1785774985.035803:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (8192->16383) req@ffff9b773fb02a00 x1872519648709120/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.035813:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb02a00 with x1872519648709120 ext(8192->16383) 00002000:00010000:2.0:1785774985.035819:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb02a00 00000100:00100000:2.0:1785774985.035848:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 84 00000100:00100000:2.0:1785774985.035857:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648709120:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774985.036914:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648709120:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1056us (1331us total) trans 4294969986 rc 0/0 00000100:00100000:2.0:1785774985.036925:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 84 00002000:00100000:2.0:1785774985.036933:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (8192->16383) req@ffff9b773fb02a00 x1872519648709120/t4294969986(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.036948:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fb02a00 with x1872519648709120 ext(8192->16383) 00002000:00010000:2.0:1785774985.036952:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fb02a00 00000100:00100000:3.0:1785774985.040855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.040937:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648709248 00000100:00100000:0.0:1785774985.040946:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648709248 00000100:00100000:0.0:1785774985.041035:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5414 00000100:00100000:0.0:1785774985.041046:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648709248:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1785774985.042350:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969986 is committed 00000100:00100000:0.0:1785774985.042559:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648709248:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1513us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.042569:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5414 00000100:00100000:0.0:1785774985.055873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.055955:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648709504 00000100:00100000:3.0:1785774985.055964:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648709504 00000100:00100000:3.0:1785774985.056023:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24267 00000100:00100000:3.0:1785774985.056034:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:22404:x1872519648709504:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1785774985.056060:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774985.056880:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a266d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c93a expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.056997:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057011:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057024:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057039:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057046:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057055:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057574:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2682 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057587:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2682 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057595:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2682 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774985.057607:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 12288 00010000:00010000:2.0:1785774985.057688:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057696:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057702:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057708:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057714:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.057719:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057726:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057738:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b76032eea00) 00010000:00010000:2.0:1785774985.057741:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.057745:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057752:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2674 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057764:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057774:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057781:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057786:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.057789:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057795:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057802:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605fce100) 00010000:00010000:2.0:1785774985.057804:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.057807:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057812:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a267b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057854:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a266d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c93a expref: 96 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057871:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2682 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c93a expref: 95 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.057879:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.057881:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774985.057884:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:2.0:1785774985.057998:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:22404:x1872519648709504:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1966us (2133us total) trans 4294968696 rc 0/0 00000100:00100000:2.0:1785774985.058007:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24267 00000100:00100000:1.0:1785774985.067470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.067509:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.067576:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648709888 00000100:00100000:2.0:1785774985.067584:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648709888 00000100:00100000:2.0:1785774985.067644:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1538 00000100:00100000:2.0:1785774985.067652:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:2416:x1872519648709888:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774985.067669:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774985.067689:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a2682 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c93a expref: 95 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.067707:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.067710:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774985.067763:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:2416:x1872519648709888:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 112us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774985.067769:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1538 00000100:00100000:0.0:1785774985.067849:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648709760 00000100:00100000:0.0:1785774985.067853:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648709760 00000100:00100000:0.0:1785774985.067885:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5300 00000100:00100000:0.0:1785774985.067892:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+94:22404:x1872519648709760:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774985.068107:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:22404:x1872519648709760:12345-192.168.202.31@tcp:35:dd.0 Request processed in 215us (643us total) trans 4294968697 rc 0/0 00000100:00100000:0.0:1785774985.068114:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5300 00000100:00100000:2.0:1785774985.079302:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.079698:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648710016 00000100:00100000:3.0:1785774985.079708:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648710016 00002000:00100000:3.0:1785774985.079751:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (12288->20479) req@ffff9b771f711c00 x1872519648710016/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774985.079761:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f711c00 with x1872519648710016 ext(12288->20479) 00002000:00010000:3.0:1785774985.079766:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f711c00 00000100:00100000:3.0:1785774985.079832:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 85 00000100:00100000:3.0:1785774985.079840:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648710016:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774985.081035:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648710016:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1194us (1749us total) trans 4294969988 rc 0/0 00000100:00100000:3.0:1785774985.081044:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 85 00002000:00100000:3.0:1785774985.081053:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (12288->20479) req@ffff9b771f711c00 x1872519648710016/t4294969988(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774985.081060:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f711c00 with x1872519648710016 ext(12288->20479) 00002000:00010000:3.0:1785774985.081064:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f711c00 00000100:00100000:1.0:1785774985.084900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.085000:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648710144 00000100:00100000:0.0:1785774985.085010:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648710144 00000100:00100000:0.0:1785774985.085139:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5415 00000100:00100000:0.0:1785774985.085150:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648710144:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1785774985.086344:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969988 is committed 00000100:00100000:0.0:1785774985.086496:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648710144:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1347us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.086505:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5415 00000100:00100000:1.0:1785774985.096244:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.096417:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648710400 00000100:00100000:2.0:1785774985.096436:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648710400 00000100:00100000:2.0:1785774985.096490:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24268 00000100:00100000:2.0:1785774985.096500:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+95:22405:x1872519648710400:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774985.096529:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774985.096552:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2690 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c941 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096686:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096701:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096711:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096722:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096728:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096733:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096806:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a26a5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096813:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a26a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096819:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a26a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774985.096828:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 16384 00010000:00010000:2.0:1785774985.096892:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096902:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096907:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096913:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096918:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.096922:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096929:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096939:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7604f39300) 00010000:00010000:2.0:1785774985.096942:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.096946:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096952:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a2697 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096965:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096971:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096976:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096982:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.096985:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096991:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.096998:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7604f39500) 00010000:00010000:2.0:1785774985.097000:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.097004:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.097010:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a269e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.097048:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2690 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c941 expref: 98 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.097062:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a26a5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c941 expref: 97 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.097070:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.097384:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774985.097389:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:2.0:1785774985.097458:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:22405:x1872519648710400:12345-192.168.202.31@tcp:101:dd.0 Request processed in 959us (1222us total) trans 4294968698 rc 0/0 00000100:00100000:2.0:1785774985.097466:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24268 00000100:00100000:2.0:1785774985.102994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.103030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.103104:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648710656 00000100:00100000:3.0:1785774985.103112:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648710656 00000100:00100000:3.0:1785774985.103194:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5301 00000100:00100000:3.0:1785774985.103203:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:22405:x1872519648710656:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1785774985.103483:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:22405:x1872519648710656:12345-192.168.202.31@tcp:35:dd.0 Request processed in 280us (496us total) trans 4294968699 rc 0/0 00000100:00100000:3.0:1785774985.103492:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5301 00000100:00100000:0.0:1785774985.104184:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648710784 00000100:00100000:0.0:1785774985.104199:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648710784 00000100:00100000:0.0:1785774985.104241:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1539 00000100:00100000:0.0:1785774985.104248:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:2419:x1872519648710784:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774985.104259:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774985.104279:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a26a5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c941 expref: 98 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.104431:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.104437:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774985.104473:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:2419:x1872519648710784:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 226us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.104480:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1539 00000100:00100000:2.0:1785774985.114591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.114718:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648710912 00000100:00100000:3.0:1785774985.114727:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648710912 00002000:00100000:3.0:1785774985.114767:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (16384->24575) req@ffff9b7741916850 x1872519648710912/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774985.114776:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741916850 with x1872519648710912 ext(16384->24575) 00002000:00010000:3.0:1785774985.114781:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7741916850 00000100:00100000:3.0:1785774985.114810:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 86 00000100:00100000:3.0:1785774985.114817:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648710912:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774985.116587:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741916850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648710912:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1767us (2000us total) trans 4294969990 rc 0/0 00000100:00100000:3.0:1785774985.116597:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 86 00002000:00100000:3.0:1785774985.116606:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (16384->24575) req@ffff9b7741916850 x1872519648710912/t4294969990(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774985.116615:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741916850 with x1872519648710912 ext(16384->24575) 00002000:00010000:3.0:1785774985.116619:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7741916850 00000100:00100000:1.0:1785774985.120769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.120849:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648711040 00000100:00100000:0.0:1785774985.120858:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648711040 00000100:00100000:0.0:1785774985.120909:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5416 00000100:00100000:0.0:1785774985.120918:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648711040:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774985.122681:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969990 is committed 00000100:00100000:0.0:1785774985.122833:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648711040:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1913us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.122843:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5416 00000100:00100000:2.0:1785774985.132262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.132353:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648711296 00000100:00100000:1.0:1785774985.132363:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648711296 00000100:00100000:1.0:1785774985.132431:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24269 00000100:00100000:1.0:1785774985.132442:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:22406:x1872519648711296:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774985.132467:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774985.132493:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a26b3 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c948 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132600:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132614:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132627:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132638:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132645:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132652:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132696:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a26c8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132704:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a26c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132712:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a26c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774985.132720:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 20480 00010000:00010000:1.0:1785774985.132783:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132790:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132796:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132802:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.132806:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132812:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132823:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774985.132826:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.132829:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132835:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26ba lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132847:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132858:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132864:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132869:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.132872:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132878:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132884:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfec00) 00010000:00010000:1.0:1785774985.132887:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.132890:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132895:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26c1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132934:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a26b3 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c948 expref: 100 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132949:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a26c8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c948 expref: 99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.132957:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774985.132959:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774985.132962:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044800, rc 0) 00000100:00100000:1.0:1785774985.133028:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:22406:x1872519648711296:12345-192.168.202.31@tcp:101:dd.0 Request processed in 588us (775us total) trans 4294968700 rc 0/0 00000100:00100000:1.0:1785774985.133036:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24269 00000100:00100000:2.0:1785774985.140327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.140489:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648711424 00000100:00100000:0.0:1785774985.140499:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648711424 00000100:00100000:0.0:1785774985.140563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1540 00000100:00100000:0.0:1785774985.140572:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:2418:x1872519648711424:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774985.140586:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774985.140608:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a26c8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c948 expref: 99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.140626:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.140630:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774985.140684:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:2418:x1872519648711424:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 114us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.140691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1540 00000100:00100000:0.0:1785774985.141989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.142056:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648711680 00000100:00100000:2.0:1785774985.142061:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648711680 00000100:00100000:2.0:1785774985.142107:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5302 00000100:00100000:2.0:1785774985.142116:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:22406:x1872519648711680:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774985.142387:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:22406:x1872519648711680:12345-192.168.202.31@tcp:35:dd.0 Request processed in 272us (399us total) trans 4294968701 rc 0/0 00000100:00100000:2.0:1785774985.142394:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5302 00000100:00100000:1.0:1785774985.163277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.163503:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648711808 00000100:00100000:2.0:1785774985.163513:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648711808 00002000:00100000:2.0:1785774985.163558:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (20480->28671) req@ffff9b77012a9c00 x1872519648711808/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.163568:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b77012a9c00 with x1872519648711808 ext(20480->28671) 00002000:00010000:2.0:1785774985.163573:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b77012a9c00 00000100:00100000:2.0:1785774985.163603:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 87 00000100:00100000:2.0:1785774985.163610:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648711808:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774985.164800:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648711808:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1186us (1528us total) trans 4294969992 rc 0/0 00000100:00100000:2.0:1785774985.164810:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 87 00002000:00100000:2.0:1785774985.164818:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (20480->28671) req@ffff9b77012a9c00 x1872519648711808/t4294969992(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.164828:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b77012a9c00 with x1872519648711808 ext(20480->28671) 00002000:00010000:2.0:1785774985.164833:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b77012a9c00 00000100:00100000:0.0:1785774985.168124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.168337:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648711936 00000100:00100000:1.0:1785774985.168346:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648711936 00000100:00100000:1.0:1785774985.168394:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5417 00000100:00100000:1.0:1785774985.168403:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648711936:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1785774985.169794:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969992 is committed 00000100:00100000:1.0:1785774985.170036:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648711936:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1631us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774985.170044:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5417 00000100:00100000:0.0:1785774985.204726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.207229:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648712192 00000100:00100000:1.0:1785774985.207241:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648712192 00000100:00100000:1.0:1785774985.207543:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24270 00000100:00100000:1.0:1785774985.207554:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:22407:x1872519648712192:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774985.207577:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774985.207599:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26d6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c94f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207697:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207711:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207723:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207738:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207745:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207751:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207802:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a26eb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207811:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a26eb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207818:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a26eb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774985.207826:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 24576 00010000:00010000:1.0:1785774985.207901:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207908:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207914:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207920:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207926:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.207931:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207949:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207961:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774985.207964:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.207969:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207975:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a26dd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207989:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.207996:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208001:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208005:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.208008:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208012:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208018:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfec00) 00010000:00010000:1.0:1785774985.208020:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.208023:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208028:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a26e4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208064:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26d6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c94f expref: 102 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208096:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a26eb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c94f expref: 101 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.208104:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774985.208107:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774985.208109:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044000, rc 0) 00000100:00100000:1.0:1785774985.208203:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+101:22407:x1872519648712192:12345-192.168.202.31@tcp:101:dd.0 Request processed in 650us (3484us total) trans 4294968702 rc 0/0 00000100:00100000:1.0:1785774985.208210:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24270 00000100:00100000:2.0:1785774985.220674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.220720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.221000:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648712576 00000100:00100000:3.0:1785774985.221010:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648712576 00000100:00100000:3.0:1785774985.221090:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1541 00000100:00100000:3.0:1785774985.221102:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+101:2416:x1872519648712576:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774985.221117:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774985.221141:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a26eb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c94f expref: 101 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774985.221191:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774985.221197:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774985.221255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+100:2416:x1872519648712576:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 155us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774985.221263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1541 00000100:00100000:1.0:1785774985.222830:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648712448 00000100:00100000:1.0:1785774985.222837:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648712448 00000100:00100000:1.0:1785774985.222879:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5303 00000100:00100000:1.0:1785774985.222885:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+100:22407:x1872519648712448:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:1.0:1785774985.223237:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+101:22407:x1872519648712448:12345-192.168.202.31@tcp:35:dd.0 Request processed in 351us (2572us total) trans 4294968703 rc 0/0 00000100:00100000:1.0:1785774985.223246:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5303 00000100:00100000:2.0:1785774985.243025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.243208:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648712704 00000100:00100000:0.0:1785774985.243218:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648712704 00002000:00100000:0.0:1785774985.243263:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (24576->32767) req@ffff9b771f712a00 x1872519648712704/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774985.243273:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712a00 with x1872519648712704 ext(24576->32767) 00002000:00010000:0.0:1785774985.243278:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f712a00 00000100:00100000:0.0:1785774985.243315:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 88 00000100:00100000:0.0:1785774985.243324:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648712704:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774985.244472:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2418:x1872519648712704:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1144us (1451us total) trans 4294969994 rc 0/0 00000100:00100000:0.0:1785774985.244482:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 88 00002000:00100000:0.0:1785774985.244490:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (24576->32767) req@ffff9b771f712a00 x1872519648712704/t4294969994(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774985.244500:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f712a00 with x1872519648712704 ext(24576->32767) 00002000:00010000:0.0:1785774985.244505:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f712a00 00000100:00100000:0.0:1785774985.254244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.254314:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648712832 00000100:00100000:1.0:1785774985.254323:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648712832 00000100:00100000:1.0:1785774985.254378:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5418 00000100:00100000:1.0:1785774985.254387:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648712832:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1785774985.255918:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969994 is committed 00000100:00100000:1.0:1785774985.256077:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648712832:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1680us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774985.256087:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5418 00000100:00100000:2.0:1785774985.273658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.273743:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648713088 00000100:00100000:1.0:1785774985.273752:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648713088 00000100:00100000:1.0:1785774985.273844:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24271 00000100:00100000:1.0:1785774985.273853:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+101:22408:x1872519648713088:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774985.273877:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774985.273898:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26f9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c956 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274006:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274021:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274033:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274046:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274053:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274060:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274127:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a270e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274136:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a270e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274144:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a270e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774985.274153:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 28672 00010000:00010000:1.0:1785774985.274267:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274276:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274283:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274290:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274297:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.274301:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274310:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274322:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774985.274325:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.274330:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274337:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2700 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274350:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274357:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274363:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274368:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.274371:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274377:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274383:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfec00) 00010000:00010000:1.0:1785774985.274386:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.274388:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.274394:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2707 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.275323:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a26f9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c956 expref: 104 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.275354:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a270e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c956 expref: 103 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.275363:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774985.275366:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774985.275368:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044c00, rc 0) 00000100:00100000:1.0:1785774985.275500:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+103:22408:x1872519648713088:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1646us (1849us total) trans 4294968704 rc 0/0 00000100:00100000:1.0:1785774985.275508:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24271 00000100:00100000:3.0:1785774985.282665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.282749:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648713216 00000100:00100000:0.0:1785774985.282758:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648713216 00000100:00100000:0.0:1785774985.282817:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1542 00000100:00100000:0.0:1785774985.282826:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+103:2418:x1872519648713216:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774985.282840:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774985.282861:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a270e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c956 expref: 103 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.282879:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.282883:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774985.282945:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+102:2418:x1872519648713216:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.282953:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1542 00000100:00100000:3.0:1785774985.283941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.284031:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648713472 00000100:00100000:0.0:1785774985.284038:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648713472 00000100:00100000:0.0:1785774985.284082:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5304 00000100:00100000:0.0:1785774985.284090:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+102:22408:x1872519648713472:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774985.284372:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+103:22408:x1872519648713472:12345-192.168.202.31@tcp:35:dd.0 Request processed in 282us (432us total) trans 4294968705 rc 0/0 00000100:00100000:0.0:1785774985.284380:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5304 00000100:00100000:3.0:1785774985.306861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.306953:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648713600 00000100:00100000:2.0:1785774985.306963:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648713600 00002000:00100000:2.0:1785774985.307009:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (28672->36863) req@ffff9b772a314a80 x1872519648713600/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.307019:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314a80 with x1872519648713600 ext(28672->36863) 00002000:00010000:2.0:1785774985.307025:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a314a80 00000100:00100000:2.0:1785774985.307059:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 89 00000100:00100000:2.0:1785774985.307069:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648713600:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774985.308245:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648713600:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1174us (1390us total) trans 4294969996 rc 0/0 00000100:00100000:2.0:1785774985.308254:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 89 00002000:00100000:2.0:1785774985.308262:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (28672->36863) req@ffff9b772a314a80 x1872519648713600/t4294969996(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.308272:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314a80 with x1872519648713600 ext(28672->36863) 00002000:00010000:2.0:1785774985.308276:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a314a80 00000100:00100000:2.0:1785774985.314278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.314402:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648713728 00000100:00100000:3.0:1785774985.314411:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648713728 00000100:00100000:3.0:1785774985.314475:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5419 00000100:00100000:3.0:1785774985.314486:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648713728:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1785774985.316000:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969996 is committed 00000100:00100000:3.0:1785774985.316247:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648713728:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1762us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774985.316255:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5419 00000100:00100000:0.0:1785774985.336471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.336563:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648713984 00000100:00100000:1.0:1785774985.336573:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648713984 00000100:00100000:1.0:1785774985.336633:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24272 00000100:00100000:1.0:1785774985.336643:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+103:22409:x1872519648713984:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774985.336667:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774985.336688:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a271c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c95d expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336815:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336829:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336841:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336854:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336862:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336869:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336918:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2731 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336927:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2731 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.336935:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2731 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774985.336944:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 32768 00010000:00010000:1.0:1785774985.337017:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337025:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337031:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337038:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.337042:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337049:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337066:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774985.337070:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.337138:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337145:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2723 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337282:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337299:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337306:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337311:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.337315:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337321:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337329:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfec00) 00010000:00010000:1.0:1785774985.337332:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.337335:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337341:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a272a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337387:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a271c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c95d expref: 106 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337404:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2731 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c95d expref: 105 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.337411:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774985.337414:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774985.337416:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045200, rc 0) 00000100:00100000:1.0:1785774985.337490:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+105:22409:x1872519648713984:12345-192.168.202.31@tcp:101:dd.0 Request processed in 848us (1027us total) trans 4294968706 rc 0/0 00000100:00100000:1.0:1785774985.337497:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24272 00000100:00100000:1.0:1785774985.343099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.343247:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648714240 00000100:00100000:2.0:1785774985.343256:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648714240 00000100:00100000:2.0:1785774985.343313:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5305 00000100:00100000:2.0:1785774985.343323:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+105:22409:x1872519648714240:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774985.343587:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+106:22409:x1872519648714240:12345-192.168.202.31@tcp:35:dd.0 Request processed in 264us (493us total) trans 4294968707 rc 0/0 00000100:00100000:2.0:1785774985.343595:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5305 00000100:00100000:3.0:1785774985.344988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.345237:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648714368 00000100:00100000:2.0:1785774985.345243:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648714368 00000100:00100000:2.0:1785774985.345284:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1543 00000100:00100000:2.0:1785774985.345298:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+106:2418:x1872519648714368:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774985.345309:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774985.345330:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2731 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c95d expref: 106 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.345349:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.345353:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774985.345390:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+105:2418:x1872519648714368:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 93us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774985.345397:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1543 00000100:00100000:3.0:1785774985.365081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.365218:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648714496 00000100:00100000:2.0:1785774985.365228:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648714496 00002000:00100000:2.0:1785774985.365273:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (32768->40959) req@ffff9b772a315180 x1872519648714496/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.365283:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a315180 with x1872519648714496 ext(32768->40959) 00002000:00010000:2.0:1785774985.365298:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a315180 00000100:00100000:2.0:1785774985.365329:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 90 00000100:00100000:2.0:1785774985.365338:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648714496:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774985.366573:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648714496:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1232us (1508us total) trans 4294969998 rc 0/0 00000100:00100000:2.0:1785774985.366581:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 90 00002000:00100000:2.0:1785774985.366590:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (32768->40959) req@ffff9b772a315180 x1872519648714496/t4294969998(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.366598:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a315180 with x1872519648714496 ext(32768->40959) 00002000:00010000:2.0:1785774985.366602:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a315180 00000100:00100000:1.0:1785774985.374395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.374471:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648714624 00000100:00100000:0.0:1785774985.374481:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648714624 00000100:00100000:0.0:1785774985.374538:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5420 00000100:00100000:0.0:1785774985.374548:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648714624:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1785774985.376413:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969998 is committed 00000100:00100000:0.0:1785774985.376580:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648714624:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2031us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.376589:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5420 00000100:00100000:3.0:1785774985.401857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.401995:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648714880 00000100:00100000:2.0:1785774985.402005:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648714880 00000100:00100000:2.0:1785774985.402067:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24273 00000100:00100000:2.0:1785774985.402076:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+105:22410:x1872519648714880:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774985.402101:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774985.402122:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a273f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c964 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402257:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402270:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402280:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402291:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402300:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402305:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402349:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2754 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402356:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2754 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402362:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2754 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774985.402370:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 36864 00010000:00010000:2.0:1785774985.402455:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402462:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402467:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402472:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402476:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.402480:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402489:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402499:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5d00) 00010000:00010000:2.0:1785774985.402502:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.402505:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402511:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2746 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402523:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402530:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402536:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402541:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.402544:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402550:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402556:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b77199f5e00) 00010000:00010000:2.0:1785774985.402558:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.402561:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402571:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a274d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402605:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a273f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c964 expref: 108 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402617:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2754 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c964 expref: 107 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.402623:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.402625:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774985.402627:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:2.0:1785774985.402697:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+107:22410:x1872519648714880:12345-192.168.202.31@tcp:101:dd.0 Request processed in 622us (848us total) trans 4294968708 rc 0/0 00000100:00100000:2.0:1785774985.402703:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24273 00000100:00100000:1.0:1785774985.415571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.415713:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648715136 00000100:00100000:0.0:1785774985.415723:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648715136 00000100:00100000:0.0:1785774985.415779:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5306 00000100:00100000:0.0:1785774985.415788:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+107:22410:x1872519648715136:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774985.416073:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+108:22410:x1872519648715136:12345-192.168.202.31@tcp:35:dd.0 Request processed in 284us (511us total) trans 4294968709 rc 0/0 00000100:00100000:0.0:1785774985.416082:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5306 00000100:00100000:3.0:1785774985.417703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.417767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648715264 00000100:00100000:0.0:1785774985.417773:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648715264 00000100:00100000:0.0:1785774985.417816:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1544 00000100:00100000:0.0:1785774985.417824:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+108:2418:x1872519648715264:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774985.417836:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774985.417858:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2754 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c964 expref: 108 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.417882:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.417887:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774985.417921:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+107:2418:x1872519648715264:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.417927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1544 00000100:00100000:3.0:1785774985.427441:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.428206:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648715392 00000100:00100000:1.0:1785774985.428216:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648715392 00002000:00100000:1.0:1785774985.428263:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (36864->45055) req@ffff9b772a314e00 x1872519648715392/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774985.428275:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314e00 with x1872519648715392 ext(36864->45055) 00002000:00010000:1.0:1785774985.428281:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a314e00 00000100:00100000:1.0:1785774985.428361:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 91 00000100:00100000:1.0:1785774985.428370:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648715392:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:1.0:1785774985.430853:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648715392:12345-192.168.202.31@tcp:4:dd.0 Request processed in 2479us (3426us total) trans 4294970000 rc 0/0 00000100:00100000:1.0:1785774985.430867:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 91 00002000:00100000:1.0:1785774985.430876:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (36864->45055) req@ffff9b772a314e00 x1872519648715392/t4294970000(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774985.430885:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a314e00 with x1872519648715392 ext(36864->45055) 00002000:00010000:1.0:1785774985.430889:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a314e00 00000100:00100000:3.0:1785774985.434973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.436988:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648715520 00000100:00100000:0.0:1785774985.436997:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648715520 00000100:00100000:0.0:1785774985.437058:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5421 00000100:00100000:0.0:1785774985.437066:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648715520:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774985.441703:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970000 is committed 00000100:00100000:3.0:1785774985.450363:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648715520:12345-192.168.202.31@tcp:16:dd.0 Request processed in 13287us (15386us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774985.450375:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5421 00000100:00100000:3.0:1785774985.490092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.490197:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648715776 00000100:00100000:0.0:1785774985.490207:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648715776 00000100:00100000:0.0:1785774985.490268:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24274 00000100:00100000:0.0:1785774985.490277:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+107:22411:x1872519648715776:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774985.490300:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774985.490322:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a2762 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c96b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490432:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490452:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490463:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490479:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490485:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490490:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490536:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2777 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490543:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2777 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490548:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2777 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774985.490556:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 40960 00010000:00010000:0.0:1785774985.490627:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490633:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490639:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490644:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490648:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774985.490653:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490659:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490668:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfd200) 00010000:00010000:0.0:1785774985.490671:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774985.490674:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490679:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2769 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490689:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490695:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490700:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490703:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774985.490705:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490710:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490715:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfd000) 00010000:00010000:0.0:1785774985.490717:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774985.490719:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490724:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2770 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490757:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a2762 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c96b expref: 110 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490770:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2777 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c96b expref: 109 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.490775:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.490778:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774985.490780:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154600, rc 0) 00000100:00100000:0.0:1785774985.490837:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+109:22411:x1872519648715776:12345-192.168.202.31@tcp:101:dd.0 Request processed in 561us (753us total) trans 4294968710 rc 0/0 00000100:00100000:0.0:1785774985.490842:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24274 00000100:00100000:2.0:1785774985.499472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.499507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.499578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648715904 00000100:00100000:1.0:1785774985.499587:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648715904 00000100:00100000:1.0:1785774985.499656:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1545 00000100:00100000:1.0:1785774985.499666:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+109:2418:x1872519648715904:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774985.499680:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774985.499701:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2777 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c96b expref: 109 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.499717:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774985.499721:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774985.499775:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+108:2418:x1872519648715904:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774985.499781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1545 00000100:00100000:0.0:1785774985.501560:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648716160 00000100:00100000:0.0:1785774985.501566:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648716160 00000100:00100000:0.0:1785774985.501634:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5307 00000100:00100000:0.0:1785774985.501643:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+108:22411:x1872519648716160:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774985.501879:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+109:22411:x1872519648716160:12345-192.168.202.31@tcp:35:dd.0 Request processed in 237us (2370us total) trans 4294968711 rc 0/0 00000100:00100000:0.0:1785774985.501887:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5307 00000100:00100000:3.0:1785774985.526883:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.526960:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648716288 00000100:00100000:0.0:1785774985.526969:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648716288 00002000:00100000:0.0:1785774985.527011:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (40960->49151) req@ffff9b773fa83b80 x1872519648716288/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774985.527022:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa83b80 with x1872519648716288 ext(40960->49151) 00002000:00010000:0.0:1785774985.527027:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fa83b80 00000100:00100000:0.0:1785774985.527059:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 92 00000100:00100000:0.0:1785774985.527078:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648716288:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1785774985.528271:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648716288:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1201us (1392us total) trans 4294970002 rc 0/0 00000100:00100000:0.0:1785774985.528278:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 92 00002000:00100000:0.0:1785774985.528285:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (40960->49151) req@ffff9b773fa83b80 x1872519648716288/t4294970002(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774985.528294:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773fa83b80 with x1872519648716288 ext(40960->49151) 00002000:00010000:0.0:1785774985.528297:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b773fa83b80 00000100:00100000:3.0:1785774985.545482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.545609:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648716416 00000100:00100000:0.0:1785774985.545618:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648716416 00000100:00100000:0.0:1785774985.545686:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5422 00000100:00100000:0.0:1785774985.545696:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648716416:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774985.547037:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970002 is committed 00000100:00100000:0.0:1785774985.547583:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648716416:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1887us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.547592:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5422 00000100:00100000:3.0:1785774985.579578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.579764:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648716672 00000100:00100000:1.0:1785774985.579774:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648716672 00000100:00100000:1.0:1785774985.579836:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24275 00000100:00100000:1.0:1785774985.579846:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+109:22412:x1872519648716672:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774985.579871:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774985.579893:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2785 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c972 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580002:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580017:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580028:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580042:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580049:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580056:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580125:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a279a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580134:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a279a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580142:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a279a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774985.580151:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 45056 00010000:00010000:1.0:1785774985.580256:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580268:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580276:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580281:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.580285:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580292:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580305:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe600) 00010000:00010000:1.0:1785774985.580308:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.580312:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580318:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a278c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580332:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580338:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580343:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580348:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.580351:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580357:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580364:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfea00) 00010000:00010000:1.0:1785774985.580366:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.580369:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580373:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2793 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580417:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2785 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c972 expref: 112 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580452:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a279a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c972 expref: 111 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.580459:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774985.580461:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774985.580464:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045000, rc 0) 00000100:00100000:1.0:1785774985.580528:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774183ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+111:22412:x1872519648716672:12345-192.168.202.31@tcp:101:dd.0 Request processed in 684us (959us total) trans 4294968712 rc 0/0 00000100:00100000:1.0:1785774985.580534:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24275 00000100:00100000:3.0:1785774985.585492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.585565:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648716800 00000100:00100000:0.0:1785774985.585574:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648716800 00000100:00100000:0.0:1785774985.585633:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1546 00000100:00100000:0.0:1785774985.585642:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+111:2418:x1872519648716800:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774985.585657:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774985.585687:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a279a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c972 expref: 111 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.585706:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.585710:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774985.586127:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+110:2418:x1872519648716800:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 485us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.586135:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1546 00000100:00100000:1.0:1785774985.599263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.603180:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648717056 00000100:00100000:2.0:1785774985.603194:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648717056 00000100:00100000:2.0:1785774985.604143:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5308 00000100:00100000:2.0:1785774985.604155:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+110:22412:x1872519648717056:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774985.604474:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+111:22412:x1872519648717056:12345-192.168.202.31@tcp:35:dd.0 Request processed in 321us (5217us total) trans 4294968713 rc 0/0 00000100:00100000:2.0:1785774985.604483:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5308 00000100:00100000:1.0:1785774985.620024:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.620205:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648717184 00000100:00100000:2.0:1785774985.620214:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648717184 00002000:00100000:2.0:1785774985.620260:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (45056->53247) req@ffff9b7735946680 x1872519648717184/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.620270:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735946680 with x1872519648717184 ext(45056->53247) 00002000:00010000:2.0:1785774985.620275:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7735946680 00000100:00100000:2.0:1785774985.620310:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 93 00000100:00100000:2.0:1785774985.620318:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648717184:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774985.621551:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648717184:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1230us (1532us total) trans 4294970004 rc 0/0 00000100:00100000:2.0:1785774985.621560:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 93 00002000:00100000:2.0:1785774985.621568:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (45056->53247) req@ffff9b7735946680 x1872519648717184/t4294970004(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.621577:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735946680 with x1872519648717184 ext(45056->53247) 00002000:00010000:2.0:1785774985.621581:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7735946680 00000100:00100000:3.0:1785774985.640956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.641273:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648717312 00000100:00100000:1.0:1785774985.641334:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648717312 00000100:00100000:1.0:1785774985.641388:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5423 00000100:00100000:1.0:1785774985.641397:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648717312:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774985.642890:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970004 is committed 00000100:00100000:1.0:1785774985.643058:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648717312:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1661us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774985.643073:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5423 00000100:00100000:1.0:1785774985.679585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.679678:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648717568 00000100:00100000:2.0:1785774985.679685:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648717568 00000100:00100000:2.0:1785774985.679737:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24276 00000100:00100000:2.0:1785774985.679745:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+111:22413:x1872519648717568:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774985.679767:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774985.679788:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a27a8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c979 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679882:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679894:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679908:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679921:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679927:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679934:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679987:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a27bd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.679996:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a27bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680004:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a27bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774985.680013:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 49152 00010000:00010000:2.0:1785774985.680103:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680110:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680115:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680120:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680126:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.680129:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680135:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680147:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5d00) 00010000:00010000:2.0:1785774985.680149:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.680153:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680193:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a27af lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680207:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680213:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680218:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680222:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774985.680224:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680230:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680240:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b77199f5e00) 00010000:00010000:2.0:1785774985.680242:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774985.680244:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680249:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a27b6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680296:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a27a8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c979 expref: 114 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680313:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a27bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c979 expref: 113 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.680321:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.680323:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774985.680325:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:2.0:1785774985.680385:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+113:22413:x1872519648717568:12345-192.168.202.31@tcp:101:dd.0 Request processed in 640us (807us total) trans 4294968714 rc 0/0 00000100:00100000:2.0:1785774985.680392:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24276 00000100:00100000:3.0:1785774985.692575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.692683:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648717824 00000100:00100000:0.0:1785774985.692693:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648717824 00000100:00100000:0.0:1785774985.692746:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5309 00000100:00100000:0.0:1785774985.692755:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+113:22413:x1872519648717824:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774985.693080:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+114:22413:x1872519648717824:12345-192.168.202.31@tcp:35:dd.0 Request processed in 317us (505us total) trans 4294968715 rc 0/0 00000100:00100000:0.0:1785774985.693089:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5309 00000100:00100000:3.0:1785774985.700320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.702185:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648717952 00000100:00100000:0.0:1785774985.702196:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648717952 00000100:00100000:0.0:1785774985.702264:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1547 00000100:00100000:0.0:1785774985.702274:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+114:2416:x1872519648717952:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774985.702288:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774985.702310:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a27bd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c979 expref: 114 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.702331:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.702336:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774985.702390:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+113:2416:x1872519648717952:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 119us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.702397:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1547 00000100:00100000:3.0:1785774985.725304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.725528:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648718080 00000100:00100000:2.0:1785774985.725538:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648718080 00002000:00100000:2.0:1785774985.725588:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (49152->57343) req@ffff9b760471c380 x1872519648718080/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.725598:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471c380 with x1872519648718080 ext(49152->57343) 00002000:00010000:2.0:1785774985.725603:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471c380 00000100:00100000:2.0:1785774985.725632:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 94 00000100:00100000:2.0:1785774985.725641:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648718080:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774985.726732:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648718080:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1090us (1435us total) trans 4294970006 rc 0/0 00000100:00100000:2.0:1785774985.726740:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 94 00002000:00100000:2.0:1785774985.726748:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (49152->57343) req@ffff9b760471c380 x1872519648718080/t4294970006(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.726756:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471c380 with x1872519648718080 ext(49152->57343) 00002000:00010000:2.0:1785774985.726759:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471c380 00000100:00100000:3.0:1785774985.750787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.750927:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648718208 00000100:00100000:1.0:1785774985.750937:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648718208 00000100:00100000:1.0:1785774985.750999:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5424 00000100:00100000:1.0:1785774985.751009:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648718208:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774985.752592:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970006 is committed 00000100:00100000:1.0:1785774985.752811:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648718208:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1802us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774985.752819:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5424 00000100:00100000:3.0:1785774985.788927:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.789482:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648718464 00000100:00100000:0.0:1785774985.789491:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648718464 00000100:00100000:0.0:1785774985.789548:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24277 00000100:00100000:0.0:1785774985.789558:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+113:22414:x1872519648718464:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774985.789590:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774985.789611:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a27cb lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c980 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789712:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789726:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789735:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789746:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789753:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789759:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789803:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a27e0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789813:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a27e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789819:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a27e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774985.789827:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 53248 00010000:00010000:0.0:1785774985.789900:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789908:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789915:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789922:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789928:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774985.789931:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789938:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789949:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfd200) 00010000:00010000:0.0:1785774985.789952:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774985.789956:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789963:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a27d2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789976:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789983:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789989:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.789994:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774985.789997:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.790003:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.790010:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfd000) 00010000:00010000:0.0:1785774985.790012:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774985.790015:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.790021:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a27d9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.790872:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a27cb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c980 expref: 116 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.790891:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a27e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c980 expref: 115 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.790904:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.790907:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774985.790909:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155800, rc 0) 00000100:00100000:0.0:1785774985.791004:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+115:22414:x1872519648718464:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1447us (2084us total) trans 4294968716 rc 0/0 00000100:00100000:0.0:1785774985.791011:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24277 00000100:00100000:3.0:1785774985.801507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.812913:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648718592 00000100:00100000:2.0:1785774985.812928:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648718592 00000100:00100000:2.0:1785774985.813003:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1548 00000100:00100000:2.0:1785774985.813012:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+115:2419:x1872519648718592:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774985.813037:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774985.813060:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a27e0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c980 expref: 115 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774985.813091:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774985.813096:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774985.813175:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76056d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+114:2419:x1872519648718592:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 148us (11882us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774985.813183:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1548 00000100:00100000:3.0:1785774985.826489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.826677:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648718848 00000100:00100000:2.0:1785774985.826686:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648718848 00000100:00100000:2.0:1785774985.826739:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5310 00000100:00100000:2.0:1785774985.826747:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+114:22414:x1872519648718848:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774985.827001:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+115:22414:x1872519648718848:12345-192.168.202.31@tcp:35:dd.0 Request processed in 254us (520us total) trans 4294968717 rc 0/0 00000100:00100000:2.0:1785774985.827009:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5310 00000100:00100000:1.0:1785774985.844634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774985.844802:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648718976 00000100:00100000:2.0:1785774985.844811:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648718976 00002000:00100000:2.0:1785774985.844853:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (53248->61439) req@ffff9b7735947100 x1872519648718976/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.844864:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735947100 with x1872519648718976 ext(53248->61439) 00002000:00010000:2.0:1785774985.844869:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7735947100 00000100:00100000:2.0:1785774985.844904:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 95 00000100:00100000:2.0:1785774985.844912:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648718976:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774985.846337:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648718976:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1416us (1703us total) trans 4294970008 rc 0/0 00000100:00100000:2.0:1785774985.846350:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 95 00002000:00100000:2.0:1785774985.846361:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (53248->61439) req@ffff9b7735947100 x1872519648718976/t4294970008(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774985.846372:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7735947100 with x1872519648718976 ext(53248->61439) 00002000:00010000:2.0:1785774985.846378:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7735947100 00000100:00100000:3.0:1785774985.864482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.864701:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648719104 00000100:00100000:0.0:1785774985.864714:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648719104 00000100:00100000:0.0:1785774985.864792:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5425 00000100:00100000:0.0:1785774985.864803:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2418:x1872519648719104:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774985.867800:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970008 is committed 00000100:00100000:3.0:1785774985.869175:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648719104:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3468us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774985.869190:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5425 00000001:00080000:3.0:1785774985.896340:0:6508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984191 is committed 00000100:00100000:3.0:1785774985.905745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.906142:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648719360 00000100:00100000:1.0:1785774985.906151:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648719360 00000100:00100000:1.0:1785774985.906251:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24278 00000100:00100000:1.0:1785774985.906261:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+115:22415:x1872519648719360:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774985.906293:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774985.906317:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a27ee lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c987 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906433:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906455:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906467:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906480:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906487:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906494:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906545:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2803 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906568:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2803 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906576:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2803 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774985.906586:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 57344 00010000:00010000:1.0:1785774985.906654:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906663:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906669:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906676:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.906681:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906688:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906699:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774985.906703:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.906707:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906713:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a27f5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906725:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906731:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906738:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906743:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774985.906746:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906752:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906758:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfec00) 00010000:00010000:1.0:1785774985.906761:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774985.906764:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906770:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a27fc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906808:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a27ee lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c987 expref: 118 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906822:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2803 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c987 expref: 117 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774985.906830:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774985.906832:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774985.906834:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044000, rc 0) 00000100:00100000:1.0:1785774985.906890:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+117:22415:x1872519648719360:12345-192.168.202.31@tcp:101:dd.0 Request processed in 630us (1151us total) trans 4294968718 rc 0/0 00000100:00100000:1.0:1785774985.906897:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24278 00000100:00100000:1.0:1785774985.910836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.910904:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648719488 00000100:00100000:0.0:1785774985.910911:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648719488 00000100:00100000:0.0:1785774985.910963:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1549 00000100:00100000:0.0:1785774985.910971:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+117:2419:x1872519648719488:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774985.910984:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774985.911003:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a2803 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c987 expref: 117 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774985.911019:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774985.911023:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774985.911063:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f711880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+116:2419:x1872519648719488:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.911077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1549 00000100:00100000:3.0:1785774985.913661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774985.913767:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648719744 00000100:00100000:1.0:1785774985.913774:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648719744 00000100:00100000:1.0:1785774985.913814:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5311 00000100:00100000:1.0:1785774985.913822:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+116:22415:x1872519648719744:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:1.0:1785774985.914087:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+117:22415:x1872519648719744:12345-192.168.202.31@tcp:35:dd.0 Request processed in 266us (430us total) trans 4294968719 rc 0/0 00000100:00100000:1.0:1785774985.914095:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5311 00000100:00100000:1.0:1785774985.937635:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774985.937736:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648719872 00000100:00100000:3.0:1785774985.937754:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648719872 00002000:00100000:3.0:1785774985.937822:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (57344->65535) req@ffff9b771f710a80 x1872519648719872/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/0 e 0 to 0 dl 1785774996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774985.937835:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f710a80 with x1872519648719872 ext(57344->65535) 00002000:00010000:3.0:1785774985.937842:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f710a80 00000100:00100000:3.0:1785774985.937884:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 96 00000100:00100000:3.0:1785774985.937895:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648719872:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774985.940919:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2418:x1872519648719872:12345-192.168.202.31@tcp:4:dd.0 Request processed in 3017us (3283us total) trans 4294970010 rc 0/0 00000100:00100000:3.0:1785774985.940933:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 96 00002000:00100000:3.0:1785774985.940945:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (57344->65535) req@ffff9b771f710a80 x1872519648719872/t4294970010(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:676/0 lens 8680/448 e 0 to 0 dl 1785774996 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774985.940956:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b771f710a80 with x1872519648719872 ext(57344->65535) 00002000:00010000:3.0:1785774985.940962:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b771f710a80 00000100:00100000:3.0:1785774985.956950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774985.957114:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648720000 00000100:00100000:0.0:1785774985.957125:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648720000 00000100:00100000:0.0:1785774985.957221:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5426 00000100:00100000:0.0:1785774985.957231:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648720000:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774985.960951:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970010 is committed 00000100:00100000:0.0:1785774985.961217:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648720000:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3979us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774985.961231:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5426 00000100:00100000:1.0:1785774986.002614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.004213:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648720256 00000100:00100000:2.0:1785774986.004227:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648720256 00000100:00100000:2.0:1785774986.004308:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24279 00000100:00100000:2.0:1785774986.004320:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+117:22416:x1872519648720256:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774986.004351:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774986.004381:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2811 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c98e expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004796:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004815:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004829:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004843:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004851:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004858:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004922:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2826 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004933:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2826 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.004941:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2826 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774986.004951:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 61440 00010000:00010000:2.0:1785774986.005048:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005062:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005369:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005376:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005382:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774986.005388:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005589:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005604:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5d00) 00010000:00010000:2.0:1785774986.005608:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774986.005613:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005621:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2818 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005637:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005644:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005650:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005656:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774986.005659:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.005666:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.006137:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b77199f5e00) 00010000:00010000:2.0:1785774986.006140:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774986.006143:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.006150:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a281f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.006365:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2811 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c98e expref: 120 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.006385:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2826 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c98e expref: 119 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.006405:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774986.006407:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774986.006410:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:2.0:1785774986.006506:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+119:22416:x1872519648720256:12345-192.168.202.31@tcp:101:dd.0 Request processed in 2187us (3991us total) trans 4294968720 rc 0/0 00000100:00100000:2.0:1785774986.006515:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24279 00010000:00010000:0.0:1785774986.020327:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774986.022309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774986.022364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.022536:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648720640 00000100:00100000:2.0:1785774986.022550:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648720640 00000100:00100000:2.0:1785774986.022638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1550 00000100:00100000:2.0:1785774986.022652:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+119:2417:x1872519648720640:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774986.022685:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774986.022716:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2826 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c98e expref: 119 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.022740:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774986.022747:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774986.022822:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+118:2417:x1872519648720640:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 174us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774986.022831:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1550 00000100:00100000:0.0:1785774986.024516:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648720512 00000100:00100000:0.0:1785774986.024529:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648720512 00000100:00100000:0.0:1785774986.024601:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5312 00000100:00100000:0.0:1785774986.024610:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+118:22416:x1872519648720512:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774986.024877:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771f713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+119:22416:x1872519648720512:12345-192.168.202.31@tcp:35:dd.0 Request processed in 266us (2579us total) trans 4294968721 rc 0/0 00000100:00100000:0.0:1785774986.024885:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5312 00000100:00100000:1.0:1785774986.052275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.052592:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648720768 00000100:00100000:3.0:1785774986.052608:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648720768 00002000:00100000:3.0:1785774986.052691:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (61440->69631) req@ffff9b772a316300 x1872519648720768/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/0 e 0 to 0 dl 1785774997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774986.052704:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a316300 with x1872519648720768 ext(61440->69631) 00002000:00010000:3.0:1785774986.052713:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a316300 00000100:00100000:3.0:1785774986.052815:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 97 00000100:00100000:3.0:1785774986.052827:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648720768:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774986.055913:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648720768:12345-192.168.202.31@tcp:4:dd.0 Request processed in 3078us (3637us total) trans 4294970012 rc 0/0 00000100:00100000:3.0:1785774986.055927:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 97 00002000:00100000:3.0:1785774986.055941:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (61440->69631) req@ffff9b772a316300 x1872519648720768/t4294970012(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/448 e 0 to 0 dl 1785774997 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774986.055952:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b772a316300 with x1872519648720768 ext(61440->69631) 00002000:00010000:3.0:1785774986.055959:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b772a316300 00000100:00100000:1.0:1785774986.063011:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.063269:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648720896 00000100:00100000:3.0:1785774986.063282:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648720896 00000100:00100000:3.0:1785774986.063412:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5427 00000100:00100000:3.0:1785774986.063433:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648720896:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774986.067210:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970012 is committed 00000100:00100000:3.0:1785774986.067513:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648720896:12345-192.168.202.31@tcp:16:dd.0 Request processed in 4077us (4513us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774986.067532:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5427 00000100:00100000:1.0:1785774986.108333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.109236:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648721152 00000100:00100000:2.0:1785774986.109251:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648721152 00000100:00100000:2.0:1785774986.109330:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24280 00000100:00100000:2.0:1785774986.109342:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+119:22417:x1872519648721152:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774986.109374:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774986.109662:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2834 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c995 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109821:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109839:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109853:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109871:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109879:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109886:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109949:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2849 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109960:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2849 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.109968:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2849 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774986.109979:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 65536 00010000:00010000:0.0:1785774986.110646:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110657:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110663:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110679:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110686:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774986.110691:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110700:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110715:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5d00) 00010000:00010000:0.0:1785774986.110718:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774986.110724:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110730:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a283b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110747:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110753:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110760:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110765:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774986.110768:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110774:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110782:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b77199f5e00) 00010000:00010000:0.0:1785774986.110784:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774986.110787:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110798:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a2842 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110848:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2834 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c995 expref: 122 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110868:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2849 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c995 expref: 121 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.110875:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774986.110878:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774986.110880:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0000, rc 0) 00000100:00100000:0.0:1785774986.110962:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+121:22417:x1872519648721152:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1622us (2642us total) trans 4294968722 rc 0/0 00000100:00100000:0.0:1785774986.110971:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24280 00000100:00100000:1.0:1785774986.120971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774986.121074:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648721408 00000100:00100000:0.0:1785774986.121087:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648721408 00000100:00100000:0.0:1785774986.121184:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5313 00000100:00100000:0.0:1785774986.121204:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+121:22417:x1872519648721408:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:0.0:1785774986.121871:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968723 00000100:00100000:0.0:1785774986.121995:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+123:22417:x1872519648721408:12345-192.168.202.31@tcp:35:dd.0 Request processed in 794us (1037us total) trans 4294968724 rc 0/0 00000100:00100000:0.0:1785774986.122004:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5313 00000020:00080000:0.0:1785774986.122009:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774986.134142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.134640:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648721664 00000100:00100000:3.0:1785774986.134653:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648721664 00000100:00100000:3.0:1785774986.134750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1551 00000100:00100000:3.0:1785774986.134762:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+123:2419:x1872519648721664:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774986.134783:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774986.134815:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2849 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c995 expref: 123 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774986.134840:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774986.134846:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774986.134916:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+122:2419:x1872519648721664:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 156us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774986.134925:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1551 00000100:00100000:1.0:1785774986.146852:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.152154:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648721536 00000100:00100000:2.0:1785774986.152362:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648721536 00002000:00100000:2.0:1785774986.152629:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (65536->73727) req@ffff9b760605d500 x1872519648721536/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/0 e 0 to 0 dl 1785774997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774986.152643:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760605d500 with x1872519648721536 ext(65536->73727) 00002000:00010000:2.0:1785774986.152651:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760605d500 00000100:00100000:2.0:1785774986.153250:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 98 00000100:00100000:2.0:1785774986.153263:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648721536:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774986.157726:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648721536:12345-192.168.202.31@tcp:4:dd.0 Request processed in 4453us (10875us total) trans 4294970014 rc 0/0 00000100:00100000:2.0:1785774986.157745:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 98 00002000:00100000:2.0:1785774986.157761:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (65536->73727) req@ffff9b760605d500 x1872519648721536/t4294970014(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/448 e 0 to 0 dl 1785774997 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774986.157773:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760605d500 with x1872519648721536 ext(65536->73727) 00002000:00010000:2.0:1785774986.157781:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760605d500 00000100:00100000:1.0:1785774986.172139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774986.175155:0:14722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648721792 00000100:00100000:0.0:1785774986.175194:0:14722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648721792 00000100:00100000:0.0:1785774986.176642:0:14722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5428 00000100:00100000:0.0:1785774986.176661:0:14722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648721792:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774986.179604:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970014 is committed 00000100:00100000:0.0:1785774986.193624:0:14722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648721792:12345-192.168.202.31@tcp:16:dd.0 Request processed in 16954us (21483us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774986.193640:0:14722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5428 00000100:00100000:1.0:1785774986.230931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.231040:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648722048 00000100:00100000:2.0:1785774986.231053:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648722048 00000100:00100000:2.0:1785774986.231136:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24281 00000100:00100000:2.0:1785774986.231148:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+122:22418:x1872519648722048:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774986.231225:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774986.231260:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2857 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c99c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231632:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231650:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231674:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231689:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231697:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231708:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231774:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a286c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231785:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a286c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231793:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a286c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774986.231805:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 69632 00010000:00010000:2.0:1785774986.231901:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231911:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231918:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231926:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231932:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774986.231937:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231945:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231964:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5b00) 00010000:00010000:2.0:1785774986.231967:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774986.231972:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231980:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a285e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.231994:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232001:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232007:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232012:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774986.232015:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232021:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232028:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b77199f5800) 00010000:00010000:2.0:1785774986.232030:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774986.232033:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232039:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2865 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232093:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a2857 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c99c expref: 125 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232110:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a286c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c99c expref: 124 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.232118:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774986.232121:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774986.232123:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:2.0:1785774986.232253:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+124:22418:x1872519648722048:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1106us (1337us total) trans 4294968725 rc 0/0 00000100:00100000:2.0:1785774986.232262:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24281 00000100:00100000:1.0:1785774986.247657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774986.247705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.247810:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648722176 00000100:00100000:3.0:1785774986.247824:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648722176 00000100:00100000:3.0:1785774986.247908:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1552 00000100:00100000:3.0:1785774986.247928:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+124:2418:x1872519648722176:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774986.247950:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774986.247982:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a286c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c99c expref: 124 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774986.248015:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774986.248022:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774986.248105:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+123:2418:x1872519648722176:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 188us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774986.248114:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1552 00000100:00100000:2.0:1785774986.248766:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648722432 00000100:00100000:2.0:1785774986.248775:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648722432 00000100:00100000:2.0:1785774986.248830:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5314 00000100:00100000:2.0:1785774986.248840:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+123:22418:x1872519648722432:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774986.249854:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+124:22418:x1872519648722432:12345-192.168.202.31@tcp:35:dd.0 Request processed in 348us (1480us total) trans 4294968726 rc 0/0 00000100:00100000:2.0:1785774986.249867:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5314 00000100:00100000:1.0:1785774986.281722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.284941:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648722560 00000100:00100000:2.0:1785774986.284958:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648722560 00002000:00100000:2.0:1785774986.285040:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (69632->77823) req@ffff9b760605f800 x1872519648722560/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/0 e 0 to 0 dl 1785774997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774986.285052:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760605f800 with x1872519648722560 ext(69632->77823) 00002000:00010000:2.0:1785774986.285067:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760605f800 00000100:00100000:2.0:1785774986.285113:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 99 00000100:00100000:2.0:1785774986.285123:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648722560:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774986.287336:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648722560:12345-192.168.202.31@tcp:4:dd.0 Request processed in 2204us (5619us total) trans 4294970016 rc 0/0 00000100:00100000:2.0:1785774986.287349:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 99 00002000:00100000:2.0:1785774986.287362:0:22712:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc:0x0] (69632->77823) req@ffff9b760605f800 x1872519648722560/t4294970016(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/448 e 0 to 0 dl 1785774997 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774986.287373:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760605f800 with x1872519648722560 ext(69632->77823) 00002000:00010000:2.0:1785774986.287380:0:22712:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760605f800 00000100:00100000:1.0:1785774986.297769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774986.297913:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648722688 00000100:00100000:0.0:1785774986.297937:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648722688 00000100:00100000:0.0:1785774986.298012:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5429 00000100:00100000:0.0:1785774986.298024:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2418:x1872519648722688:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774986.311422:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970016 is committed 00000100:00100000:0.0:1785774986.314124:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648722688:12345-192.168.202.31@tcp:16:dd.0 Request processed in 16087us (16354us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774986.314142:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5429 00000100:00100000:0.0:1785774986.358130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774986.358254:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648722944 00000100:00100000:1.0:1785774986.358270:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648722944 00000100:00100000:1.0:1785774986.358348:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24282 00000100:00100000:1.0:1785774986.358359:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+124:22419:x1872519648722944:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774986.358387:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774986.358423:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a287a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9a3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358705:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358724:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358736:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358749:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358756:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358761:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358819:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a288f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358829:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a288f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358837:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a288f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774986.358846:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 73728 00010000:00010000:1.0:1785774986.358918:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358926:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358932:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358938:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358945:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774986.358949:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358956:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358968:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774986.358972:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774986.358976:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358982:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2881 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.358996:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359002:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359008:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359013:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774986.359016:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359026:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359034:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfec00) 00010000:00010000:1.0:1785774986.359036:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774986.359039:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359044:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2888 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359087:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a287a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9a3 expref: 127 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359103:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a288f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9a3 expref: 126 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.359112:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:1.0:1785774986.359115:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785774986.359117:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045200, rc 0) 00000100:00100000:1.0:1785774986.359261:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+126:22419:x1872519648722944:12345-192.168.202.31@tcp:101:dd.0 Request processed in 904us (1146us total) trans 4294968727 rc 0/0 00000100:00100000:1.0:1785774986.359270:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24282 00000100:00100000:0.0:1785774986.374586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.374675:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648723072 00000100:00100000:3.0:1785774986.374683:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648723072 00000100:00100000:3.0:1785774986.374745:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1553 00000100:00100000:3.0:1785774986.374753:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+126:2419:x1872519648723072:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774986.374768:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774986.374791:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a288f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9a3 expref: 126 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774986.374813:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774986.374817:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774986.374884:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+125:2419:x1872519648723072:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 132us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774986.374891:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1553 00000100:00100000:0.0:1785774986.376937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.377008:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648723328 00000100:00100000:3.0:1785774986.377018:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648723328 00000100:00100000:3.0:1785774986.377084:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5315 00000100:00100000:3.0:1785774986.377094:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+125:22419:x1872519648723328:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1785774986.377396:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+126:22419:x1872519648723328:12345-192.168.202.31@tcp:35:dd.0 Request processed in 303us (466us total) trans 4294968728 rc 0/0 00000100:00100000:3.0:1785774986.377406:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5315 00000100:00100000:1.0:1785774986.408516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.408758:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648723456 00000100:00100000:3.0:1785774986.408767:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648723456 00002000:00100000:3.0:1785774986.408810:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (73728->81919) req@ffff9b7603d7bb80 x1872519648723456/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/0 e 0 to 0 dl 1785774997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774986.408820:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603d7bb80 with x1872519648723456 ext(73728->81919) 00002000:00010000:3.0:1785774986.408826:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603d7bb80 00000100:00100000:3.0:1785774986.408857:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 100 00000100:00100000:3.0:1785774986.408865:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648723456:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774986.410319:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648723456:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1451us (1808us total) trans 4294970018 rc 0/0 00000100:00100000:3.0:1785774986.410329:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 100 00002000:00100000:3.0:1785774986.410337:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (73728->81919) req@ffff9b7603d7bb80 x1872519648723456/t4294970018(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/448 e 0 to 0 dl 1785774997 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774986.410346:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603d7bb80 with x1872519648723456 ext(73728->81919) 00002000:00010000:3.0:1785774986.410351:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603d7bb80 00000100:00100000:1.0:1785774986.418964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.419078:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648723584 00000100:00100000:2.0:1785774986.419088:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648723584 00000100:00100000:2.0:1785774986.419154:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5430 00000100:00100000:2.0:1785774986.419190:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648723584:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774986.424183:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970018 is committed 00000100:00100000:2.0:1785774986.425220:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648723584:12345-192.168.202.31@tcp:16:dd.0 Request processed in 6027us (6260us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774986.425233:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5430 00000100:00100000:0.0:1785774986.461316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.461456:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648723840 00000100:00100000:2.0:1785774986.461467:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648723840 00000100:00100000:2.0:1785774986.461527:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24283 00000100:00100000:2.0:1785774986.461536:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+126:22420:x1872519648723840:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1785774986.461561:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774986.461585:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a289d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9aa expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461703:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461718:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461730:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461743:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461751:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461758:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461815:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a28b2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461823:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a28b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461830:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a28b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774986.461838:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 77824 00010000:00010000:2.0:1785774986.461902:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461909:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461916:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461923:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461929:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774986.461933:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461942:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461954:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5b00) 00010000:00010000:2.0:1785774986.461957:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774986.461961:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461967:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a28a4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461981:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461987:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461993:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.461997:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774986.462000:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.462009:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.462015:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b77199f5800) 00010000:00010000:2.0:1785774986.462017:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774986.462019:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.462024:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ab lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.462074:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a289d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9aa expref: 129 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.462090:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a28b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9aa expref: 128 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.462098:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774986.462100:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785774986.462102:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0600, rc 0) 00000100:00100000:2.0:1785774986.462200:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+128:22420:x1872519648723840:12345-192.168.202.31@tcp:101:dd.0 Request processed in 665us (893us total) trans 4294968729 rc 0/0 00000100:00100000:2.0:1785774986.462207:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24283 00000100:00100000:1.0:1785774986.495505:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774986.495654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.501750:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648724224 00000100:00100000:2.0:1785774986.501763:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648724224 00000100:00100000:2.0:1785774986.502723:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5316 00000100:00100000:2.0:1785774986.502735:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+128:22420:x1872519648724224:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1785774986.503012:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+129:22420:x1872519648724224:12345-192.168.202.31@tcp:35:dd.0 Request processed in 279us (7356us total) trans 4294968730 rc 0/0 00000100:00100000:2.0:1785774986.503032:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5316 00000100:00100000:0.0:1785774986.503727:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648723968 00000100:00100000:0.0:1785774986.503734:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648723968 00000100:00100000:0.0:1785774986.503784:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1554 00000100:00100000:0.0:1785774986.503793:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+129:2418:x1872519648723968:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774986.503804:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774986.503826:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a28b2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9aa expref: 129 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.503843:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774986.503849:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774986.503879:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+128:2418:x1872519648723968:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 88us (8384us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774986.503886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1554 00000100:00100000:1.0:1785774986.533877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.534051:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648724352 00000100:00100000:3.0:1785774986.534071:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648724352 00002000:00100000:3.0:1785774986.534122:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (77824->86015) req@ffff9b7603d7a300 x1872519648724352/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/0 e 0 to 0 dl 1785774997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774986.534134:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603d7a300 with x1872519648724352 ext(77824->86015) 00002000:00010000:3.0:1785774986.534141:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603d7a300 00000100:00100000:3.0:1785774986.534207:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 101 00000100:00100000:3.0:1785774986.534217:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648724352:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774986.535906:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648724352:12345-192.168.202.31@tcp:4:dd.0 Request processed in 1685us (2033us total) trans 4294970020 rc 0/0 00000100:00100000:3.0:1785774986.535917:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 101 00002000:00100000:3.0:1785774986.535926:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (77824->86015) req@ffff9b7603d7a300 x1872519648724352/t4294970020(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/448 e 0 to 0 dl 1785774997 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785774986.535936:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603d7a300 with x1872519648724352 ext(77824->86015) 00002000:00010000:3.0:1785774986.535940:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7603d7a300 00000100:00100000:0.0:1785774986.564992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774986.565198:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648724480 00000100:00100000:3.0:1785774986.565207:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648724480 00000100:00100000:3.0:1785774986.565267:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5431 00000100:00100000:3.0:1785774986.565276:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648724480:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774986.566801:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970020 is committed 00000100:00100000:2.0:1785774986.584154:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648724480:12345-192.168.202.31@tcp:16:dd.0 Request processed in 18869us (19161us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774986.584181:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5431 00000100:00100000:1.0:1785774986.666257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774986.666343:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648724736 00000100:00100000:0.0:1785774986.666352:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648724736 00000100:00100000:0.0:1785774986.666423:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24284 00000100:00100000:0.0:1785774986.666433:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+128:22421:x1872519648724736:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774986.666458:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774986.666479:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a28c0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9b1 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666596:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666609:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666620:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666633:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666640:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666646:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666697:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a28d5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666707:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a28d5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666713:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a28d5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774986.666722:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 81920 00010000:00010000:0.0:1785774986.666795:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666803:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666810:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666816:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774986.666820:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666828:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666839:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b7605dfd900) 00010000:00010000:0.0:1785774986.666842:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774986.666846:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666856:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a28c7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666869:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666875:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666881:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666885:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774986.666888:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666893:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666912:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605dfda00) 00010000:00010000:0.0:1785774986.666914:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774986.666918:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666923:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a28ce lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666960:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a28c0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9b1 expref: 131 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666979:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a28d5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9b1 expref: 130 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774986.666986:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774986.666989:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774986.666991:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155600, rc 0) 00000100:00100000:0.0:1785774986.667307:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+130:22421:x1872519648724736:12345-192.168.202.31@tcp:101:dd.0 Request processed in 874us (1056us total) trans 4294968731 rc 0/0 00000100:00100000:0.0:1785774986.667315:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24284 00000100:00100000:1.0:1785774986.671875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774986.671996:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648724992 00000100:00100000:0.0:1785774986.672005:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648724992 00000100:00100000:0.0:1785774986.672156:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5317 00000100:00100000:0.0:1785774986.672192:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+130:22421:x1872519648724992:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1785774986.672457:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+131:22421:x1872519648724992:12345-192.168.202.31@tcp:35:dd.0 Request processed in 267us (590us total) trans 4294968732 rc 0/0 00000100:00100000:0.0:1785774986.672465:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5317 00000100:00100000:1.0:1785774986.678692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.678779:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648725120 00000100:00100000:2.0:1785774986.678788:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648725120 00000100:00100000:2.0:1785774986.678852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1555 00000100:00100000:2.0:1785774986.678862:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+131:2417:x1872519648725120:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785774986.678878:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774986.679472:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a28d5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9b1 expref: 131 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.679493:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774986.679497:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785774986.679545:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+130:2417:x1872519648725120:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 684us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774986.679612:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1555 00000100:00100000:1.0:1785774986.695328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.695519:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648725248 00000100:00100000:2.0:1785774986.695529:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648725248 00002000:00100000:2.0:1785774986.695589:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (81920->90111) req@ffff9b76044bce00 x1872519648725248/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/0 e 0 to 0 dl 1785774997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774986.695600:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bce00 with x1872519648725248 ext(81920->90111) 00002000:00010000:2.0:1785774986.695606:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044bce00 00000100:00100000:2.0:1785774986.695637:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 102 00000100:00100000:2.0:1785774986.695646:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648725248:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774986.698945:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648725248:12345-192.168.202.31@tcp:4:dd.0 Request processed in 3293us (3618us total) trans 4294970022 rc 0/0 00000100:00100000:2.0:1785774986.698957:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 102 00002000:00100000:2.0:1785774986.698968:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (81920->90111) req@ffff9b76044bce00 x1872519648725248/t4294970022(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:677/0 lens 8680/448 e 0 to 0 dl 1785774997 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774986.698978:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044bce00 with x1872519648725248 ext(81920->90111) 00002000:00010000:2.0:1785774986.698984:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044bce00 00000100:00100000:1.0:1785774986.711021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774986.713671:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648725376 00000100:00100000:0.0:1785774986.713684:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648725376 00000100:00100000:0.0:1785774986.713800:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5432 00000100:00100000:0.0:1785774986.713811:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648725376:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:1.0:1785774986.718428:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970022 is committed 00000100:00100000:0.0:1785774986.718650:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648725376:12345-192.168.202.31@tcp:16:dd.0 Request processed in 4836us (7632us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774986.718660:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5432 00000100:00100000:1.0:1785774986.913275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.913366:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648725504 00000100:00100000:2.0:1785774986.913376:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648725504 00000100:00100000:2.0:1785774986.913489:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24285 00000100:00100000:2.0:1785774986.913500:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+130:22428:x1872519648725504:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1785774986.913525:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774986.913548:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a28e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9b8 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.913625:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ea lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.913639:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.913651:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774986.913695:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000004:00200000:2.0:1785774986.913699:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774986.913718:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.913743:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a28e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9b8 expref: 132 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.913765:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ea lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9b8 expref: 131 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774986.913773:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:2.0:1785774986.913776:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785774986.913780:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:2.0:1785774986.913845:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+131:22428:x1872519648725504:12345-192.168.202.31@tcp:101:ls.0 Request processed in 347us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774986.913853:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24285 00000100:00100000:3.0:1785774986.917751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774986.935118:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648725632 00000100:00100000:1.0:1785774986.935133:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648725632 00000100:00100000:1.0:1785774986.935264:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24286 00000100:00100000:1.0:1785774986.935275:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+131:22428:x1872519648725632:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774986.935297:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774986.935319:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a28f1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.935354:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a28f8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.935368:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a28f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.935379:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a28f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.935504:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a28f1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9bf expref: 133 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.935524:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044000/0x7b7109e1d0a28f8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9bf expref: 132 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.935537:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:1.0:1785774986.935540:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774986.935543:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044000, rc 0) 00000100:00100000:1.0:1785774986.935602:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+132:22428:x1872519648725632:12345-192.168.202.31@tcp:101:ls.0 Request processed in 329us (17858us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774986.935609:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24286 00000100:00100000:0.0:1785774986.974684:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774986.980490:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648725888 00000100:00100000:1.0:1785774986.980504:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648725888 00000100:00100000:1.0:1785774986.980710:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24287 00000100:00100000:1.0:1785774986.980721:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+132:22428:x1872519648725888:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1785774986.980740:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774986.980761:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a28ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9c6 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774986.980852:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:1.0:1785774986.980945:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a28ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9c6 expref: 134 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.980958:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774986.980962:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774986.980967:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a28ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9c6 expref: 134 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774986.980985:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044600, rc 0) 00000100:00100000:1.0:1785774986.981053:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+133:22428:x1872519648725888:12345-192.168.202.31@tcp:101:ls.0 Request processed in 334us (6377us total) trans 4294968733 rc 301/301 00000100:00100000:1.0:1785774986.981061:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24287 00000100:00100000:1.0:1785774986.995122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774986.995458:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648726016 00000100:00100000:2.0:1785774986.995468:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648726016 00000100:00100000:2.0:1785774986.995533:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5318 00000100:00100000:2.0:1785774986.995542:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+133:22428:x1872519648726016:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:1.0:1785774987.011738:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+133:22428:x1872519648726016:12345-192.168.202.31@tcp:37:ls.0 Request processed in 16188us (16616us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.011753:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5318 00010000:00010000:2.0:1785774987.044696:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774987.060463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.060527:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648726144 00000100:00100000:0.0:1785774987.060537:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648726144 00000100:00100000:0.0:1785774987.060625:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4097 00000100:00100000:0.0:1785774987.060636:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a990050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+133:2416:x1872519648726144:12345-192.168.202.31@tcp:63:ll_sa.0 00010000:00010000:0.0:1785774987.060678:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774987.060698:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a290d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9cd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060751:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060764:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060775:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060790:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060797:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060804:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060870:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a2922 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060878:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a2922 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060888:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a2922 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774987.060932:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 86016 00000004:00200000:0.0:1785774987.060935:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1785774987.060968:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a2922 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060979:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a2922 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060987:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.060993:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061000:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061007:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774987.061011:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061030:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061041:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:0.0:1785774987.061045:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774987.061049:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061061:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2914 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061074:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061080:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061087:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061092:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1785774987.061095:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061102:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061109:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b7605f95e00) 00010000:00010000:0.0:1785774987.061112:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785774987.061115:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061122:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a291b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061148:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154a00/0x7b7109e1d0a290d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9cd expref: 135 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061207:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155200/0x7b7109e1d0a2922 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9cd expref: 134 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.061216:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:0.0:1785774987.061218:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785774987.061221:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155200, rc 0) 00000100:00100000:1.0:1785774987.061348:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a990050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+134:2416:x1872519648726144:12345-192.168.202.31@tcp:63:ll_sa.0 Request processed in 712us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.061365:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4097 00000100:00080000:2.0:1785774987.061700:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774987.120291:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.120461:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648726272 00000100:00100000:2.0:1785774987.120472:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648726272 00000100:00100000:2.0:1785774987.120538:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24288 00000100:00100000:2.0:1785774987.120558:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+134:22428:x1872519648726272:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1785774987.120579:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774987.120601:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2929 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9d4 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120666:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120681:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120692:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120707:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120714:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120721:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120768:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120777:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 135 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120786:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120816:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 135 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.120836:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 135 pid: 8469 timeout: 1328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774987.120851:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671388928:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774987.120948:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770383b840 going to sleep for 11 seconds 00000100:00100000:0.0:1785774987.131323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.132462:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648726528 00000100:00100000:1.0:1785774987.132472:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648726528 00000100:00100000:1.0:1785774987.132535:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5319 00000100:00100000:1.0:1785774987.132545:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+136:6199:x1872519648726528:12345-192.168.202.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785774987.132861:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+137:6199:x1872519648726528:12345-192.168.202.31@tcp:35:ldlm_bl.0 Request processed in 315us (1544us total) trans 4294968734 rc 0/0 00000100:00100000:1.0:1785774987.132869:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5319 00000100:00100000:2.0:1785774987.133050:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671388928:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774987.133077:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774987.137911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.138142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648726656 00000100:00100000:3.0:1785774987.138151:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648726656 00010000:00010000:3.0:1785774987.138208:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 137 pid: 8469 timeout: 1328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774987.138249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1681 00000100:00100000:3.0:1785774987.138257:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+137:2417:x1872519648726656:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774987.138279:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774987.138286:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 137 pid: 8469 timeout: 1328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.138299:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 137 pid: 8469 timeout: 1328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.138322:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a238e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1ae:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259c899 expref: 137 pid: 8469 timeout: 1328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.138337:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:3.0:1785774987.138342:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.138984:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.138996:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.139029:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774987.139089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+136:2417:x1872519648726656:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 832us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.139096:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1681 00010000:00010000:2.0:1785774987.139565:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139574:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774987.139627:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 90112 00000004:00200000:2.0:1785774987.139632:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774987.139652:0:8627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139665:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139676:0:8627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139683:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139693:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139699:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139704:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774987.139708:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139715:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139725:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:2.0:1785774987.139727:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774987.139731:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139737:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2930 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139749:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139754:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139760:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139764:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec1e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774987.139767:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139774:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139780:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x1a9514bb (ffff9b77199f5b00) 00010000:00010000:2.0:1785774987.139783:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774987.139785:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139791:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2937 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139821:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a2929 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9d4 expref: 136 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139835:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1000/0x7b7109e1d0a293e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9d4 expref: 135 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.139843:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9b7605f95400) 00010000:00010000:2.0:1785774987.139845:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774987.139848:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1000, rc 0) 00000100:00100000:2.0:1785774987.139883:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+135:22428:x1872519648726272:12345-192.168.202.31@tcp:101:ls.0 Request processed in 19337us (19601us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.139890:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24288 00000100:00100000:0.0:1785774987.295189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.295279:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648726912 00000100:00100000:1.0:1785774987.295288:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648726912 00000100:00100000:1.0:1785774987.295377:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5320 00000100:00100000:1.0:1785774987.295387:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7732ac5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+135:22428:x1872519648726912:12345-192.168.202.31@tcp:35:ls.0 00000100:00100000:1.0:1785774987.295626:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7732ac5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+136:22428:x1872519648726912:12345-192.168.202.31@tcp:35:ls.0 Request processed in 240us (470us total) trans 4294968735 rc 0/0 00000100:00100000:1.0:1785774987.295634:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5320 00000100:00100000:0.0:1785774987.430032:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671389440:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.430303:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774987.430415:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671389952:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.430443:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774987.430460:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671390464:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.430480:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774987.430502:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1785774987.430508:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671389312:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430635:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671389184:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430662:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774987.430681:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671389696:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430700:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774987.430714:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671390208:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430746:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774987.430764:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1785774987.430769:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671389056:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430795:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774987.430814:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671389568:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430832:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774987.430844:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671390080:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774987.430871:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671390592:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.430886:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774987.431263:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389952 00000100:00100000:3.0:1785774987.431272:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389952 00000100:00100000:3.0:1785774987.431328:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671390464 00000100:00100000:3.0:1785774987.431331:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671390464 00000100:00100000:3.0:1785774987.431348:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671390080 00000100:00100000:3.0:1785774987.431421:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671390080 00000100:00100000:3.0:1785774987.431442:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671390592 00000100:00100000:3.0:1785774987.431445:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671390592 00000100:00100000:3.0:1785774987.431466:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1785774987.431474:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671389952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.431524:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671389952:12345-0@lo:400:kworker.0 Request processed in 51us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.431532:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1785774987.432493:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774987.432520:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671389824:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.432633:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1785774987.432643:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671390464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.432679:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671390464:12345-0@lo:400:kworker.0 Request processed in 39us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.432685:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1785774987.432699:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1785774987.432705:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671390080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.432741:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671390080:12345-0@lo:400:kworker.0 Request processed in 37us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.432747:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1785774987.432757:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1785774987.432762:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671390592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.432784:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671390592:12345-0@lo:400:kworker.0 Request processed in 22us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.432788:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1785774987.432805:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389568 00000100:00100000:3.0:1785774987.432809:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389568 00000100:00100000:3.0:1785774987.432829:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389312 00000100:00100000:3.0:1785774987.432831:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389312 00000100:00100000:3.0:1785774987.432843:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:3.0:1785774987.432848:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671389568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.432872:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671389568:12345-0@lo:400:kworker.0 Request processed in 25us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.432877:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000100:00100000:3.0:1785774987.432885:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:3.0:1785774987.432890:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671389312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774987.433089:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389440 00000100:00100000:1.0:1785774987.433094:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389440 00000100:00100000:1.0:1785774987.433126:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389184 00000100:00100000:1.0:1785774987.433129:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389184 00000100:00100000:1.0:1785774987.433144:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389696 00000100:00100000:1.0:1785774987.433147:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389696 00000100:00100000:1.0:1785774987.433180:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671390208 00000100:00100000:1.0:1785774987.433183:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671390208 00000100:00100000:1.0:1785774987.433198:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1785774987.433204:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671389440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774987.433240:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671389440:12345-0@lo:400:kworker.0 Request processed in 36us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.433246:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1785774987.433258:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1785774987.433264:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671389184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774987.433292:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671389184:12345-0@lo:400:kworker.0 Request processed in 28us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.433297:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1785774987.433309:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1785774987.433314:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671389696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774987.433341:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671389696:12345-0@lo:400:kworker.0 Request processed in 27us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.433347:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1785774987.433372:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1785774987.433378:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671390208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774987.433417:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671390208:12345-0@lo:400:kworker.0 Request processed in 39us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.433423:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1785774987.433459:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389056 00000100:00100000:1.0:1785774987.433463:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389056 00000100:00100000:1.0:1785774987.433489:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1785774987.433495:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671389056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785774987.433524:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671389056:12345-0@lo:400:kworker.0 Request processed in 29us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.433530:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00080000:1.0:1785774987.433679:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785774987.433684:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785774987.433687:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785774987.434197:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774987.434216:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7604e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671390336:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.434242:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774987.434273:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671389440:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.434286:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671389952:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.434294:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671390464:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.434319:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671389824 00000100:00100000:0.0:1785774987.434322:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671389824 00000100:00080000:0.0:1785774987.434334:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774987.435270:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785774987.435283:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671390720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774987.435320:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774987.435363:0:7692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671390720 00000100:00100000:2.0:1785774987.435368:0:7692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671390720 00000100:00100000:2.0:1785774987.435398:0:7692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:2.0:1785774987.435416:0:7692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671390720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1785774987.435446:0:7692:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443889152 avail 1297649664 00000100:00100000:2.0:1785774987.435484:0:7692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:3653:x1872519671390720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.435491:0:7692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000100:00100000:2.0:1785774987.435520:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294984191 gen 2 00000004:00080000:2.0:1785774987.435526:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294984191 committed transno 4294984191 00000100:00100000:2.0:1785774987.435560:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671390720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774987.442240:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671390336 00000100:00100000:2.0:1785774987.442255:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671390336 00000100:00080000:2.0:1785774987.442307:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1785774987.442372:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1785774987.442382:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671389824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442543:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671389312:12345-0@lo:400:kworker.0 Request processed in 9649us (10048us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.442563:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:3.0:1785774987.442629:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671389056:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442644:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671389568:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442657:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671390080:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442669:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671390592:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442683:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671389184:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442694:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671389696:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442705:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671390208:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.442762:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1785774987.442770:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671390336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774987.452511:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1872519671389824:12345-0@lo:400:kworker.0 Request processed in 10120us (18303us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.452526:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1785774987.458272:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1872519671390336:12345-0@lo:400:kworker.0 Request processed in 15493us (24018us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.458287:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1785774987.466756:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671389312:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.466786:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1872519671389824:0@lo:400:kworker.0 00000100:00100000:0.0:1785774987.466798:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7604e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1872519671390336:0@lo:400:kworker.0 00000100:00100000:3.0:1785774987.467282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.467432:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648727168 00000100:00100000:1.0:1785774987.467441:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648727168 00000100:00100000:1.0:1785774987.468663:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24289 00000100:00100000:1.0:1785774987.468677:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+136:22206:x1872519648727168:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774987.468702:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774987.468705:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785774987.468734:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a28ea lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9b8 expref: 136 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.468753:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:1.0:1785774987.468758:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774987.468772:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2945 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.468874:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a294c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.468899:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a294c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.468920:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a294c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774987.468931:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 6 00010000:00010000:1.0:1785774987.469242:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2945 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9db expref: 138 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.469259:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a294c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9db expref: 137 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.469267:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:1.0:1785774987.469270:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774987.469273:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044c00, rc 0) 00000100:00100000:1.0:1785774987.469334:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+137:22206:x1872519648727168:12345-192.168.202.31@tcp:101:bash.0 Request processed in 662us (2054us total) trans 4294968736 rc 0/0 00000100:00100000:1.0:1785774987.469342:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24289 00000100:00100000:0.0:1785774987.475651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.475788:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648727296 00000100:00100000:3.0:1785774987.475797:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648727296 00000100:00100000:3.0:1785774987.475863:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1556 00000100:00100000:3.0:1785774987.475873:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+137:2416:x1872519648727296:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774987.475888:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774987.475930:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a294c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9db expref: 137 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.475959:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:3.0:1785774987.475963:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774987.476009:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+136:2416:x1872519648727296:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 139us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.476016:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1556 00000100:00100000:3.0:1785774987.479434:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.479696:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648727552 00000100:00100000:1.0:1785774987.479705:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648727552 00000100:00100000:1.0:1785774987.479757:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24290 00000100:00100000:1.0:1785774987.479766:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+136:22206:x1872519648727552:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774987.479814:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774987.479837:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a1d6e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c65b expref: 136 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.479855:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:1.0:1785774987.479860:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774987.480043:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.480220:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.480233:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774987.480277:0:21784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968737 00000004:00010000:1.0:1785774987.480302:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd65a9bb reply state 000000009f860d53 transno 4294968738 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.480313:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.480319:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:1.0:1785774987.480322:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774987.480324:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774987.480460:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+138:22206:x1872519648727552:12345-192.168.202.31@tcp:36:bash.0 Request processed in 694us (1032us total) trans 4294968738 rc 0/0 00000100:00100000:1.0:1785774987.480467:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24290 00000020:00080000:1.0:1785774987.480473:0:21784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774987.488314:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.495528:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648727680 00000100:00100000:2.0:1785774987.495542:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648727680 00000100:00100000:3.0:1785774987.495808:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24291 00000100:00100000:3.0:1785774987.495818:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+138:22206:x1872519648727680:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774987.495842:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774987.495862:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2961 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9e2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.496122:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2961 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9e2 expref: 139 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.496137:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf600/0x7b7109e1d0a2961 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9e2 expref: 139 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.496157:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:3.0:1785774987.496306:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785774987.496310:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf600, rc 0) 00000100:00100000:3.0:1785774987.497202:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+139:22206:x1872519648727680:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1382us (8894us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.497211:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24291 00000100:00100000:2.0:1785774987.524291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.530152:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648727808 00000100:00100000:1.0:1785774987.530178:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648727808 00002000:00010000:1.0:1785774987.530294:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2 (0->18446744073709551615) 00002000:00100000:1.0:1785774987.530300:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b3100 with x1872519648727808 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774987.530312:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b3100. 00000100:00100000:1.0:1785774987.530348:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 103 00000100:00100000:1.0:1785774987.530359:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648727808:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774987.530631:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774987.530635:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1785774986 00002000:00010000:1.0:1785774987.530638:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774987.530640:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1785774986 00002000:00010000:1.0:1785774987.530641:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774987.530711:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2418:x1872519648727808:12345-192.168.202.31@tcp:10:bash.0 Request processed in 354us (6429us total) trans 4294970023 rc 0/0 00000100:00100000:1.0:1785774987.530718:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 103 00002000:00010000:1.0:1785774987.530721:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2 (0->18446744073709551615) 00002000:00100000:1.0:1785774987.530724:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b3100 with x1872519648727808 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774987.530728:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b3100. 00000100:00080000:2.0:1785774987.540443:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774987.543278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.543365:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648727936 00000100:00100000:0.0:1785774987.543375:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648727936 00000100:00100000:0.0:1785774987.543435:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5433 00000100:00100000:0.0:1785774987.543444:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2419:x1872519648727936:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:1.0:1785774987.546255:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970023 is committed 00000100:00100000:0.0:1785774987.547294:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648727936:12345-192.168.202.31@tcp:16:bash.0 Request processed in 3847us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774987.547304:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5433 00000100:00100000:0.0:1785774987.556858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.562622:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648728192 00000100:00100000:1.0:1785774987.562636:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648728192 00000100:00100000:1.0:1785774987.562703:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5321 00000100:00100000:1.0:1785774987.562712:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+139:22206:x1872519648728192:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774987.562939:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+140:22206:x1872519648728192:12345-192.168.202.31@tcp:35:bash.0 Request processed in 227us (6088us total) trans 4294968739 rc 0/0 00000100:00100000:1.0:1785774987.562946:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5321 00000100:00100000:2.0:1785774987.575341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.575600:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648728320 00000100:00100000:1.0:1785774987.575608:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648728320 00000100:00100000:1.0:1785774987.575664:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24292 00000100:00100000:1.0:1785774987.575673:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+140:22206:x1872519648728320:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774987.575806:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+140:22206:x1872519648728320:12345-192.168.202.31@tcp:44:bash.0 Request processed in 134us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.575813:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24292 00000100:00100000:2.0:1785774987.586230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.586376:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648728448 00000100:00100000:1.0:1785774987.586385:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648728448 00000100:00100000:1.0:1785774987.586465:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24293 00000100:00100000:1.0:1785774987.586475:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22206:x1872519648728448:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774987.586496:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774987.586516:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9e9 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586579:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586594:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586606:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586619:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586626:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586632:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586700:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a297d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586707:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a297d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586714:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a297d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785774987.586736:0:21784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a297d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586748:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586755:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586760:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586766:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774987.586770:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586776:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586786:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605fda300) 00010000:00010000:1.0:1785774987.586789:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774987.586794:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586801:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045200/0x7b7109e1d0a296f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586814:0:21784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586819:0:21784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586825:0:21784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586828:0:21784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774987.586831:0:21784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586836:0:21784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586842:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9b7605dfe600) 00010000:00010000:1.0:1785774987.586844:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774987.586846:0:21784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586852:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044800/0x7b7109e1d0a2976 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586896:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9e9 expref: 18 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586909:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a297d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9e9 expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.586916:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5100) 00010000:00010000:1.0:1785774987.586918:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774987.586920:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045000, rc 0) 00000100:00100000:1.0:1785774987.586972:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22206:x1872519648728448:12345-192.168.202.31@tcp:101:bash.0 Request processed in 498us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.586982:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24293 00000100:00080000:2.0:1785774987.587483:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774987.595239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.595274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.595527:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648728704 00000100:00100000:3.0:1785774987.595537:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648728704 00000100:00100000:3.0:1785774987.595594:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1557 00000100:00100000:3.0:1785774987.595602:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648728704:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774987.595616:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774987.595639:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7742045000/0x7b7109e1d0a297d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9e9 expref: 17 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.595655:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77131b5100) 00010000:00010000:3.0:1785774987.595660:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774987.595714:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648728704:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.595721:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1557 00000100:00100000:2.0:1785774987.595895:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648728576 00000100:00100000:2.0:1785774987.595900:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648728576 00000100:00100000:2.0:1785774987.595935:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24294 00000100:00100000:2.0:1785774987.595941:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+140:22206:x1872519648728576:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774987.595955:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774987.595970:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2984 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9f0 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.596020:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a298b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.596034:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a298b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.596045:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a298b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774987.596090:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00000004:00200000:2.0:1785774987.596094:0:8627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1785774987.596126:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a2984 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9f0 expref: 142 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.596141:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0e00/0x7b7109e1d0a298b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9f0 expref: 141 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.596149:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:2.0:1785774987.596152:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1785774987.596155:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0e00, rc 0) 00000100:00100000:2.0:1785774987.596226:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+141:22206:x1872519648728576:12345-192.168.202.31@tcp:101:bash.0 Request processed in 285us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.596237:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24294 00000100:00100000:0.0:1785774987.610213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.610310:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648728960 00000100:00100000:1.0:1785774987.610319:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648728960 00000100:00100000:1.0:1785774987.610389:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24295 00000100:00100000:1.0:1785774987.610408:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+141:22206:x1872519648728960:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774987.610430:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774987.610452:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2992 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9f7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.610585:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2999 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.610599:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2999 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.610611:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2999 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774987.610622:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19b:0x0]: returning size 6 00010000:00010000:1.0:1785774987.610727:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2992 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9f7 expref: 144 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.610746:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2999 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9f7 expref: 143 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.610754:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:1.0:1785774987.610757:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774987.610761:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045200, rc 0) 00000100:00100000:1.0:1785774987.610824:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+143:22206:x1872519648728960:12345-192.168.202.31@tcp:101:bash.0 Request processed in 427us (669us total) trans 4294968740 rc 0/0 00000100:00100000:1.0:1785774987.610832:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24295 00000100:00100000:2.0:1785774987.616504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.616576:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648729216 00000100:00100000:1.0:1785774987.616585:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648729216 00000100:00100000:1.0:1785774987.616634:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24296 00000100:00100000:1.0:1785774987.616643:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+143:22206:x1872519648729216:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774987.616692:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1785774987.616716:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2999 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9f7 expref: 143 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.616737:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a1d91 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c662 expref: 142 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.616747:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:1.0:1785774987.616752:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774987.616892:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.616904:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.616913:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774987.616947:0:21784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968741 00000004:00010000:1.0:1785774987.616966:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b61ebbf reply state 00000000255fd35d transno 4294968742 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.616981:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.616988:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:1.0:1785774987.616990:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774987.616993:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774987.617072:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+144:22206:x1872519648729216:12345-192.168.202.31@tcp:36:bash.0 Request processed in 430us (575us total) trans 4294968742 rc 0/0 00000100:00100000:1.0:1785774987.617079:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24296 00000020:00080000:1.0:1785774987.617084:0:21784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774987.620871:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.620971:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648729344 00000100:00100000:2.0:1785774987.620988:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648729344 00000100:00100000:2.0:1785774987.621038:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24297 00000100:00100000:2.0:1785774987.621048:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+144:22206:x1872519648729344:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774987.621069:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774987.621086:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a29ae lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259c9fe expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.621145:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a29ae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9fe expref: 145 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.621191:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0200/0x7b7109e1d0a29ae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c9fe expref: 145 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.621210:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:2.0:1785774987.621213:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785774987.621217:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0200, rc 0) 00000100:00100000:2.0:1785774987.621270:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+145:22206:x1872519648729344:12345-192.168.202.31@tcp:101:bash.0 Request processed in 224us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.621277:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24297 00000100:00100000:0.0:1785774987.634823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.634906:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648729472 00000100:00100000:3.0:1785774987.634915:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648729472 00002000:00010000:3.0:1785774987.634970:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:3.0:1785774987.634975:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e00700 with x1872519648729472 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774987.634998:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604e00700. 00000100:00100000:3.0:1785774987.635037:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 104 00000100:00100000:3.0:1785774987.635047:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648729472:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:3.0:1785774987.635534:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785774987.635538:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1785774986 00002000:00010000:3.0:1785774987.635540:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785774987.635542:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1785774986 00002000:00010000:3.0:1785774987.635544:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1785774987.635821:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648729472:12345-192.168.202.31@tcp:10:bash.0 Request processed in 774us (1005us total) trans 4294969988 rc 0/0 00000100:00100000:3.0:1785774987.635830:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 104 00002000:00010000:3.0:1785774987.635834:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:3.0:1785774987.635837:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e00700 with x1872519648729472 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774987.635842:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604e00700. 00000100:00080000:2.0:1785774987.635914:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785774987.645272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.645371:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648729600 00000100:00100000:3.0:1785774987.645381:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648729600 00000100:00100000:3.0:1785774987.645453:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5434 00000100:00100000:3.0:1785774987.645464:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648729600:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:2.0:1785774987.647395:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969988 is committed 00000100:00100000:3.0:1785774987.647557:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648729600:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2092us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.647567:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5434 00000100:00100000:1.0:1785774987.659355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.659680:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648729856 00000100:00100000:0.0:1785774987.659690:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648729856 00000100:00100000:0.0:1785774987.659748:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5322 00000100:00100000:0.0:1785774987.659760:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+145:22206:x1872519648729856:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774987.661186:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+146:22206:x1872519648729856:12345-192.168.202.31@tcp:35:bash.0 Request processed in 222us (633us total) trans 4294968743 rc 0/0 00000100:00100000:0.0:1785774987.661198:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5322 00000100:00100000:0.0:1785774987.667144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.667313:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648729984 00000100:00100000:1.0:1785774987.667323:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648729984 00000100:00100000:2.0:1785774987.667410:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24298 00000100:00100000:2.0:1785774987.667424:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+146:22206:x1872519648729984:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:2.0:1785774987.667563:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+146:22206:x1872519648729984:12345-192.168.202.31@tcp:44:bash.0 Request processed in 142us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.667570:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24298 00000100:00100000:2.0:1785774987.675801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.676196:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648730240 00000100:00100000:1.0:1785774987.676207:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648730240 00000100:00100000:1.0:1785774987.676268:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24299 00000100:00100000:1.0:1785774987.676288:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+146:22206:x1872519648730240:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774987.676309:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774987.676333:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a29b5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca05 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.676454:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a29bc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.676470:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a29bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.676482:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a29bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774987.676498:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19c:0x0]: returning size 6 00010000:00010000:1.0:1785774987.676609:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a29b5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca05 expref: 149 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.676628:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a29bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca05 expref: 148 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.676638:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:1.0:1785774987.676641:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774987.676644:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045200, rc 0) 00000100:00100000:1.0:1785774987.676701:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+148:22206:x1872519648730240:12345-192.168.202.31@tcp:101:bash.0 Request processed in 417us (910us total) trans 4294968744 rc 0/0 00000100:00100000:1.0:1785774987.676708:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24299 00000100:00100000:1.0:1785774987.699240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.699383:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648730496 00000100:00100000:2.0:1785774987.699393:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648730496 00000100:00100000:2.0:1785774987.699465:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24300 00000100:00100000:2.0:1785774987.699475:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+148:22206:x1872519648730496:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:2.0:1785774987.699554:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1785774987.699581:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a29bc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca05 expref: 148 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.699606:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a1db4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c669 expref: 147 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.699617:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:2.0:1785774987.699621:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774987.699769:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.699782:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.699791:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774987.699825:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968745 00000004:00010000:2.0:1785774987.699843:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000411ae1d9 reply state 00000000e9649127 transno 4294968746 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.699855:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.699863:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:2.0:1785774987.699865:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774987.699868:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774987.699939:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+149:22206:x1872519648730496:12345-192.168.202.31@tcp:36:bash.0 Request processed in 465us (708us total) trans 4294968746 rc 0/0 00000100:00100000:2.0:1785774987.699947:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24300 00000020:00080000:2.0:1785774987.699952:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774987.711217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.711315:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648730624 00000100:00100000:2.0:1785774987.711324:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648730624 00000100:00100000:2.0:1785774987.711377:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24301 00000100:00100000:2.0:1785774987.711385:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+149:22206:x1872519648730624:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774987.711415:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774987.711436:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a29d1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca0c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.711489:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a29d1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca0c expref: 150 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.711504:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0400/0x7b7109e1d0a29d1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca0c expref: 150 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.711520:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:2.0:1785774987.711523:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785774987.711527:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0400, rc 0) 00000100:00100000:2.0:1785774987.711571:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+150:22206:x1872519648730624:12345-192.168.202.31@tcp:101:bash.0 Request processed in 187us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.711578:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24301 00000100:00100000:0.0:1785774987.721362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.721465:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648730752 00000100:00100000:1.0:1785774987.721475:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648730752 00002000:00010000:1.0:1785774987.721515:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1785774987.721520:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7bb80 with x1872519648730752 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774987.721532:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7741b7bb80. 00000100:00100000:1.0:1785774987.721566:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 105 00000100:00100000:1.0:1785774987.721576:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648730752:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774987.721806:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774987.721809:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785774986 00002000:00010000:1.0:1785774987.721811:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774987.721813:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1785774986 00002000:00010000:1.0:1785774987.721816:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774987.721871:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648730752:12345-192.168.202.31@tcp:10:bash.0 Request processed in 297us (519us total) trans 4294970024 rc 0/0 00000100:00100000:1.0:1785774987.721877:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 105 00002000:00010000:1.0:1785774987.721881:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1785774987.721883:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7bb80 with x1872519648730752 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774987.721887:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7741b7bb80. 00000100:00100000:1.0:1785774987.745774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.745888:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648730880 00000100:00100000:0.0:1785774987.745898:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648730880 00000100:00100000:0.0:1785774987.745946:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5435 00000100:00100000:0.0:1785774987.745954:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2419:x1872519648730880:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:1.0:1785774987.750223:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970024 is committed 00000100:00100000:0.0:1785774987.750466:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648730880:12345-192.168.202.31@tcp:16:bash.0 Request processed in 4509us (4698us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774987.750476:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5435 00000100:00100000:0.0:1785774987.753623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.753706:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648731136 00000100:00100000:3.0:1785774987.753716:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648731136 00000100:00100000:3.0:1785774987.753771:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5323 00000100:00100000:3.0:1785774987.753781:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+150:22206:x1872519648731136:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774987.754000:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+151:22206:x1872519648731136:12345-192.168.202.31@tcp:35:bash.0 Request processed in 220us (383us total) trans 4294968747 rc 0/0 00000100:00100000:3.0:1785774987.754008:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5323 00000100:00100000:2.0:1785774987.764447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.764544:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648731264 00000100:00100000:1.0:1785774987.764555:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648731264 00000100:00100000:1.0:1785774987.764616:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24302 00000100:00100000:1.0:1785774987.764625:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+151:22206:x1872519648731264:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774987.764816:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+151:22206:x1872519648731264:12345-192.168.202.31@tcp:44:bash.0 Request processed in 191us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.764825:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24302 00000100:00100000:2.0:1785774987.779440:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.784406:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648731520 00000100:00100000:3.0:1785774987.784422:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648731520 00000100:00100000:2.0:1785774987.792531:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24303 00000100:00100000:2.0:1785774987.792544:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+151:22206:x1872519648731520:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774987.792566:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774987.792586:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29d8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca13 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.792696:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.792710:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.792722:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774987.792734:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19d:0x0]: returning size 6 00010000:00010000:2.0:1785774987.792834:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29d8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 154 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.792849:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 153 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.792858:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:2.0:1785774987.792861:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774987.792865:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0800, rc 0) 00000100:00100000:2.0:1785774987.792936:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+153:22206:x1872519648731520:12345-192.168.202.31@tcp:101:bash.0 Request processed in 394us (13505us total) trans 4294968748 rc 0/0 00000100:00100000:2.0:1785774987.792943:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24303 00000100:00100000:1.0:1785774987.812337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.813232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.813358:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648731904 00000100:00100000:2.0:1785774987.813368:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648731904 00000100:00100000:2.0:1785774987.813427:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24304 00000100:00100000:2.0:1785774987.813436:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+153:22206:x1872519648731904:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:2.0:1785774987.813488:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774987.813514:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e9200/0x7b7109e1d0a1dd7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c670 expref: 153 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.813533:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:2.0:1785774987.813538:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774987.813679:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.813692:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 153 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.813702:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 4/0,1 mode: --/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.813729:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 153 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.813741:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 153 pid: 8627 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774987.813757:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671390848:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774987.813836:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770383b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785774987.814218:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648731648 00000100:00100000:3.0:1785774987.814223:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648731648 00010000:00010000:3.0:1785774987.814246:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 154 pid: 8627 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774987.814279:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1682 00000100:00100000:3.0:1785774987.814287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77110d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+154:2419:x1872519648731648:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774987.814297:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774987.814302:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 154 pid: 8627 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.814312:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 154 pid: 8627 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.814328:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:3.0:1785774987.814332:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.814338:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.814502:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.814517:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774987.814551:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77110d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+154:2419:x1872519648731648:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 265us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774987.814558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1682 00010000:00010000:2.0:1785774987.817532:0:6529:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@0000000072cff9d8 x1872519671390848) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 1/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 153 pid: 8627 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.817552:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29df lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca13 expref: 153 pid: 8627 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774987.817566:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6529:1872519671390848:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774987.817590:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:2.0:1785774987.817597:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.817606:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.817612:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774987.817696:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968749 00000004:00010000:2.0:1785774987.817742:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e13c25e4 reply state 00000000593792b0 transno 4294968750 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.817757:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.817765:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:2.0:1785774987.817768:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774987.817771:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774987.817865:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+154:22206:x1872519648731904:12345-192.168.202.31@tcp:36:bash.0 Request processed in 4429us (4633us total) trans 4294968750 rc 0/0 00000100:00100000:2.0:1785774987.817875:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24304 00000020:00080000:2.0:1785774987.817880:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774987.825271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.825446:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648732032 00000100:00100000:2.0:1785774987.825455:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648732032 00000100:00100000:2.0:1785774987.825511:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24305 00000100:00100000:2.0:1785774987.825520:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731e15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+154:22206:x1872519648732032:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774987.825543:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774987.825561:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29f4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca1a expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.825613:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29f4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca1a expref: 155 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.825626:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0800/0x7b7109e1d0a29f4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca1a expref: 155 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.825641:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:2.0:1785774987.825644:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785774987.825646:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec0800, rc 0) 00000100:00100000:2.0:1785774987.825697:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731e15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+155:22206:x1872519648732032:12345-192.168.202.31@tcp:101:bash.0 Request processed in 178us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.825703:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24305 00000100:00100000:1.0:1785774987.837681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.837765:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648732160 00000100:00100000:0.0:1785774987.837775:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648732160 00002000:00010000:0.0:1785774987.837813:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00002000:00100000:0.0:1785774987.837817:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff05c00 with x1872519648732160 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774987.837828:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773ff05c00. 00000100:00100000:0.0:1785774987.837862:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 106 00000100:00100000:0.0:1785774987.837871:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648732160:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:0.0:1785774987.838289:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785774987.838293:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785774986 00002000:00010000:0.0:1785774987.838295:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1785774987.838298:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1785774986 00002000:00010000:0.0:1785774987.838300:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1785774987.838464:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648732160:12345-192.168.202.31@tcp:10:bash.0 Request processed in 593us (791us total) trans 4294969989 rc 0/0 00000100:00100000:0.0:1785774987.838471:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 106 00002000:00010000:0.0:1785774987.838475:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00002000:00100000:0.0:1785774987.838477:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff05c00 with x1872519648732160 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774987.838482:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773ff05c00. 00000100:00100000:1.0:1785774987.845598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.845715:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648732288 00000100:00100000:2.0:1785774987.845725:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648732288 00000100:00100000:2.0:1785774987.845825:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5436 00000100:00100000:2.0:1785774987.845835:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648732288:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774987.852204:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969989 is committed 00000100:00100000:2.0:1785774987.852394:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648732288:12345-192.168.202.31@tcp:16:bash.0 Request processed in 6555us (6797us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.852416:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5436 00000100:00100000:1.0:1785774987.859520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.859620:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648732544 00000100:00100000:0.0:1785774987.859630:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648732544 00000100:00100000:0.0:1785774987.859684:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5324 00000100:00100000:0.0:1785774987.859693:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+155:22206:x1872519648732544:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774987.859893:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+156:22206:x1872519648732544:12345-192.168.202.31@tcp:35:bash.0 Request processed in 200us (381us total) trans 4294968751 rc 0/0 00000100:00100000:0.0:1785774987.859900:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5324 00000100:00100000:3.0:1785774987.872289:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.873317:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648732672 00000100:00100000:2.0:1785774987.873327:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648732672 00000100:00100000:2.0:1785774987.873391:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24306 00000100:00100000:2.0:1785774987.873408:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+156:22206:x1872519648732672:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:2.0:1785774987.873537:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+156:22206:x1872519648732672:12345-192.168.202.31@tcp:44:bash.0 Request processed in 138us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.873543:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24306 00000100:00100000:1.0:1785774987.880610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.881215:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648732928 00000100:00100000:0.0:1785774987.881225:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648732928 00000100:00100000:0.0:1785774987.881280:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24307 00000100:00100000:0.0:1785774987.881288:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+156:22206:x1872519648732928:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774987.881307:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774987.881328:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a29fb lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca21 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.881582:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2a02 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.881596:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2a02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.881608:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2a02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774987.881617:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19e:0x0]: returning size 6 00010000:00010000:0.0:1785774987.881710:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a29fb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca21 expref: 159 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.881725:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2a02 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca21 expref: 158 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.881732:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:0.0:1785774987.881735:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774987.881737:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155000, rc 0) 00000100:00100000:0.0:1785774987.884498:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+158:22206:x1872519648732928:12345-192.168.202.31@tcp:101:bash.0 Request processed in 3201us (3887us total) trans 4294968752 rc 0/0 00000100:00100000:0.0:1785774987.884508:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24307 00000100:00100000:1.0:1785774987.904609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774987.904697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648733056 00000100:00100000:0.0:1785774987.904706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648733056 00000100:00100000:0.0:1785774987.904764:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1558 00000100:00100000:0.0:1785774987.904773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+158:2419:x1872519648733056:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774987.904788:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774987.904810:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2a02 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca21 expref: 158 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.904828:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:0.0:1785774987.904832:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774987.904885:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+157:2419:x1872519648733056:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 114us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774987.904893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1558 00000100:00100000:2.0:1785774987.909311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.909345:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.909496:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648733440 00000100:00100000:3.0:1785774987.909504:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648733440 00000100:00100000:3.0:1785774987.909554:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24308 00000100:00100000:3.0:1785774987.909562:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+157:22206:x1872519648733440:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:3.0:1785774987.909613:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774987.909636:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745000/0x7b7109e1d0a1dfa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c677 expref: 157 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.909653:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:3.0:1785774987.909658:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774987.909805:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.909819:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.909828:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774987.909863:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968753 00000004:00010000:3.0:1785774987.909878:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076fd169d reply state 00000000cae728d0 transno 4294968754 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.909889:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.909896:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:3.0:1785774987.909898:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774987.909900:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774987.909981:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+159:22206:x1872519648733440:12345-192.168.202.31@tcp:36:bash.0 Request processed in 419us (633us total) trans 4294968754 rc 0/0 00000100:00100000:3.0:1785774987.909989:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24308 00000020:00080000:3.0:1785774987.909995:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774987.911191:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648733184 00000100:00100000:1.0:1785774987.911198:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648733184 00000100:00100000:1.0:1785774987.911241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 623 00000100:00100000:1.0:1785774987.911252:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648733184:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1785774987.911292:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648733184:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 42us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.911299:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 623 00000100:00100000:1.0:1785774987.917231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.918349:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648733568 00000100:00100000:2.0:1785774987.918359:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648733568 00000100:00100000:2.0:1785774987.918421:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24309 00000100:00100000:2.0:1785774987.918431:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+159:22206:x1872519648733568:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774987.918454:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774987.918474:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2a17 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca28 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.918533:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2a17 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca28 expref: 160 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.918547:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1e00/0x7b7109e1d0a2a17 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca28 expref: 160 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774987.918566:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:2.0:1785774987.918569:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785774987.918573:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1e00, rc 0) 00000100:00100000:2.0:1785774987.918633:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+160:22206:x1872519648733568:12345-192.168.202.31@tcp:101:bash.0 Request processed in 204us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.918640:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24309 00000100:00100000:0.0:1785774987.931474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.931686:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648733696 00000100:00100000:1.0:1785774987.931698:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648733696 00002000:00010000:1.0:1785774987.931741:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:1.0:1785774987.931746:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7a300 with x1872519648733696 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774987.931757:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7741b7a300. 00000100:00100000:1.0:1785774987.931794:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 107 00000100:00100000:1.0:1785774987.931804:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648733696:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774987.932054:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774987.932058:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785774986 00002000:00010000:1.0:1785774987.932060:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774987.932062:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1785774986 00002000:00010000:1.0:1785774987.932065:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774987.932251:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648733696:12345-192.168.202.31@tcp:10:bash.0 Request processed in 447us (784us total) trans 4294970025 rc 0/0 00000100:00100000:1.0:1785774987.932259:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 107 00002000:00010000:1.0:1785774987.932263:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:1.0:1785774987.932265:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7a300 with x1872519648733696 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774987.932270:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7741b7a300. 00000100:00100000:1.0:1785774987.944303:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.944460:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648733824 00000100:00100000:2.0:1785774987.944470:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648733824 00000100:00100000:2.0:1785774987.944531:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5437 00000100:00100000:2.0:1785774987.944541:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648733824:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774987.947282:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970025 is committed 00000100:00100000:2.0:1785774987.947450:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648733824:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2908us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.947460:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5437 00000100:00100000:3.0:1785774987.950625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.950750:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648734080 00000100:00100000:1.0:1785774987.950759:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648734080 00000100:00100000:1.0:1785774987.950811:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5325 00000100:00100000:1.0:1785774987.950819:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+160:22206:x1872519648734080:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774987.951022:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+161:22206:x1872519648734080:12345-192.168.202.31@tcp:35:bash.0 Request processed in 203us (403us total) trans 4294968755 rc 0/0 00000100:00100000:1.0:1785774987.951030:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5325 00000100:00100000:0.0:1785774987.959263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.959441:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648734208 00000100:00100000:2.0:1785774987.959451:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648734208 00000100:00100000:2.0:1785774987.959518:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24310 00000100:00100000:2.0:1785774987.959531:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+161:22206:x1872519648734208:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:2.0:1785774987.959711:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+161:22206:x1872519648734208:12345-192.168.202.31@tcp:44:bash.0 Request processed in 182us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774987.959721:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24310 00000100:00100000:2.0:1785774987.962881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.962973:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648734464 00000100:00100000:3.0:1785774987.962981:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648734464 00000100:00100000:3.0:1785774987.963034:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24311 00000100:00100000:3.0:1785774987.963045:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+161:22206:x1872519648734464:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774987.963064:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774987.963085:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a1e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca2f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.963240:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.963255:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.963266:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774987.963277:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19f:0x0]: returning size 6 00010000:00010000:0.0:1785774987.963699:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a1e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 164 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.963723:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 163 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.963734:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:0.0:1785774987.963737:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774987.963741:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce800, rc 0) 00000100:00100000:0.0:1785774987.963802:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+163:22206:x1872519648734464:12345-192.168.202.31@tcp:101:bash.0 Request processed in 759us (928us total) trans 4294968756 rc 0/0 00000100:00100000:0.0:1785774987.963809:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24311 00000100:00100000:3.0:1785774987.970628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774987.973857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774987.974090:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648734848 00000100:00100000:3.0:1785774987.974100:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648734848 00000100:00100000:3.0:1785774987.974201:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24312 00000100:00100000:3.0:1785774987.974213:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+163:22206:x1872519648734848:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:3.0:1785774987.974281:0:8627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774987.974311:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a1e1d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c67e expref: 163 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.974330:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:3.0:1785774987.974334:0:8627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774987.974513:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.974528:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 163 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.974537:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 4/0,1 mode: --/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.974571:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 163 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774987.974584:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 163 pid: 6530 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774987.974597:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671390976:192.168.202.31@tcp:104: 00000100:00100000:3.0:1785774987.974672:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7605da5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1785774987.976293:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648734592 00000100:00100000:0.0:1785774987.976303:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648734592 00010000:00010000:0.0:1785774987.976335:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 164 pid: 6530 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774987.976524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1683 00000100:00100000:0.0:1785774987.976533:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+164:2419:x1872519648734592:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774987.976545:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774987.976552:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 164 pid: 6530 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.976571:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 164 pid: 6530 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.976590:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:0.0:1785774987.976595:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.976604:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.976611:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.976626:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774987.976671:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+164:2419:x1872519648734592:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 138us (6052us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774987.976679:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1683 00010000:00010000:0.0:1785774987.987414:0:8627:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@000000007890f0a1 x1872519671390976) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 163 pid: 6530 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.987439:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2a25 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca2f expref: 163 pid: 6530 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774987.987457:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671390976:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774987.987478:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:0.0:1785774987.987486:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.987497:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.987502:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774987.987594:0:8627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968757 00000004:00010000:0.0:1785774987.987644:0:8627:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022823ea7 reply state 000000009fae93b4 transno 4294968758 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.987660:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774987.987668:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:0.0:1785774987.987670:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774987.987673:0:8627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774987.987773:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+164:22206:x1872519648734848:12345-192.168.202.31@tcp:36:bash.0 Request processed in 13562us (13922us total) trans 4294968758 rc 0/0 00000100:00100000:0.0:1785774987.987782:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24312 00000020:00080000:0.0:1785774987.987787:0:8627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774987.994393:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774987.995366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648734976 00000100:00100000:1.0:1785774987.995376:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648734976 00000100:00100000:1.0:1785774987.995459:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24313 00000100:00100000:1.0:1785774987.995468:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+164:22206:x1872519648734976:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774987.995490:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774987.995509:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a2a3a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca36 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.995559:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a2a3a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca36 expref: 165 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.995572:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044c00/0x7b7109e1d0a2a3a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca36 expref: 165 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774987.995588:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:1.0:1785774987.995591:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785774987.995594:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044c00, rc 0) 00000100:00100000:1.0:1785774987.995646:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+165:22206:x1872519648734976:12345-192.168.202.31@tcp:101:bash.0 Request processed in 179us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774987.995653:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24313 00000100:00100000:1.0:1785774988.012733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.013069:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648735104 00000100:00100000:3.0:1785774988.013079:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648735104 00002000:00010000:3.0:1785774988.013128:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:3.0:1785774988.013133:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff04000 with x1872519648735104 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774988.013146:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773ff04000. 00000100:00100000:3.0:1785774988.013217:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 108 00000100:00100000:3.0:1785774988.013229:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648735104:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:3.0:1785774988.013502:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785774988.013506:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785774986 00002000:00010000:3.0:1785774988.013508:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785774988.013510:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1785774986 00002000:00010000:3.0:1785774988.013512:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1785774988.013582:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648735104:12345-192.168.202.31@tcp:10:bash.0 Request processed in 355us (858us total) trans 4294969990 rc 0/0 00000100:00100000:3.0:1785774988.013589:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 108 00002000:00010000:3.0:1785774988.013593:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:3.0:1785774988.013596:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b773ff04000 with x1872519648735104 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774988.013601:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b773ff04000. 00000100:00100000:3.0:1785774988.026475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.026892:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648735232 00000100:00100000:2.0:1785774988.026902:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648735232 00000100:00100000:2.0:1785774988.026969:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5438 00000100:00100000:2.0:1785774988.026978:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648735232:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:2.0:1785774988.032475:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969990 is committed 00000100:00100000:0.0:1785774988.044667:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648735232:12345-192.168.202.31@tcp:16:bash.0 Request processed in 17679us (18191us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.044682:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5438 00000100:00100000:2.0:1785774988.048326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.048436:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648735488 00000100:00100000:3.0:1785774988.048445:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648735488 00000100:00100000:3.0:1785774988.048496:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5326 00000100:00100000:3.0:1785774988.048505:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77013bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+165:22206:x1872519648735488:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774988.048706:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77013bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+166:22206:x1872519648735488:12345-192.168.202.31@tcp:35:bash.0 Request processed in 200us (388us total) trans 4294968759 rc 0/0 00000100:00100000:3.0:1785774988.048714:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5326 00000100:00100000:1.0:1785774988.053753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.053826:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648735616 00000100:00100000:0.0:1785774988.053835:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648735616 00000100:00100000:0.0:1785774988.053891:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24314 00000100:00100000:0.0:1785774988.053900:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+166:22206:x1872519648735616:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:0.0:1785774988.054034:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+166:22206:x1872519648735616:12345-192.168.202.31@tcp:44:bash.0 Request processed in 134us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.054042:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24314 00000100:00100000:0.0:1785774988.062078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.062199:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648735872 00000100:00100000:1.0:1785774988.062208:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648735872 00000100:00100000:1.0:1785774988.062256:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24315 00000100:00100000:1.0:1785774988.062265:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+166:22206:x1872519648735872:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774988.062284:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774988.062305:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a41 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca3d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.062419:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2a48 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.062434:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2a48 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.062446:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2a48 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774988.062458:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a0:0x0]: returning size 6 00010000:00010000:1.0:1785774988.062565:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a41 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca3d expref: 169 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.062584:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2a48 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca3d expref: 168 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.062593:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774988.062596:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774988.062600:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045200, rc 0) 00000100:00100000:1.0:1785774988.062658:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+168:22206:x1872519648735872:12345-192.168.202.31@tcp:101:bash.0 Request processed in 394us (589us total) trans 4294968760 rc 0/0 00000100:00100000:1.0:1785774988.062666:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24315 00010000:00010000:0.0:1785774988.068352:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774988.074438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.074567:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648736000 00000100:00100000:3.0:1785774988.074576:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648736000 00000100:00100000:3.0:1785774988.074634:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1559 00000100:00100000:3.0:1785774988.074644:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+168:2419:x1872519648736000:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774988.074658:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774988.074680:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2a48 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca3d expref: 168 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.074700:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:3.0:1785774988.074704:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774988.074758:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+167:2419:x1872519648736000:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 115us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774988.074765:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1559 00000100:00100000:2.0:1785774988.077643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.077716:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648736256 00000100:00100000:1.0:1785774988.077724:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648736256 00000100:00100000:1.0:1785774988.077772:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24316 00000100:00100000:1.0:1785774988.077785:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+167:22206:x1872519648736256:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774988.077840:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774988.077861:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8c00/0x7b7109e1d0a1e40 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c685 expref: 167 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.077878:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774988.077883:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774988.078039:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.078064:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.078073:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774988.078114:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968761 00000004:00010000:1.0:1785774988.078139:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de28c14e reply state 000000003d72bc9d transno 4294968762 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.078151:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.078196:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774988.078200:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774988.078202:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774988.078271:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+169:22206:x1872519648736256:12345-192.168.202.31@tcp:36:bash.0 Request processed in 486us (633us total) trans 4294968762 rc 0/0 00000100:00100000:1.0:1785774988.078278:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24316 00000020:00080000:1.0:1785774988.078282:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785774988.085231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.085316:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648736384 00000100:00100000:0.0:1785774988.085326:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648736384 00000100:00100000:0.0:1785774988.085386:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24317 00000100:00100000:0.0:1785774988.085407:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+169:22206:x1872519648736384:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774988.085432:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774988.085452:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2a5d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca44 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.085506:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2a5d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca44 expref: 170 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.085521:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154400/0x7b7109e1d0a2a5d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca44 expref: 170 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.085541:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:0.0:1785774988.085544:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785774988.085548:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154400, rc 0) 00000100:00100000:0.0:1785774988.085610:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+170:22206:x1872519648736384:12345-192.168.202.31@tcp:101:bash.0 Request processed in 214us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.085617:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24317 00000100:00100000:2.0:1785774988.118287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.118465:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648736512 00000100:00100000:3.0:1785774988.118475:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648736512 00002000:00010000:3.0:1785774988.118520:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1785774988.118525:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c94380 with x1872519648736512 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774988.118539:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c94380. 00000100:00100000:3.0:1785774988.118575:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 109 00000100:00100000:3.0:1785774988.118585:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648736512:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:3.0:1785774988.118866:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785774988.118870:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785774987 00002000:00010000:3.0:1785774988.118872:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785774988.118874:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1785774987 00002000:00010000:3.0:1785774988.118877:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1785774988.118942:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2418:x1872519648736512:12345-192.168.202.31@tcp:10:bash.0 Request processed in 358us (663us total) trans 4294970026 rc 0/0 00000100:00100000:3.0:1785774988.118950:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 109 00002000:00010000:3.0:1785774988.118954:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1785774988.118957:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c94380 with x1872519648736512 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774988.118962:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c94380. 00000100:00100000:1.0:1785774988.132494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.132587:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648736640 00000100:00100000:0.0:1785774988.132596:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648736640 00000100:00100000:0.0:1785774988.132657:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5439 00000100:00100000:0.0:1785774988.132667:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2419:x1872519648736640:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:1.0:1785774988.135945:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970026 is committed 00000100:00100000:0.0:1785774988.136199:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648736640:12345-192.168.202.31@tcp:16:bash.0 Request processed in 3528us (3711us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.136211:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5439 00000100:00100000:0.0:1785774988.163919:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.165207:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648736896 00000100:00100000:1.0:1785774988.165217:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648736896 00000100:00100000:1.0:1785774988.165352:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5327 00000100:00100000:1.0:1785774988.165362:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+170:22206:x1872519648736896:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774988.167471:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+171:22206:x1872519648736896:12345-192.168.202.31@tcp:35:bash.0 Request processed in 2107us (3557us total) trans 4294968763 rc 0/0 00000100:00100000:1.0:1785774988.167479:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5327 00000100:00100000:2.0:1785774988.176296:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.176436:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648737024 00000100:00100000:1.0:1785774988.176447:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648737024 00000100:00100000:1.0:1785774988.176509:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24318 00000100:00100000:1.0:1785774988.176520:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+171:22206:x1872519648737024:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774988.176662:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+171:22206:x1872519648737024:12345-192.168.202.31@tcp:44:bash.0 Request processed in 143us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.176669:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24318 00000100:00100000:2.0:1785774988.186115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.186468:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648737280 00000100:00100000:1.0:1785774988.186478:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648737280 00000100:00100000:1.0:1785774988.186534:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24319 00000100:00100000:1.0:1785774988.186542:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+171:22206:x1872519648737280:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774988.186564:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774988.186585:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2a64 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca4b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.186693:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2a6b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.186708:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2a6b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.186722:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2a6b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774988.186734:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 6 00010000:00010000:1.0:1785774988.186839:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2a64 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca4b expref: 174 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.186859:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2a6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca4b expref: 173 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.186868:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:1.0:1785774988.186871:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774988.186875:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045000, rc 0) 00000100:00100000:1.0:1785774988.186937:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+173:22206:x1872519648737280:12345-192.168.202.31@tcp:101:bash.0 Request processed in 395us (841us total) trans 4294968764 rc 0/0 00000100:00100000:1.0:1785774988.186943:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24319 00000100:00100000:2.0:1785774988.203203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.203370:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648737408 00000100:00100000:3.0:1785774988.203380:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648737408 00000100:00100000:3.0:1785774988.203444:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1560 00000100:00100000:3.0:1785774988.203453:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+173:2418:x1872519648737408:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774988.203470:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774988.203492:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2a6b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca4b expref: 173 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.203510:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:3.0:1785774988.203515:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774988.203563:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+172:2418:x1872519648737408:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 111us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774988.203573:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1560 00000100:00100000:2.0:1785774988.221381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.221560:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648737664 00000100:00100000:0.0:1785774988.221569:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648737664 00000100:00100000:0.0:1785774988.221623:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24320 00000100:00100000:0.0:1785774988.221632:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+172:22206:x1872519648737664:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:0.0:1785774988.221685:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774988.221710:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745600/0x7b7109e1d0a1e63 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c68c expref: 172 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.221728:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:0.0:1785774988.221733:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774988.221881:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.221894:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.221904:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774988.221947:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968765 00000004:00010000:0.0:1785774988.221969:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ffd2692 reply state 00000000f923859e transno 4294968766 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.221981:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.221987:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:0.0:1785774988.221990:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774988.221992:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774988.222580:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+174:22206:x1872519648737664:12345-192.168.202.31@tcp:36:bash.0 Request processed in 947us (1208us total) trans 4294968766 rc 0/0 00000100:00100000:0.0:1785774988.222587:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24320 00000020:00080000:0.0:1785774988.222591:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774988.251141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.258359:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648737792 00000100:00100000:1.0:1785774988.258374:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648737792 00000100:00100000:2.0:1785774988.258574:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24321 00000100:00100000:2.0:1785774988.258585:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+174:22206:x1872519648737792:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774988.258609:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774988.258629:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a2a80 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca52 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.258679:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a2a80 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca52 expref: 175 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.258692:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec1800/0x7b7109e1d0a2a80 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca52 expref: 175 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.258707:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:2.0:1785774988.258709:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785774988.258713:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7605ec1800, rc 0) 00000100:00100000:2.0:1785774988.258775:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+175:22206:x1872519648737792:12345-192.168.202.31@tcp:101:bash.0 Request processed in 192us (7642us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.258782:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24321 00000100:00100000:3.0:1785774988.265601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.265766:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648737920 00000100:00100000:0.0:1785774988.265776:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648737920 00002000:00010000:0.0:1785774988.265811:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/5 (0->18446744073709551615) 00002000:00100000:0.0:1785774988.265815:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d880 with x1872519648737920 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774988.265826:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d880. 00000100:00100000:0.0:1785774988.265860:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 110 00000100:00100000:0.0:1785774988.265869:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2418:x1872519648737920:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:0.0:1785774988.266117:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785774988.266121:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785774987 00002000:00010000:0.0:1785774988.266123:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1785774988.266125:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1785774987 00002000:00010000:0.0:1785774988.266127:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1785774988.266215:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648737920:12345-192.168.202.31@tcp:10:bash.0 Request processed in 347us (623us total) trans 4294969991 rc 0/0 00000100:00100000:0.0:1785774988.266222:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 110 00002000:00010000:0.0:1785774988.266225:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/5 (0->18446744073709551615) 00002000:00100000:0.0:1785774988.266228:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d880 with x1872519648737920 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774988.266232:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d880. 00000100:00100000:1.0:1785774988.276087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.277011:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648738048 00000100:00100000:3.0:1785774988.277020:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648738048 00000100:00100000:3.0:1785774988.277081:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5440 00000100:00100000:3.0:1785774988.277089:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648738048:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:2.0:1785774988.281252:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969991 is committed 00000100:00100000:3.0:1785774988.281548:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648738048:12345-192.168.202.31@tcp:16:bash.0 Request processed in 4454us (5465us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774988.281558:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5440 00000100:00100000:1.0:1785774988.287536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.287629:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648738304 00000100:00100000:0.0:1785774988.287639:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648738304 00000100:00100000:0.0:1785774988.287696:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5328 00000100:00100000:0.0:1785774988.287706:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+175:22206:x1872519648738304:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774988.287922:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+176:22206:x1872519648738304:12345-192.168.202.31@tcp:35:bash.0 Request processed in 216us (392us total) trans 4294968767 rc 0/0 00000100:00100000:0.0:1785774988.287930:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5328 00000100:00100000:2.0:1785774988.300496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.300594:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648738432 00000100:00100000:1.0:1785774988.300603:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648738432 00000100:00100000:1.0:1785774988.300656:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24322 00000100:00100000:1.0:1785774988.300665:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+176:22206:x1872519648738432:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774988.300820:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+176:22206:x1872519648738432:12345-192.168.202.31@tcp:44:bash.0 Request processed in 156us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.300827:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24322 00000100:00100000:1.0:1785774988.318615:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.318736:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648738688 00000100:00100000:2.0:1785774988.318746:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648738688 00000100:00100000:2.0:1785774988.318820:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24323 00000100:00100000:2.0:1785774988.318829:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+176:22206:x1872519648738688:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774988.318847:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774988.318869:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2a87 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca59 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.318987:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7c00/0x7b7109e1d0a2a8e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.319000:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7c00/0x7b7109e1d0a2a8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.319011:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7c00/0x7b7109e1d0a2a8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774988.319023:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a2:0x0]: returning size 6 00010000:00010000:2.0:1785774988.319139:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0000/0x7b7109e1d0a2a87 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca59 expref: 179 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.319195:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7c00/0x7b7109e1d0a2a8e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca59 expref: 178 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.319208:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:2.0:1785774988.319211:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774988.319214:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773faf7c00, rc 0) 00000100:00100000:2.0:1785774988.319670:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+178:22206:x1872519648738688:12345-192.168.202.31@tcp:101:bash.0 Request processed in 841us (1062us total) trans 4294968768 rc 0/0 00000100:00100000:2.0:1785774988.319677:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24323 00000100:00100000:2.0:1785774988.336899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.336975:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648738816 00000100:00100000:3.0:1785774988.336984:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648738816 00000100:00100000:3.0:1785774988.337061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1561 00000100:00100000:3.0:1785774988.337071:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+178:2419:x1872519648738816:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774988.337087:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774988.337121:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7c00/0x7b7109e1d0a2a8e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca59 expref: 178 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.337140:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:3.0:1785774988.337145:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774988.337241:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+177:2419:x1872519648738816:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 171us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774988.337249:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1561 00000100:00100000:2.0:1785774988.338685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.338742:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648739072 00000100:00100000:3.0:1785774988.338747:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648739072 00000100:00100000:3.0:1785774988.338787:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24324 00000100:00100000:3.0:1785774988.338795:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+177:22206:x1872519648739072:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:3.0:1785774988.338841:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774988.338858:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a1e86 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c693 expref: 177 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.338873:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:3.0:1785774988.338876:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785774988.339060:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.339075:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.339084:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774988.339485:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968769 00000004:00010000:3.0:1785774988.339509:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c49752a3 reply state 000000007dc23404 transno 4294968770 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.339522:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.339529:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:3.0:1785774988.339532:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774988.339534:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774988.339609:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+179:22206:x1872519648739072:12345-192.168.202.31@tcp:36:bash.0 Request processed in 814us (927us total) trans 4294968770 rc 0/0 00000100:00100000:3.0:1785774988.339617:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24324 00000020:00080000:3.0:1785774988.339622:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774988.344020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.344116:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648739200 00000100:00100000:1.0:1785774988.344124:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648739200 00000100:00100000:1.0:1785774988.344208:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24325 00000100:00100000:1.0:1785774988.344217:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+179:22206:x1872519648739200:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774988.344238:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774988.344254:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2aa3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.344301:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2aa3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca60 expref: 180 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.344314:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044e00/0x7b7109e1d0a2aa3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca60 expref: 180 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.344328:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:1.0:1785774988.344331:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785774988.344334:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044e00, rc 0) 00000100:00100000:1.0:1785774988.344629:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+180:22206:x1872519648739200:12345-192.168.202.31@tcp:101:bash.0 Request processed in 413us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.344636:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24325 00000100:00100000:2.0:1785774988.353528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.354323:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648739328 00000100:00100000:3.0:1785774988.354332:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648739328 00002000:00010000:3.0:1785774988.354376:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/6 (0->18446744073709551615) 00002000:00100000:3.0:1785774988.354381:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c95180 with x1872519648739328 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774988.354399:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c95180. 00000100:00100000:3.0:1785774988.354430:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 111 00000100:00100000:3.0:1785774988.354438:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648739328:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:3.0:1785774988.354655:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785774988.354658:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1785774987 00002000:00010000:3.0:1785774988.354661:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785774988.354663:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1785774987 00002000:00010000:3.0:1785774988.354665:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1785774988.354725:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648739328:12345-192.168.202.31@tcp:10:bash.0 Request processed in 286us (1205us total) trans 4294970027 rc 0/0 00000100:00100000:3.0:1785774988.354732:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 111 00002000:00010000:3.0:1785774988.354735:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/6 (0->18446744073709551615) 00002000:00100000:3.0:1785774988.354737:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c95180 with x1872519648739328 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774988.354741:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7605c95180. 00000100:00100000:2.0:1785774988.373367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.373469:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648739456 00000100:00100000:0.0:1785774988.373478:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648739456 00000100:00100000:0.0:1785774988.373540:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5441 00000100:00100000:0.0:1785774988.373550:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648739456:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:1.0:1785774988.382234:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970027 is committed 00000100:00100000:0.0:1785774988.395128:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648739456:12345-192.168.202.31@tcp:16:bash.0 Request processed in 21569us (21760us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.395142:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5441 00000100:00100000:2.0:1785774988.408281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.408427:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648739712 00000100:00100000:1.0:1785774988.408439:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648739712 00000100:00100000:1.0:1785774988.408486:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5329 00000100:00100000:1.0:1785774988.408496:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+180:22206:x1872519648739712:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774988.408713:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+181:22206:x1872519648739712:12345-192.168.202.31@tcp:35:bash.0 Request processed in 217us (439us total) trans 4294968771 rc 0/0 00000100:00100000:1.0:1785774988.408720:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5329 00000100:00100000:1.0:1785774988.418313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.425329:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648739840 00000100:00100000:0.0:1785774988.425344:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648739840 00000100:00100000:2.0:1785774988.426340:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24326 00000100:00100000:2.0:1785774988.426351:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+181:22206:x1872519648739840:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:2.0:1785774988.426501:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+181:22206:x1872519648739840:12345-192.168.202.31@tcp:44:bash.0 Request processed in 152us (8250us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.426508:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24326 00000100:00100000:2.0:1785774988.436329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.436458:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648740096 00000100:00100000:0.0:1785774988.436467:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648740096 00000100:00100000:0.0:1785774988.436522:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24327 00000100:00100000:0.0:1785774988.436531:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+181:22206:x1872519648740096:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774988.436550:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774988.436570:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a2aaa lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca67 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.436671:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2ab1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.436686:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2ab1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.436698:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2ab1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774988.436708:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a3:0x0]: returning size 6 00010000:00010000:2.0:1785774988.438415:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a2aaa lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca67 expref: 184 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.438437:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2ab1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca67 expref: 183 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.438451:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:2.0:1785774988.438453:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774988.438456:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154e00, rc 0) 00000100:00100000:2.0:1785774988.438559:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+183:22206:x1872519648740096:12345-192.168.202.31@tcp:101:bash.0 Request processed in 2028us (2237us total) trans 4294968772 rc 0/0 00000100:00100000:2.0:1785774988.438567:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24327 00000100:00100000:2.0:1785774988.452422:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671391104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774988.452493:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774988.452900:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671391104 00000100:00100000:1.0:1785774988.452909:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671391104 00000100:00100000:1.0:1785774988.452961:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1785774988.452971:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671391104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785774988.453001:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484845248 pending 0 free 3923374080 avail 3691851776 00000100:00100000:1.0:1785774988.453092:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671391104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.453109:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1785774988.456605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.456723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648740224 00000100:00100000:0.0:1785774988.456730:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648740224 00000100:00100000:0.0:1785774988.456786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1562 00000100:00100000:0.0:1785774988.456794:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+183:2416:x1872519648740224:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774988.456805:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774988.456826:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2ab1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca67 expref: 183 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.456844:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:0.0:1785774988.456848:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774988.456891:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+182:2416:x1872519648740224:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 98us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.456898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1562 00000100:00100000:3.0:1785774988.458855:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671391232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1785774988.458905:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774988.458995:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671391232 00000100:00100000:1.0:1785774988.459001:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671391232 00000100:00100000:1.0:1785774988.459038:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1785774988.459058:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671391232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1785774988.459079:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484845248 pending 0 free 3923374080 avail 3691851776 00000100:00100000:1.0:1785774988.459137:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671391232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.459148:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1785774988.459415:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671391232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1785774988.464658:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.464749:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648740480 00000100:00100000:0.0:1785774988.464758:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648740480 00000100:00100000:0.0:1785774988.464809:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24328 00000100:00100000:0.0:1785774988.464817:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+182:22206:x1872519648740480:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:0.0:1785774988.464870:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774988.464897:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8400/0x7b7109e1d0a1ea9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c69a expref: 182 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.464916:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:0.0:1785774988.464922:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774988.465088:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.465111:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.465121:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774988.465157:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968773 00000004:00010000:0.0:1785774988.465193:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e7d3f07 reply state 0000000021a3e730 transno 4294968774 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.465205:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.465211:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:0.0:1785774988.465214:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774988.465216:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774988.465426:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+184:22206:x1872519648740480:12345-192.168.202.31@tcp:36:bash.0 Request processed in 608us (775us total) trans 4294968774 rc 0/0 00000100:00100000:0.0:1785774988.465434:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24328 00000020:00080000:0.0:1785774988.465439:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774988.466866:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671391104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774988.477092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.477271:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648740608 00000100:00100000:2.0:1785774988.477280:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648740608 00000100:00100000:2.0:1785774988.477332:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24329 00000100:00100000:2.0:1785774988.477341:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+184:22206:x1872519648740608:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774988.477362:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774988.477380:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6e00/0x7b7109e1d0a2ac6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca6e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.477441:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6e00/0x7b7109e1d0a2ac6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca6e expref: 185 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.477454:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6e00/0x7b7109e1d0a2ac6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca6e expref: 185 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.477469:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:2.0:1785774988.477472:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785774988.477475:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773faf6e00, rc 0) 00000100:00100000:2.0:1785774988.477531:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+185:22206:x1872519648740608:12345-192.168.202.31@tcp:101:bash.0 Request processed in 191us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.477537:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24329 00000100:00100000:3.0:1785774988.496686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.497055:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648740736 00000100:00100000:0.0:1785774988.497064:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648740736 00002000:00010000:0.0:1785774988.497210:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/6 (0->18446744073709551615) 00002000:00100000:0.0:1785774988.497215:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d500 with x1872519648740736 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774988.497226:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d500. 00000100:00100000:0.0:1785774988.497364:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 112 00000100:00100000:1.0:1785774988.504888:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648740736:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774988.505251:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774988.505265:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1785774987 00002000:00010000:1.0:1785774988.505268:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774988.505270:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1785774987 00002000:00010000:1.0:1785774988.505272:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774988.505328:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648740736:12345-192.168.202.31@tcp:10:bash.0 Request processed in 7956us (8650us total) trans 4294969992 rc 0/0 00000100:00100000:1.0:1785774988.505337:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 112 00002000:00010000:1.0:1785774988.505342:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/6 (0->18446744073709551615) 00002000:00100000:1.0:1785774988.505345:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d500 with x1872519648740736 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774988.505351:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d500. 00000100:00100000:3.0:1785774988.519197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.519429:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648740864 00000100:00100000:2.0:1785774988.519439:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648740864 00000100:00100000:2.0:1785774988.519496:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5442 00000100:00100000:2.0:1785774988.519505:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648740864:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774988.522092:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969992 is committed 00000100:00100000:2.0:1785774988.522300:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648740864:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2794us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.522309:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5442 00000100:00100000:0.0:1785774988.548770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.548883:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648741120 00000100:00100000:3.0:1785774988.548893:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648741120 00000100:00100000:3.0:1785774988.548947:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5330 00000100:00100000:3.0:1785774988.548956:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+185:22206:x1872519648741120:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774988.549203:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+186:22206:x1872519648741120:12345-192.168.202.31@tcp:35:bash.0 Request processed in 246us (441us total) trans 4294968775 rc 0/0 00000100:00100000:3.0:1785774988.549211:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5330 00000100:00100000:3.0:1785774988.554729:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.554882:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648741248 00000100:00100000:2.0:1785774988.554892:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648741248 00000100:00100000:2.0:1785774988.554951:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24330 00000100:00100000:2.0:1785774988.554961:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+186:22206:x1872519648741248:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:2.0:1785774988.555113:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+186:22206:x1872519648741248:12345-192.168.202.31@tcp:44:bash.0 Request processed in 153us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.555120:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24330 00000100:00100000:0.0:1785774988.567908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.569205:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648741504 00000100:00100000:2.0:1785774988.569215:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648741504 00000100:00100000:2.0:1785774988.569374:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24331 00000100:00100000:2.0:1785774988.569385:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+186:22206:x1872519648741504:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774988.569418:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774988.569441:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7800/0x7b7109e1d0a2acd lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca75 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.569557:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7600/0x7b7109e1d0a2ad4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.569572:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7600/0x7b7109e1d0a2ad4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.569586:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7600/0x7b7109e1d0a2ad4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774988.569597:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a4:0x0]: returning size 7 00010000:00010000:2.0:1785774988.569708:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7800/0x7b7109e1d0a2acd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca75 expref: 189 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.569728:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7600/0x7b7109e1d0a2ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca75 expref: 188 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.569750:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:2.0:1785774988.569753:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774988.569756:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773faf7600, rc 0) 00000100:00100000:2.0:1785774988.569813:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+188:22206:x1872519648741504:12345-192.168.202.31@tcp:101:bash.0 Request processed in 430us (1913us total) trans 4294968776 rc 0/0 00000100:00100000:2.0:1785774988.569819:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24331 00000100:00100000:2.0:1785774988.596795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.596970:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648741760 00000100:00100000:1.0:1785774988.596980:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648741760 00000100:00100000:1.0:1785774988.597044:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24332 00000100:00100000:1.0:1785774988.597064:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+188:22206:x1872519648741760:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774988.597121:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1785774988.597148:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7600/0x7b7109e1d0a2ad4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca75 expref: 188 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.597208:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744600/0x7b7109e1d0a1ecc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6a1 expref: 187 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.597223:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:1.0:1785774988.597228:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774988.597638:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.597653:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.597663:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774988.597704:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968777 00000004:00010000:0.0:1785774988.597727:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a827b29 reply state 00000000d5fe32b7 transno 4294968778 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.597753:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.597759:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:0.0:1785774988.597761:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774988.597764:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774988.597853:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+189:22206:x1872519648741760:12345-192.168.202.31@tcp:36:bash.0 Request processed in 800us (1066us total) trans 4294968778 rc 0/0 00000100:00100000:0.0:1785774988.597861:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24332 00000020:00080000:0.0:1785774988.597865:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774988.617960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.618074:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648741888 00000100:00100000:2.0:1785774988.618084:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648741888 00000100:00100000:2.0:1785774988.618144:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24333 00000100:00100000:2.0:1785774988.618154:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+189:22206:x1872519648741888:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774988.618228:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774988.618249:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7800/0x7b7109e1d0a2ae9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca7c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.618316:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7800/0x7b7109e1d0a2ae9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca7c expref: 190 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.618332:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7800/0x7b7109e1d0a2ae9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca7c expref: 190 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.618351:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:2.0:1785774988.618354:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785774988.618358:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773faf7800, rc 0) 00000100:00100000:2.0:1785774988.618421:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+190:22206:x1872519648741888:12345-192.168.202.31@tcp:101:bash.0 Request processed in 268us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.618428:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24333 00000100:00100000:3.0:1785774988.646453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.646606:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648742016 00000100:00100000:2.0:1785774988.646616:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648742016 00002000:00010000:2.0:1785774988.646652:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:2.0:1785774988.646656:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471ca80 with x1872519648742016 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774988.646667:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471ca80. 00000100:00100000:2.0:1785774988.646698:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 113 00000100:00100000:2.0:1785774988.646706:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648742016:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:2.0:1785774988.646963:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774988.646967:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1785774987 00002000:00010000:2.0:1785774988.646970:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774988.646973:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1785774987 00002000:00010000:2.0:1785774988.646975:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774988.647036:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648742016:12345-192.168.202.31@tcp:10:bash.0 Request processed in 330us (591us total) trans 4294970028 rc 0/0 00000100:00100000:2.0:1785774988.647569:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 113 00002000:00010000:2.0:1785774988.647574:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:2.0:1785774988.647576:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471ca80 with x1872519648742016 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774988.647581:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471ca80. 00000100:00100000:0.0:1785774988.676050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.677361:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648742144 00000100:00100000:2.0:1785774988.677372:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648742144 00000100:00100000:2.0:1785774988.677445:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5443 00000100:00100000:2.0:1785774988.677455:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648742144:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:1.0:1785774988.682559:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970028 is committed 00000100:00100000:2.0:1785774988.682739:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648742144:12345-192.168.202.31@tcp:16:bash.0 Request processed in 5271us (6693us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.682750:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5443 00000100:00100000:3.0:1785774988.709688:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.710341:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648742400 00000100:00100000:0.0:1785774988.710351:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648742400 00000100:00100000:0.0:1785774988.710412:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5331 00000100:00100000:0.0:1785774988.710421:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+190:22206:x1872519648742400:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774988.712156:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+191:22206:x1872519648742400:12345-192.168.202.31@tcp:35:bash.0 Request processed in 1727us (2468us total) trans 4294968779 rc 0/0 00000100:00100000:0.0:1785774988.712182:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5331 00000100:00100000:0.0:1785774988.729434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.737148:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648742528 00000100:00100000:1.0:1785774988.737249:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648742528 00000100:00100000:1.0:1785774988.737424:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24334 00000100:00100000:1.0:1785774988.737436:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+191:22206:x1872519648742528:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774988.737579:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+191:22206:x1872519648742528:12345-192.168.202.31@tcp:44:bash.0 Request processed in 147us (8154us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.737586:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24334 00000100:00100000:2.0:1785774988.766799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.766937:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648742784 00000100:00100000:1.0:1785774988.766947:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648742784 00000100:00100000:1.0:1785774988.767006:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24335 00000100:00100000:1.0:1785774988.767018:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+191:22206:x1872519648742784:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774988.767154:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774988.767209:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2af0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca83 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.767427:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.767442:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.767453:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774988.767468:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a5:0x0]: returning size 7 00010000:00010000:1.0:1785774988.767573:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2af0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 194 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.767592:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 193 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.767602:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:1.0:1785774988.767605:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774988.767608:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742045000, rc 0) 00000100:00100000:1.0:1785774988.767699:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+193:22206:x1872519648742784:12345-192.168.202.31@tcp:101:bash.0 Request processed in 684us (909us total) trans 4294968780 rc 0/0 00000100:00100000:1.0:1785774988.767706:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24335 00000100:00100000:0.0:1785774988.793079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.793125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.793945:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648743168 00000100:00100000:2.0:1785774988.793955:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648743168 00000100:00100000:2.0:1785774988.794008:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24336 00000100:00100000:2.0:1785774988.794019:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+193:22206:x1872519648743168:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:2.0:1785774988.794069:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774988.794094:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a1eef lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6a8 expref: 193 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.794114:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:2.0:1785774988.794119:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774988.794323:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.794336:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 193 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.794344:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 4/0,1 mode: --/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.794371:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 193 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.794384:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 193 pid: 21784 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774988.794409:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671391360:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774988.794490:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770383b240 going to sleep for 11 seconds 00000100:00100000:1.0:1785774988.797353:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648742912 00000100:00100000:1.0:1785774988.797364:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648742912 00010000:00010000:1.0:1785774988.797411:0:19895:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 194 pid: 21784 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774988.797451:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1684 00000100:00100000:1.0:1785774988.797460:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b771040a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+194:2418:x1872519648742912:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774988.797475:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774988.797480:0:19895:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 194 pid: 21784 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.797491:0:19895:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 194 pid: 21784 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.797512:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:1.0:1785774988.797516:0:19895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.797524:0:19895:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.797530:0:19895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.797544:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774988.797578:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b771040a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+194:2418:x1872519648742912:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 120us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.797584:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1684 00010000:00010000:2.0:1785774988.821470:0:8469:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@0000000048fc83e5 x1872519671391360) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 193 pid: 21784 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.821494:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2af7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca83 expref: 193 pid: 21784 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774988.821513:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8469:1872519671391360:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774988.821535:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:2.0:1785774988.821542:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.821555:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.821561:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774988.821644:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968781 00000004:00010000:2.0:1785774988.821691:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0dd0cb7 reply state 0000000076ae37a1 transno 4294968782 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.821706:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.821712:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:2.0:1785774988.821714:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774988.821717:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774988.822533:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+194:22206:x1872519648743168:12345-192.168.202.31@tcp:36:bash.0 Request processed in 28515us (29406us total) trans 4294968782 rc 0/0 00000100:00100000:2.0:1785774988.822542:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24336 00000020:00080000:2.0:1785774988.822547:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774988.835189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.837492:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648743296 00000100:00100000:0.0:1785774988.837504:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648743296 00000100:00100000:0.0:1785774988.837550:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24337 00000100:00100000:0.0:1785774988.837558:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+194:22206:x1872519648743296:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774988.837581:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774988.837600:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a2b0c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca8a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.837649:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a2b0c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca8a expref: 195 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.837662:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155600/0x7b7109e1d0a2b0c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca8a expref: 195 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.837677:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:0.0:1785774988.837680:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785774988.837683:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155600, rc 0) 00000100:00100000:0.0:1785774988.837744:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+195:22206:x1872519648743296:12345-192.168.202.31@tcp:101:bash.0 Request processed in 186us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.837751:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24337 00000100:00100000:3.0:1785774988.844476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.844635:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648743424 00000100:00100000:2.0:1785774988.844644:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648743424 00002000:00010000:2.0:1785774988.844678:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00002000:00100000:2.0:1785774988.844683:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471ed80 with x1872519648743424 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774988.844694:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471ed80. 00000100:00100000:2.0:1785774988.844725:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 114 00000100:00100000:2.0:1785774988.844740:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648743424:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:2.0:1785774988.844979:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774988.844983:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1785774987 00002000:00010000:2.0:1785774988.844986:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774988.844988:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1785774987 00002000:00010000:2.0:1785774988.844990:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774988.845056:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648743424:12345-192.168.202.31@tcp:10:bash.0 Request processed in 323us (587us total) trans 4294969993 rc 0/0 00000100:00100000:2.0:1785774988.845063:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 114 00002000:00010000:2.0:1785774988.845066:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00002000:00100000:2.0:1785774988.845069:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471ed80 with x1872519648743424 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774988.845074:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471ed80. 00000100:00100000:3.0:1785774988.853296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.853440:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648743552 00000100:00100000:0.0:1785774988.853450:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648743552 00000100:00100000:0.0:1785774988.853509:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5444 00000100:00100000:0.0:1785774988.853519:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648743552:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:2.0:1785774988.857605:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969993 is committed 00000100:00100000:0.0:1785774988.857792:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648743552:12345-192.168.202.31@tcp:16:bash.0 Request processed in 4270us (4499us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.857802:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5444 00000100:00100000:3.0:1785774988.866662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.867135:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648743808 00000100:00100000:1.0:1785774988.867145:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648743808 00000100:00100000:1.0:1785774988.867240:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5332 00000100:00100000:1.0:1785774988.867261:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7731e24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+195:22206:x1872519648743808:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774988.867512:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7731e24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+196:22206:x1872519648743808:12345-192.168.202.31@tcp:35:bash.0 Request processed in 263us (858us total) trans 4294968783 rc 0/0 00000100:00100000:1.0:1785774988.867520:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5332 00000001:00080000:0.0:1785774988.874911:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968783 is committed 00010000:00010000:1.0:1785774988.875149:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875190:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875197:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875203:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875208:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875214:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875229:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9b77131b5200) 00010000:00010000:1.0:1785774988.875231:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875235:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875240:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a295a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875273:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875278:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875283:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875287:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875289:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875294:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875304:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9b77131b5000) 00010000:00010000:1.0:1785774988.875306:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875308:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875312:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a29a7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875320:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875326:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875331:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875334:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875336:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875341:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875346:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9b77131b5e00) 00010000:00010000:1.0:1785774988.875348:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875350:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875354:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0c00/0x7b7109e1d0a29ca lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875366:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875371:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875375:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875379:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7605ec0600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875381:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875394:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875400:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9b7605fd8d00) 00010000:00010000:1.0:1785774988.875402:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875405:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875409:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7605ec0600/0x7b7109e1d0a29ed lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875418:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875422:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875427:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875432:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875434:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875439:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875444:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9b7604f39f00) 00010000:00010000:1.0:1785774988.875446:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875448:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875453:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2a10 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875460:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875465:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875469:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875473:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cfc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875475:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875480:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875489:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9b7707de8100) 00010000:00010000:1.0:1785774988.875491:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875494:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875498:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2a33 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875505:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875509:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875514:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875517:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875519:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875524:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875529:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9b7605fd8600) 00010000:00010000:1.0:1785774988.875530:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875532:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875537:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2a56 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875548:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875554:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875558:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875561:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875564:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875568:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875573:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9b7605fce600) 00010000:00010000:1.0:1785774988.875575:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875577:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875581:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155800/0x7b7109e1d0a2a79 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875589:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875594:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875598:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875604:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875606:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875611:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875616:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9b7707de8900) 00010000:00010000:1.0:1785774988.875618:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875620:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875625:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2a9c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875632:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875637:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875642:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875647:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606155e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875649:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875655:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875667:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9b7605fd8b00) 00010000:00010000:1.0:1785774988.875669:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875672:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875677:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155e00/0x7b7109e1d0a2abf lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875686:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875691:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875696:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875701:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.875704:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875709:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875716:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9b7605fce300) 00010000:00010000:1.0:1785774988.875719:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.875721:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.875726:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154c00/0x7b7109e1d0a2ae2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774988.876501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:1.0:1785774988.877147:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.877154:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.877184:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.877190:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773faf7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774988.877194:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.877200:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.877210:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9b77131b5d00) 00010000:00010000:1.0:1785774988.877212:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774988.877215:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.877220:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7e00/0x7b7109e1d0a2b05 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774988.877372:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648743936 00000100:00100000:0.0:1785774988.877381:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648743936 00000100:00100000:0.0:1785774988.877445:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24338 00000100:00100000:0.0:1785774988.877454:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:22206:x1872519648743936:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:0.0:1785774988.877580:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:22206:x1872519648743936:12345-192.168.202.31@tcp:44:bash.0 Request processed in 127us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.877586:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24338 00000100:00100000:2.0:1785774988.892932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774988.893014:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648744192 00000100:00100000:3.0:1785774988.893024:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648744192 00000100:00100000:3.0:1785774988.893092:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24339 00000100:00100000:3.0:1785774988.893103:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+53:22206:x1872519648744192:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774988.893123:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774988.893143:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a2b13 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca91 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.893298:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b1a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.893312:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.893323:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774988.893335:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a6:0x0]: returning size 7 00010000:00010000:3.0:1785774988.893461:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a2b13 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca91 expref: 56 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.893478:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b1a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca91 expref: 55 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.893487:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:3.0:1785774988.893490:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774988.893493:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:3.0:1785774988.893546:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:22206:x1872519648744192:12345-192.168.202.31@tcp:101:bash.0 Request processed in 446us (625us total) trans 4294968784 rc 0/0 00000100:00100000:3.0:1785774988.893553:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24339 00000100:00100000:3.0:1785774988.902313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.902396:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648744320 00000100:00100000:1.0:1785774988.902404:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648744320 00000100:00100000:1.0:1785774988.902471:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1563 00000100:00100000:1.0:1785774988.902481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:2417:x1872519648744320:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774988.902495:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774988.902520:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b1a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca91 expref: 55 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.902538:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:1.0:1785774988.902543:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774988.902601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:2417:x1872519648744320:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774988.902609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1563 00000100:00100000:0.0:1785774988.912576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.912713:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648744576 00000100:00100000:2.0:1785774988.912724:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648744576 00000100:00100000:2.0:1785774988.912794:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24340 00000100:00100000:2.0:1785774988.912805:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22206:x1872519648744576:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:2.0:1785774988.912857:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774988.912883:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711744a00/0x7b7109e1d0a1f12 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6af expref: 54 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.912900:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:2.0:1785774988.912904:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774988.913077:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.913092:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.913102:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774988.913141:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968785 00000004:00010000:2.0:1785774988.914087:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099901cd2 reply state 00000000a8a28c11 transno 4294968786 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.914103:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.914110:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:2.0:1785774988.914112:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774988.914115:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774988.914437:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22206:x1872519648744576:12345-192.168.202.31@tcp:36:bash.0 Request processed in 1632us (1870us total) trans 4294968786 rc 0/0 00000100:00100000:2.0:1785774988.914445:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24340 00000020:00080000:2.0:1785774988.914450:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774988.918882:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.918965:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648744704 00000100:00100000:0.0:1785774988.918973:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648744704 00000100:00100000:0.0:1785774988.919031:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24341 00000100:00100000:0.0:1785774988.919052:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22206:x1872519648744704:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774988.919076:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774988.919097:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2b2f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca98 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.919152:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2b2f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca98 expref: 57 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.919217:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155400/0x7b7109e1d0a2b2f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca98 expref: 57 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774988.919292:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:0.0:1785774988.919296:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785774988.919299:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155400, rc 0) 00000100:00100000:0.0:1785774988.919344:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+57:22206:x1872519648744704:12345-192.168.202.31@tcp:101:bash.0 Request processed in 306us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774988.919350:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24341 00000100:00100000:3.0:1785774988.928414:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.928559:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648744832 00000100:00100000:1.0:1785774988.928569:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648744832 00002000:00010000:1.0:1785774988.928603:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1785774988.928608:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471fb80 with x1872519648744832 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774988.928618:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471fb80. 00000100:00100000:1.0:1785774988.928651:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 115 00000100:00100000:1.0:1785774988.928659:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648744832:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774988.928911:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774988.928915:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1785774987 00002000:00010000:1.0:1785774988.928918:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774988.928920:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1785774987 00002000:00010000:1.0:1785774988.928922:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774988.928982:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2419:x1872519648744832:12345-192.168.202.31@tcp:10:bash.0 Request processed in 323us (575us total) trans 4294970029 rc 0/0 00000100:00100000:1.0:1785774988.928989:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 115 00002000:00010000:1.0:1785774988.928993:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:1.0:1785774988.928995:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471fb80 with x1872519648744832 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774988.929000:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471fb80. 00000100:00100000:0.0:1785774988.944776:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.944906:0:14712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648744960 00000100:00100000:2.0:1785774988.944916:0:14712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648744960 00000100:00100000:2.0:1785774988.944977:0:14712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5445 00000100:00100000:2.0:1785774988.944987:0:14712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648744960:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774988.946493:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970029 is committed 00000100:00100000:2.0:1785774988.946634:0:14712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648744960:12345-192.168.202.31@tcp:16:bash.0 Request processed in 1647us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.946643:0:14712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5445 00000100:00100000:3.0:1785774988.949703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.952046:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648745216 00000100:00100000:0.0:1785774988.952059:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648745216 00000100:00100000:0.0:1785774988.952118:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5333 00000100:00100000:0.0:1785774988.952128:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+57:22206:x1872519648745216:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774988.952504:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22206:x1872519648745216:12345-192.168.202.31@tcp:35:bash.0 Request processed in 377us (2806us total) trans 4294968787 rc 0/0 00000100:00100000:0.0:1785774988.952512:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5333 00000100:00100000:3.0:1785774988.962570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.962683:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648745344 00000100:00100000:2.0:1785774988.962691:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648745344 00000100:00100000:2.0:1785774988.962751:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24342 00000100:00100000:2.0:1785774988.962761:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22206:x1872519648745344:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:2.0:1785774988.962887:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22206:x1872519648745344:12345-192.168.202.31@tcp:44:bash.0 Request processed in 127us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774988.962894:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24342 00000100:00100000:2.0:1785774988.970134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774988.970599:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648745600 00000100:00100000:1.0:1785774988.970609:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648745600 00000100:00100000:1.0:1785774988.970665:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24343 00000100:00100000:1.0:1785774988.970674:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22206:x1872519648745600:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774988.970694:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774988.970713:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b36 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259ca9f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.970818:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.970831:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.970842:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774988.970852:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a7:0x0]: returning size 7 00010000:00010000:1.0:1785774988.970953:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b36 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 61 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.971989:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774988.971999:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:1.0:1785774988.972002:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774988.972005:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044800, rc 0) 00000100:00100000:1.0:1785774988.972068:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22206:x1872519648745600:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1395us (1942us total) trans 4294968788 rc 0/0 00000100:00100000:1.0:1785774988.972075:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24343 00000100:00100000:0.0:1785774988.994245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774988.994287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774988.994380:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648745984 00000100:00100000:2.0:1785774988.994401:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648745984 00000100:00100000:2.0:1785774988.994462:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24344 00000100:00100000:2.0:1785774988.994472:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+60:22206:x1872519648745984:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:2.0:1785774988.994525:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774988.994551:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745a00/0x7b7109e1d0a1f35 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6b6 expref: 60 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.994569:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:2.0:1785774988.994573:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774988.994737:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.994751:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.994759:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 4/0,1 mode: --/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.994790:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 60 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774988.994803:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 60 pid: 6529 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774988.994818:0:6530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671391488:192.168.202.31@tcp:104: 00000100:00100000:2.0:1785774988.994906:0:6530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b770383b840 going to sleep for 11 seconds 00000100:00100000:3.0:1785774988.995679:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648745728 00000100:00100000:3.0:1785774988.995685:0:9541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648745728 00010000:00010000:3.0:1785774988.995708:0:9541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 61 pid: 6529 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785774988.995740:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1685 00000100:00100000:3.0:1785774988.995748:0:9541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:2418:x1872519648745728:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785774988.995759:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785774988.995765:0:9541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 61 pid: 6529 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.995777:0:9541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 61 pid: 6529 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.995791:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:3.0:1785774988.995796:0:9541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.995804:0:9541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.995812:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774988.995825:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785774988.995865:0:9541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:2418:x1872519648745728:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 117us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774988.995873:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1685 00010000:00010000:2.0:1785774989.005010:0:6530:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@000000001fb15af1 x1872519671391488) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 60 pid: 6529 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.005044:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b3d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259ca9f expref: 60 pid: 6529 timeout: 1330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774989.005061:0:6530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6530:1872519671391488:192.168.202.31@tcp:104: 00010000:00010000:2.0:1785774989.005082:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:2.0:1785774989.005089:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.005104:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.005110:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785774989.005240:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968789 00000004:00010000:2.0:1785774989.005286:0:6530:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004eaf83ae reply state 000000008d5bfc18 transno 4294968790 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.005303:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.005311:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:2.0:1785774989.005314:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1785774989.005316:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785774989.005495:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:22206:x1872519648745984:12345-192.168.202.31@tcp:36:bash.0 Request processed in 11024us (11207us total) trans 4294968790 rc 0/0 00000100:00100000:2.0:1785774989.005504:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24344 00000020:00080000:2.0:1785774989.005510:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774989.022940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.024071:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648746112 00000100:00100000:3.0:1785774989.024081:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648746112 00000100:00080000:2.0:1785774989.024216:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1785774989.024827:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24345 00000100:00100000:3.0:1785774989.024839:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:22206:x1872519648746112:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774989.024863:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774989.024883:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a2b52 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259caa6 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.024936:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a2b52 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caa6 expref: 62 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.024949:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfe00/0x7b7109e1d0a2b52 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caa6 expref: 62 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.024965:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:3.0:1785774989.024978:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785774989.024981:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfe00, rc 0) 00000100:00100000:3.0:1785774989.025032:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:22206:x1872519648746112:12345-192.168.202.31@tcp:101:bash.0 Request processed in 197us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774989.025048:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24345 00000100:00100000:0.0:1785774989.037603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774989.037915:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648746240 00000100:00100000:2.0:1785774989.037925:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648746240 00002000:00010000:2.0:1785774989.037980:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/8 (0->18446744073709551615) 00002000:00100000:2.0:1785774989.037985:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7b480 with x1872519648746240 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774989.037995:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7741b7b480. 00000100:00100000:2.0:1785774989.038029:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 116 00000100:00100000:2.0:1785774989.038038:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648746240:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:2.0:1785774989.038310:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774989.038314:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1785774988 00002000:00010000:2.0:1785774989.038316:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774989.038318:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1785774988 00002000:00010000:2.0:1785774989.038320:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774989.038382:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648746240:12345-192.168.202.31@tcp:10:bash.0 Request processed in 344us (788us total) trans 4294969994 rc 0/0 00000100:00100000:2.0:1785774989.038399:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 116 00002000:00010000:2.0:1785774989.038404:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/8 (0->18446744073709551615) 00002000:00100000:2.0:1785774989.038406:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b7b480 with x1872519648746240 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774989.038410:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7741b7b480. 00000100:00080000:0.0:1785774989.038551:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774989.052462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.052713:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648746368 00000100:00100000:3.0:1785774989.052723:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648746368 00000100:00100000:3.0:1785774989.052790:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5446 00000100:00100000:3.0:1785774989.052801:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773c2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648746368:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774989.059297:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969994 is committed 00000100:00100000:0.0:1785774989.059542:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773c2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648746368:12345-192.168.202.31@tcp:16:bash.0 Request processed in 6738us (7082us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.059552:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5446 00000100:00100000:2.0:1785774989.070497:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.070592:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648746624 00000100:00100000:3.0:1785774989.070601:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648746624 00000100:00100000:3.0:1785774989.070657:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5334 00000100:00100000:3.0:1785774989.070667:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+62:22206:x1872519648746624:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774989.070889:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22206:x1872519648746624:12345-192.168.202.31@tcp:35:bash.0 Request processed in 223us (400us total) trans 4294968791 rc 0/0 00000100:00100000:3.0:1785774989.070897:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5334 00000100:00100000:2.0:1785774989.075009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.075122:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648746752 00000100:00100000:0.0:1785774989.075131:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648746752 00000100:00100000:0.0:1785774989.075210:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24346 00000100:00100000:0.0:1785774989.075221:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22206:x1872519648746752:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:0.0:1785774989.075353:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22206:x1872519648746752:12345-192.168.202.31@tcp:44:bash.0 Request processed in 134us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.075361:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24346 00000100:00100000:1.0:1785774989.084497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774989.084591:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648747008 00000100:00100000:2.0:1785774989.084600:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648747008 00000100:00100000:2.0:1785774989.084651:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24347 00000100:00100000:2.0:1785774989.084660:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22206:x1872519648747008:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1785774989.084685:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785774989.084704:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7600/0x7b7109e1d0a2b59 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259caad expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.084815:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7400/0x7b7109e1d0a2b60 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.084830:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7400/0x7b7109e1d0a2b60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.084844:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7400/0x7b7109e1d0a2b60 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774989.084855:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a8:0x0]: returning size 7 00010000:00010000:2.0:1785774989.084959:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7600/0x7b7109e1d0a2b59 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caad expref: 66 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.084977:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7400/0x7b7109e1d0a2b60 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caad expref: 65 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774989.084985:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:2.0:1785774989.084987:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785774989.084990:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b773faf7400, rc 0) 00000100:00100000:2.0:1785774989.085057:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:22206:x1872519648747008:12345-192.168.202.31@tcp:101:bash.0 Request processed in 397us (567us total) trans 4294968792 rc 0/0 00000100:00100000:2.0:1785774989.085065:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24347 00000100:00100000:2.0:1785774989.089129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.089309:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648747136 00000100:00100000:0.0:1785774989.089319:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648747136 00000100:00100000:0.0:1785774989.089375:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1564 00000100:00100000:0.0:1785774989.089392:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+65:2418:x1872519648747136:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774989.089409:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774989.089430:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7400/0x7b7109e1d0a2b60 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caad expref: 65 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.089448:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:0.0:1785774989.089451:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774989.089509:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:2418:x1872519648747136:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 126us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.089516:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1564 00010000:00010000:3.0:1785774989.093987:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774989.117935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.118131:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648747392 00000100:00100000:0.0:1785774989.118141:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648747392 00000100:00100000:0.0:1785774989.118227:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24348 00000100:00100000:0.0:1785774989.118236:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+64:22206:x1872519648747392:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774989.118517:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774989.118543:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8a00/0x7b7109e1d0a1f58 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6bd expref: 64 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.118560:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:1.0:1785774989.118565:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774989.118716:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.118729:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.118747:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774989.118788:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968793 00000004:00010000:1.0:1785774989.118810:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b588c078 reply state 000000008c385c15 transno 4294968794 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.118822:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.118828:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:1.0:1785774989.118830:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774989.118832:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774989.118920:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:22206:x1872519648747392:12345-192.168.202.31@tcp:36:bash.0 Request processed in 684us (993us total) trans 4294968794 rc 0/0 00000100:00100000:1.0:1785774989.118927:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24348 00000020:00080000:1.0:1785774989.118931:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774989.122423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.122503:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648747520 00000100:00100000:0.0:1785774989.122510:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648747520 00000100:00100000:0.0:1785774989.122554:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24349 00000100:00100000:0.0:1785774989.122563:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+66:22206:x1872519648747520:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774989.122585:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774989.122601:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2b75 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cab4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.122653:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2b75 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cab4 expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.122667:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154600/0x7b7109e1d0a2b75 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cab4 expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.122685:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:0.0:1785774989.122689:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785774989.122692:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154600, rc 0) 00000100:00100000:0.0:1785774989.123428:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+67:22206:x1872519648747520:12345-192.168.202.31@tcp:101:bash.0 Request processed in 179us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.123438:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24349 00000100:00100000:2.0:1785774989.136578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.136663:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648747648 00000100:00100000:1.0:1785774989.136673:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648747648 00002000:00010000:1.0:1785774989.136728:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/9 (0->18446744073709551615) 00002000:00100000:1.0:1785774989.136733:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b2300 with x1872519648747648 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774989.136752:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b2300. 00000100:00100000:1.0:1785774989.136786:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 117 00000100:00100000:1.0:1785774989.136797:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648747648:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774989.137057:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774989.137061:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1785774988 00002000:00010000:1.0:1785774989.137063:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774989.137065:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1785774988 00002000:00010000:1.0:1785774989.137067:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774989.137136:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648747648:12345-192.168.202.31@tcp:10:bash.0 Request processed in 340us (564us total) trans 4294970030 rc 0/0 00000100:00100000:1.0:1785774989.137143:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 117 00002000:00010000:1.0:1785774989.137147:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/9 (0->18446744073709551615) 00002000:00100000:1.0:1785774989.137150:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b2300 with x1872519648747648 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774989.137154:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b2300. 00000100:00080000:2.0:1785774989.137506:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774989.156111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.161069:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648747776 00000100:00100000:0.0:1785774989.161080:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648747776 00000100:00100000:0.0:1785774989.161148:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5447 00000100:00100000:0.0:1785774989.161187:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648747776:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774989.163788:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970030 is committed 00000100:00100000:0.0:1785774989.163973:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648747776:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2814us (7878us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.163983:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5447 00000100:00100000:1.0:1785774989.169264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.169353:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648748032 00000100:00100000:0.0:1785774989.169363:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648748032 00000100:00100000:0.0:1785774989.169429:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5335 00000100:00100000:0.0:1785774989.169440:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+67:22206:x1872519648748032:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774989.169642:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22206:x1872519648748032:12345-192.168.202.31@tcp:35:bash.0 Request processed in 204us (396us total) trans 4294968795 rc 0/0 00000100:00100000:0.0:1785774989.169651:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5335 00000100:00100000:2.0:1785774989.175441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.175529:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648748160 00000100:00100000:1.0:1785774989.175537:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648748160 00000100:00100000:1.0:1785774989.175584:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24350 00000100:00100000:1.0:1785774989.175593:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22206:x1872519648748160:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774989.175728:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22206:x1872519648748160:12345-192.168.202.31@tcp:44:bash.0 Request processed in 135us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.175736:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24350 00000100:00100000:2.0:1785774989.194910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.195619:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648748416 00000100:00100000:3.0:1785774989.195629:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648748416 00000100:00100000:3.0:1785774989.195685:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24351 00000100:00100000:3.0:1785774989.195694:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+68:22206:x1872519648748416:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774989.195727:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774989.195757:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a2b7c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cabb expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.195863:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b83 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.195877:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.195889:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774989.195899:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a9:0x0]: returning size 7 00010000:00010000:3.0:1785774989.196000:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a2b7c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cabb expref: 71 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.196017:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b83 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cabb expref: 70 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.196025:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:3.0:1785774989.196028:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774989.196031:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfa00, rc 0) 00000100:00100000:3.0:1785774989.197217:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:22206:x1872519648748416:12345-192.168.202.31@tcp:101:bash.0 Request processed in 1522us (2314us total) trans 4294968796 rc 0/0 00000100:00100000:3.0:1785774989.197228:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24351 00000100:00100000:2.0:1785774989.216124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.216534:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648748672 00000100:00100000:1.0:1785774989.216543:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648748672 00000100:00100000:1.0:1785774989.216591:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24352 00000100:00100000:1.0:1785774989.216598:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+70:22206:x1872519648748672:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774989.216656:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1785774989.216679:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfa00/0x7b7109e1d0a2b83 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cabb expref: 70 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.216698:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a1f7b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6c4 expref: 69 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.216707:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:1.0:1785774989.216712:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774989.216856:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.216868:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.216877:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774989.216911:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968797 00000004:00010000:1.0:1785774989.216928:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005dc1d9c reply state 00000000d629b5a1 transno 4294968798 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.216939:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.216945:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:1.0:1785774989.216948:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774989.216950:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774989.217028:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:22206:x1872519648748672:12345-192.168.202.31@tcp:36:bash.0 Request processed in 429us (912us total) trans 4294968798 rc 0/0 00000100:00100000:1.0:1785774989.217034:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24352 00000020:00080000:1.0:1785774989.217048:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774989.220981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.221117:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648748800 00000100:00100000:1.0:1785774989.221126:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648748800 00000100:00100000:1.0:1785774989.221206:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24353 00000100:00100000:1.0:1785774989.221216:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+71:22206:x1872519648748800:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774989.221236:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774989.221265:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b98 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cac2 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.221317:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b98 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cac2 expref: 72 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.221329:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044800/0x7b7109e1d0a2b98 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cac2 expref: 72 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.221344:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:1.0:1785774989.221346:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785774989.221349:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044800, rc 0) 00000100:00100000:1.0:1785774989.221410:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22206:x1872519648748800:12345-192.168.202.31@tcp:101:bash.0 Request processed in 196us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.221417:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24353 00000100:00100000:2.0:1785774989.244086:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.244209:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648748928 00000100:00100000:0.0:1785774989.244219:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648748928 00002000:00010000:0.0:1785774989.244264:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/9 (0->18446744073709551615) 00002000:00100000:0.0:1785774989.244268:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307dc00 with x1872519648748928 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774989.244279:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307dc00. 00000100:00100000:0.0:1785774989.244301:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 118 00000100:00100000:0.0:1785774989.244309:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648748928:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:0.0:1785774989.244558:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785774989.244561:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1785774988 00002000:00010000:0.0:1785774989.244564:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1785774989.244565:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1785774988 00002000:00010000:0.0:1785774989.244568:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1785774989.244623:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648748928:12345-192.168.202.31@tcp:10:bash.0 Request processed in 314us (546us total) trans 4294969995 rc 0/0 00000100:00100000:0.0:1785774989.244630:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 118 00002000:00010000:0.0:1785774989.244633:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/9 (0->18446744073709551615) 00002000:00100000:0.0:1785774989.244636:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307dc00 with x1872519648748928 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774989.244640:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760307dc00. 00000100:00100000:3.0:1785774989.257428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774989.257527:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648749056 00000100:00100000:2.0:1785774989.257535:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648749056 00000100:00100000:2.0:1785774989.257589:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5448 00000100:00100000:2.0:1785774989.257598:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648749056:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774989.259267:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969995 is committed 00000100:00100000:2.0:1785774989.259432:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648749056:12345-192.168.202.31@tcp:16:bash.0 Request processed in 1832us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774989.259442:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5448 00000100:00100000:2.0:1785774989.279227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.279412:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648749312 00000100:00100000:0.0:1785774989.279421:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648749312 00000100:00100000:0.0:1785774989.279475:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5336 00000100:00100000:0.0:1785774989.279484:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+72:22206:x1872519648749312:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774989.279685:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+73:22206:x1872519648749312:12345-192.168.202.31@tcp:35:bash.0 Request processed in 202us (467us total) trans 4294968799 rc 0/0 00000100:00100000:0.0:1785774989.279695:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5336 00000100:00100000:3.0:1785774989.291069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.292331:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648749440 00000100:00100000:1.0:1785774989.292341:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648749440 00000100:00100000:1.0:1785774989.292408:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24354 00000100:00100000:1.0:1785774989.292420:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+73:22206:x1872519648749440:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774989.292548:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+73:22206:x1872519648749440:12345-192.168.202.31@tcp:44:bash.0 Request processed in 130us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.292556:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24354 00000100:00100000:3.0:1785774989.312787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.312890:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648749696 00000100:00100000:1.0:1785774989.312900:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648749696 00000100:00100000:1.0:1785774989.312960:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24355 00000100:00100000:1.0:1785774989.312970:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+73:22206:x1872519648749696:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774989.313000:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774989.313021:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2b9f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cac9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.313454:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2ba6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.313468:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2ba6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.313478:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2ba6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774989.313488:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1aa:0x0]: returning size 7 00010000:00010000:1.0:1785774989.313592:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2b9f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cac9 expref: 76 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.313611:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2ba6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cac9 expref: 75 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.313624:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:1.0:1785774989.313626:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774989.313629:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044600, rc 0) 00000100:00100000:1.0:1785774989.313689:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:22206:x1872519648749696:12345-192.168.202.31@tcp:101:bash.0 Request processed in 721us (911us total) trans 4294968800 rc 0/0 00000100:00100000:1.0:1785774989.313696:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24355 00000100:00100000:2.0:1785774989.326941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.327080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648749824 00000100:00100000:0.0:1785774989.327099:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648749824 00000100:00100000:0.0:1785774989.327196:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1565 00000100:00100000:0.0:1785774989.327206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+75:2416:x1872519648749824:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785774989.327232:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785774989.327279:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2ba6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cac9 expref: 75 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.327298:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:0.0:1785774989.327302:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785774989.327353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:2416:x1872519648749824:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 149us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.327359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1565 00000100:00100000:3.0:1785774989.335536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.335662:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648750080 00000100:00100000:1.0:1785774989.335671:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648750080 00000100:00100000:1.0:1785774989.335723:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24356 00000100:00100000:1.0:1785774989.335732:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+74:22206:x1872519648750080:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774989.335789:0:21784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774989.335814:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745e00/0x7b7109e1d0a1f9e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6cb expref: 74 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.335833:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:1.0:1785774989.335838:0:21784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774989.336010:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.336024:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.336043:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774989.336084:0:21784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968801 00000004:00010000:1.0:1785774989.336119:0:21784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6d8cce0 reply state 0000000091c60cfd transno 4294968802 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.336132:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.336138:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:1.0:1785774989.336141:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774989.336143:0:21784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774989.336498:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22206:x1872519648750080:12345-192.168.202.31@tcp:36:bash.0 Request processed in 766us (967us total) trans 4294968802 rc 0/0 00000100:00100000:1.0:1785774989.336507:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24356 00000020:00080000:1.0:1785774989.336511:0:21784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774989.345491:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.345616:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648750208 00000100:00100000:1.0:1785774989.345624:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648750208 00000100:00100000:1.0:1785774989.345676:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24357 00000100:00100000:1.0:1785774989.345684:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+76:22206:x1872519648750208:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774989.345705:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774989.345724:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2bbb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cad0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.345774:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2bbb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cad0 expref: 77 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.345786:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044600/0x7b7109e1d0a2bbb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cad0 expref: 77 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.345800:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:1.0:1785774989.345803:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785774989.345806:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7742044600, rc 0) 00000100:00100000:1.0:1785774989.345858:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:22206:x1872519648750208:12345-192.168.202.31@tcp:101:bash.0 Request processed in 176us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.345865:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24357 00000100:00100000:2.0:1785774989.349894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.349962:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648750336 00000100:00100000:1.0:1785774989.349968:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648750336 00002000:00010000:1.0:1785774989.350007:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/10 (0->18446744073709551615) 00002000:00100000:1.0:1785774989.350011:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307c000 with x1872519648750336 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774989.350021:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760307c000. 00000100:00100000:1.0:1785774989.350051:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 119 00000100:00100000:1.0:1785774989.350059:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648750336:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774989.350591:0:22712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774989.350595:0:22712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1785774988 00002000:00010000:1.0:1785774989.350598:0:22712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774989.350599:0:22712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1785774988 00002000:00010000:1.0:1785774989.350601:0:22712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774989.350651:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648750336:12345-192.168.202.31@tcp:10:bash.0 Request processed in 592us (761us total) trans 4294970031 rc 0/0 00000100:00100000:1.0:1785774989.350659:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 119 00002000:00010000:1.0:1785774989.350663:0:22712:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/10 (0->18446744073709551615) 00002000:00100000:1.0:1785774989.350665:0:22712:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307c000 with x1872519648750336 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774989.350670:0:22712:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760307c000. 00000100:00100000:0.0:1785774989.365629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774989.365723:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648750464 00000100:00100000:2.0:1785774989.365733:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648750464 00000100:00100000:2.0:1785774989.365789:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5449 00000100:00100000:2.0:1785774989.365799:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2418:x1872519648750464:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:1.0:1785774989.375112:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970031 is committed 00000100:00100000:2.0:1785774989.375378:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648750464:12345-192.168.202.31@tcp:16:bash.0 Request processed in 9576us (9753us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774989.375404:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5449 00000100:00100000:2.0:1785774989.386995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.387198:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648750720 00000100:00100000:3.0:1785774989.387208:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648750720 00000100:00100000:3.0:1785774989.387270:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5337 00000100:00100000:3.0:1785774989.387281:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+77:22206:x1872519648750720:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1785774989.387516:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22206:x1872519648750720:12345-192.168.202.31@tcp:35:bash.0 Request processed in 236us (528us total) trans 4294968803 rc 0/0 00000100:00100000:3.0:1785774989.387523:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5337 00000100:00100000:3.0:1785774989.396602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.399491:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648750848 00000100:00100000:0.0:1785774989.399503:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648750848 00000100:00100000:0.0:1785774989.399573:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24358 00000100:00100000:0.0:1785774989.399583:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22206:x1872519648750848:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:0.0:1785774989.399732:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22206:x1872519648750848:12345-192.168.202.31@tcp:44:bash.0 Request processed in 150us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.399740:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24358 00000100:00100000:2.0:1785774989.414110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.414184:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648751104 00000100:00100000:1.0:1785774989.414194:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648751104 00000100:00100000:1.0:1785774989.414252:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24359 00000100:00100000:1.0:1785774989.414262:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+78:22206:x1872519648751104:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774989.414283:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774989.414305:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bc2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cad7 expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.414412:0:21784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a2bc9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.414427:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a2bc9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.414439:0:21784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a2bc9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774989.414449:0:21784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ab:0x0]: returning size 7 00010000:00010000:1.0:1785774989.414539:0:21784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bc2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cad7 expref: 81 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.414555:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a2bc9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cad7 expref: 80 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.414564:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:1.0:1785774989.414567:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774989.414570:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9dc00, rc 0) 00000100:00100000:1.0:1785774989.414626:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22206:x1872519648751104:12345-192.168.202.31@tcp:101:bash.0 Request processed in 365us (524us total) trans 4294968804 rc 0/0 00000100:00100000:1.0:1785774989.414632:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24359 00000100:00100000:2.0:1785774989.430789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.430887:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648751360 00000100:00100000:1.0:1785774989.430897:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648751360 00000100:00100000:1.0:1785774989.430950:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24360 00000100:00100000:1.0:1785774989.430959:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+80:22206:x1872519648751360:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774989.431011:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1785774989.431044:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a2bc9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cad7 expref: 80 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.431064:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76045e8000/0x7b7109e1d0a1fc1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6d2 expref: 79 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.431073:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:1.0:1785774989.431077:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774989.431324:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.431337:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.431346:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774989.431380:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968805 00000004:00010000:1.0:1785774989.431413:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074601ea4 reply state 00000000ec786b2a transno 4294968806 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.431424:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.431429:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:1.0:1785774989.431432:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774989.431434:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774989.431505:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:22206:x1872519648751360:12345-192.168.202.31@tcp:36:bash.0 Request processed in 547us (724us total) trans 4294968806 rc 0/0 00000100:00100000:1.0:1785774989.431512:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24360 00000020:00080000:1.0:1785774989.431516:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785774989.435764:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.435842:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648751488 00000100:00100000:0.0:1785774989.435851:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648751488 00000100:00100000:0.0:1785774989.435913:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24361 00000100:00100000:0.0:1785774989.435923:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+81:22206:x1872519648751488:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774989.435943:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774989.435959:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2bde lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cade expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.436015:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2bde lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cade expref: 82 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.436029:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155000/0x7b7109e1d0a2bde lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cade expref: 82 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.436058:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:0.0:1785774989.436061:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785774989.436065:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155000, rc 0) 00000100:00100000:0.0:1785774989.436115:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:22206:x1872519648751488:12345-192.168.202.31@tcp:101:bash.0 Request processed in 194us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.436122:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24361 00000100:00100000:0.0:1785774989.444265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774989.444357:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648751616 00000100:00100000:2.0:1785774989.444365:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648751616 00002000:00010000:2.0:1785774989.444410:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/10 (0->18446744073709551615) 00002000:00100000:2.0:1785774989.444415:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b79500 with x1872519648751616 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774989.444426:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7741b79500. 00000100:00100000:2.0:1785774989.444455:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 120 00000100:00100000:2.0:1785774989.444464:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648751616:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:2.0:1785774989.444682:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774989.444686:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1785774988 00002000:00010000:2.0:1785774989.444688:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774989.444690:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1785774988 00002000:00010000:2.0:1785774989.444692:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774989.444935:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648751616:12345-192.168.202.31@tcp:10:bash.0 Request processed in 470us (677us total) trans 4294969996 rc 0/0 00000100:00100000:2.0:1785774989.444942:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 120 00002000:00010000:2.0:1785774989.444945:0:8451:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/10 (0->18446744073709551615) 00002000:00100000:2.0:1785774989.444948:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7741b79500 with x1872519648751616 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774989.444952:0:8451:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7741b79500. 00000100:00100000:2.0:1785774989.457244:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.457376:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648751744 00000100:00100000:0.0:1785774989.457411:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648751744 00000100:00100000:0.0:1785774989.457466:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5450 00000100:00100000:0.0:1785774989.457475:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648751744:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774989.471341:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969996 is committed 00000100:00100000:0.0:1785774989.471832:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2417:x1872519648751744:12345-192.168.202.31@tcp:16:bash.0 Request processed in 14353us (14591us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.471843:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5450 00000100:00100000:3.0:1785774989.477339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.477587:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648752000 00000100:00100000:1.0:1785774989.477596:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648752000 00000100:00100000:1.0:1785774989.477653:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5338 00000100:00100000:1.0:1785774989.477664:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+82:22206:x1872519648752000:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1785774989.477888:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:22206:x1872519648752000:12345-192.168.202.31@tcp:35:bash.0 Request processed in 226us (556us total) trans 4294968807 rc 0/0 00000100:00100000:1.0:1785774989.477896:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5338 00000100:00100000:0.0:1785774989.478349:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671391616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1785774989.478405:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774989.478475:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671391616 00000100:00100000:0.0:1785774989.478480:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671391616 00000100:00100000:0.0:1785774989.478508:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:0.0:1785774989.478515:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671391616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1785774989.478534:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445052416 avail 1298812928 00000100:00100000:0.0:1785774989.478571:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671391616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.478577:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00000100:00100000:0.0:1785774989.478620:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671391616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1785774989.479519:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785774989.479529:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671391744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1785774989.479560:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774989.481851:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671391744 00000100:00100000:2.0:1785774989.481868:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671391744 00000100:00100000:2.0:1785774989.481928:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1785774989.481936:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671391744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774989.481959:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218216128 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1785774989.482017:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671391744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774989.482024:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1785774989.482082:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760307d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671391744:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1785774989.482452:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785774989.486321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.486418:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648752128 00000100:00100000:1.0:1785774989.486426:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648752128 00000100:00100000:1.0:1785774989.486481:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24362 00000100:00100000:1.0:1785774989.486491:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:22206:x1872519648752128:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774989.486622:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:22206:x1872519648752128:12345-192.168.202.31@tcp:44:bash.0 Request processed in 132us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.486630:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24362 00000100:00100000:2.0:1785774989.503876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.503945:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648752384 00000100:00100000:1.0:1785774989.503953:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648752384 00000100:00100000:1.0:1785774989.504017:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24363 00000100:00100000:1.0:1785774989.504028:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+83:22206:x1872519648752384:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1785774989.504059:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774989.504080:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a2be5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cae5 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.504223:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2bec lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.504238:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2bec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.504873:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2bec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774989.504888:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ac:0x0]: returning size 7 00010000:00010000:0.0:1785774989.506402:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9dc00/0x7b7109e1d0a2be5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cae5 expref: 86 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.506424:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2bec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cae5 expref: 85 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.506434:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:0.0:1785774989.506437:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774989.506440:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ce00, rc 0) 00000100:00100000:0.0:1785774989.506506:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:22206:x1872519648752384:12345-192.168.202.31@tcp:101:bash.0 Request processed in 2479us (2635us total) trans 4294968808 rc 0/0 00000100:00100000:0.0:1785774989.506514:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24363 00000100:00100000:3.0:1785774989.522929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.523120:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648752640 00000100:00100000:0.0:1785774989.523129:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648752640 00000100:00100000:0.0:1785774989.523217:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24364 00000100:00100000:0.0:1785774989.523227:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+85:22206:x1872519648752640:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:0.0:1785774989.523286:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1785774989.523312:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2bec lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cae5 expref: 85 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.523333:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a1fe4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6d9 expref: 84 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.523342:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:0.0:1785774989.523347:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785774989.523509:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.523522:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.523531:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785774989.523564:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968809 00000004:00010000:0.0:1785774989.523584:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001141f129 reply state 0000000002fd40da transno 4294968810 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.523596:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.523603:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:0.0:1785774989.523605:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1785774989.523608:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785774989.523692:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:22206:x1872519648752640:12345-192.168.202.31@tcp:36:bash.0 Request processed in 466us (770us total) trans 4294968810 rc 0/0 00000100:00100000:0.0:1785774989.523699:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24364 00000020:00080000:0.0:1785774989.523704:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774989.527444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.527526:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648752768 00000100:00100000:3.0:1785774989.527535:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648752768 00000100:00100000:3.0:1785774989.527583:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24365 00000100:00100000:3.0:1785774989.527592:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+86:22206:x1872519648752768:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774989.527612:0:21784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774989.527629:0:21784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a2c01 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259caec expref: -99 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.527677:0:21784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a2c01 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caec expref: 87 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.527693:0:21784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf400/0x7b7109e1d0a2c01 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caec expref: 87 pid: 21784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.527710:0:21784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:3.0:1785774989.527713:0:21784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785774989.527716:0:21784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cf400, rc 0) 00000100:00100000:3.0:1785774989.527777:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:22206:x1872519648752768:12345-192.168.202.31@tcp:101:bash.0 Request processed in 186us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774989.527785:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24365 00000100:00100000:2.0:1785774989.548021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.548197:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648752896 00000100:00100000:3.0:1785774989.548207:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648752896 00002000:00010000:3.0:1785774989.548258:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/11 (0->18446744073709551615) 00002000:00100000:3.0:1785774989.548263:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307f480 with x1872519648752896 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774989.548276:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760307f480. 00000100:00100000:3.0:1785774989.548307:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 121 00000100:00100000:3.0:1785774989.548317:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648752896:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:3.0:1785774989.548568:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785774989.548572:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1785774988 00002000:00010000:3.0:1785774989.548574:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785774989.548577:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1785774988 00002000:00010000:3.0:1785774989.548579:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1785774989.548634:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2419:x1872519648752896:12345-192.168.202.31@tcp:10:bash.0 Request processed in 319us (623us total) trans 4294970032 rc 0/0 00000100:00100000:3.0:1785774989.548641:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 121 00002000:00010000:3.0:1785774989.548644:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/11 (0->18446744073709551615) 00002000:00100000:3.0:1785774989.548647:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760307f480 with x1872519648752896 ext(0->18446744073709551615) 00002000:00010000:3.0:1785774989.548651:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760307f480. 00000100:00100000:2.0:1785774989.555142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.555402:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648753024 00000100:00100000:1.0:1785774989.555412:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648753024 00000100:00100000:1.0:1785774989.555472:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5451 00000100:00100000:1.0:1785774989.555482:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2418:x1872519648753024:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:3.0:1785774989.558022:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970032 is committed 00000100:00100000:1.0:1785774989.558255:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648753024:12345-192.168.202.31@tcp:16:bash.0 Request processed in 2763us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.558264:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5451 00000100:00100000:2.0:1785774989.563352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.563448:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648753280 00000100:00100000:0.0:1785774989.563457:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648753280 00000100:00100000:0.0:1785774989.563515:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5339 00000100:00100000:0.0:1785774989.563524:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+87:22206:x1872519648753280:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:0.0:1785774989.563721:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760307e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22206:x1872519648753280:12345-192.168.202.31@tcp:35:bash.0 Request processed in 198us (376us total) trans 4294968811 rc 0/0 00000100:00100000:0.0:1785774989.563729:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5339 00000100:00100000:2.0:1785774989.593107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.593460:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648753408 00000100:00100000:3.0:1785774989.593470:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648753408 00000100:00100000:3.0:1785774989.593524:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24366 00000100:00100000:3.0:1785774989.593533:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22206:x1872519648753408:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:3.0:1785774989.593662:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22206:x1872519648753408:12345-192.168.202.31@tcp:44:bash.0 Request processed in 130us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774989.593668:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24366 00000100:00100000:2.0:1785774989.622649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774989.622763:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648753664 00000100:00100000:0.0:1785774989.622772:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648753664 00000100:00100000:0.0:1785774989.622833:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24367 00000100:00100000:0.0:1785774989.622843:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+88:22206:x1872519648753664:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1785774989.622876:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774989.622899:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155c00/0x7b7109e1d0a2c08 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259caf3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.623305:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2c0f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.623321:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2c0f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.623334:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2c0f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774989.623345:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ad:0x0]: returning size 7 00010000:00010000:0.0:1785774989.623459:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155c00/0x7b7109e1d0a2c08 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caf3 expref: 91 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.623479:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2c0f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caf3 expref: 90 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774989.623487:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:0.0:1785774989.623490:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785774989.623494:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606155a00, rc 0) 00000100:00100000:0.0:1785774989.623552:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:22206:x1872519648753664:12345-192.168.202.31@tcp:101:bash.0 Request processed in 711us (912us total) trans 4294968812 rc 0/0 00000100:00100000:0.0:1785774989.623558:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24367 00000100:00100000:2.0:1785774989.630129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.631660:0:19895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648753792 00000100:00100000:1.0:1785774989.631673:0:19895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648753792 00000100:00100000:1.0:1785774989.631751:0:19895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1566 00000100:00100000:1.0:1785774989.631760:0:19895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+90:2418:x1872519648753792:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774989.631776:0:19895:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774989.631800:0:19895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606155a00/0x7b7109e1d0a2c0f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259caf3 expref: 90 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.631818:0:19895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:1.0:1785774989.631823:0:19895:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774989.631886:0:19895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:2418:x1872519648753792:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 127us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.631897:0:19895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1566 00000100:00100000:2.0:1785774989.663776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.663925:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648754048 00000100:00100000:1.0:1785774989.663934:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648754048 00000100:00100000:1.0:1785774989.664002:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24368 00000100:00100000:1.0:1785774989.664013:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+89:22206:x1872519648754048:12345-192.168.202.31@tcp:36:bash.0 00010000:00010000:1.0:1785774989.664074:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774989.664103:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7711745c00/0x7b7109e1d0a2007 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259c6e0 expref: 89 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.664124:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:1.0:1785774989.664129:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785774989.664350:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.664364:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.664372:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785774989.664421:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968813 00000004:00010000:1.0:1785774989.664444:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dedfb2d6 reply state 00000000631fd676 transno 4294968814 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.664457:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774989.664463:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:1.0:1785774989.664466:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1785774989.664470:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785774989.664561:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+91:22206:x1872519648754048:12345-192.168.202.31@tcp:36:bash.0 Request processed in 550us (793us total) trans 4294968814 rc 0/0 00000100:00100000:1.0:1785774989.664567:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24368 00000020:00080000:1.0:1785774989.664572:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774989.669281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774989.669403:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648754176 00000100:00100000:3.0:1785774989.669412:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648754176 00000100:00100000:3.0:1785774989.669469:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24369 00000100:00100000:3.0:1785774989.669480:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+91:22206:x1872519648754176:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1785774989.669502:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774989.669520:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2c24 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cafa expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.669570:0:8627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2c24 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cafa expref: 92 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.669587:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cee00/0x7b7109e1d0a2c24 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cafa expref: 92 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774989.669602:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:3.0:1785774989.669605:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785774989.669608:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cee00, rc 0) 00000100:00100000:3.0:1785774989.669659:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:22206:x1872519648754176:12345-192.168.202.31@tcp:101:bash.0 Request processed in 181us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774989.669666:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24369 00000100:00100000:3.0:1785774989.675318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.675513:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648754304 00000100:00100000:1.0:1785774989.675522:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648754304 00002000:00010000:1.0:1785774989.675562:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/11 (0->18446744073709551615) 00002000:00100000:1.0:1785774989.675567:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603081c00 with x1872519648754304 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774989.675579:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7603081c00. 00000100:00100000:1.0:1785774989.675614:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 122 00000100:00100000:1.0:1785774989.675623:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2418:x1872519648754304:12345-192.168.202.31@tcp:10:bash.0 00002000:00010000:1.0:1785774989.675905:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785774989.675909:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1785774988 00002000:00010000:1.0:1785774989.675911:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785774989.675913:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1785774988 00002000:00010000:1.0:1785774989.675915:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1785774989.676193:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2418:x1872519648754304:12345-192.168.202.31@tcp:10:bash.0 Request processed in 537us (849us total) trans 4294969997 rc 0/0 00000100:00100000:1.0:1785774989.676202:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 122 00002000:00010000:1.0:1785774989.676205:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/11 (0->18446744073709551615) 00002000:00100000:1.0:1785774989.676208:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7603081c00 with x1872519648754304 ext(0->18446744073709551615) 00002000:00010000:1.0:1785774989.676212:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7603081c00. 00000100:00100000:2.0:1785774989.740020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.740648:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648754432 00000100:00100000:1.0:1785774989.740658:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648754432 00000100:00100000:1.0:1785774989.740707:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5452 00000100:00100000:1.0:1785774989.740716:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2419:x1872519648754432:12345-192.168.202.31@tcp:16:bash.0 00000001:00080000:1.0:1785774989.752553:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969997 is committed 00000100:00100000:1.0:1785774989.752668:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2419:x1872519648754432:12345-192.168.202.31@tcp:16:bash.0 Request processed in 11947us (12652us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.752679:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5452 00000100:00100000:3.0:1785774989.789103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774989.789513:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648754688 00000100:00100000:2.0:1785774989.789523:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648754688 00000100:00100000:2.0:1785774989.789579:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5340 00000100:00100000:2.0:1785774989.789590:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+92:22206:x1872519648754688:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1785774989.789816:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:22206:x1872519648754688:12345-192.168.202.31@tcp:35:bash.0 Request processed in 227us (719us total) trans 4294968815 rc 0/0 00000100:00100000:2.0:1785774989.789824:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5340 00000100:00100000:3.0:1785774989.798569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774989.798807:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648754816 00000100:00100000:1.0:1785774989.798817:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648754816 00000100:00100000:1.0:1785774989.798885:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24370 00000100:00100000:1.0:1785774989.798896:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:22206:x1872519648754816:12345-192.168.202.31@tcp:44:bash.0 00000100:00100000:1.0:1785774989.799022:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:22206:x1872519648754816:12345-192.168.202.31@tcp:44:bash.0 Request processed in 128us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774989.799043:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24370 00000100:00100000:3.0:1785774989.991194:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671391872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785774989.991463:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774989.993698:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671391872 00000100:00100000:0.0:1785774989.993708:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671391872 00000100:00100000:0.0:1785774989.993768:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1785774989.993777:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671391872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785774989.993801:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218216128 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1785774989.993870:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671391872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774989.993877:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1785774989.993925:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671391872:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1785774989.995113:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1785774990.116277:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774990.346122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774990.348269:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648755072 00000100:00100000:3.0:1785774990.348281:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648755072 00000100:00100000:3.0:1785774990.348350:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24371 00000100:00100000:3.0:1785774990.348361:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+93:22448:x1872519648755072:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774990.348393:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774990.348423:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2c2b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb01 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.348528:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.348541:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.348553:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.348567:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.348573:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.348579:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.349857:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.349871:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.349881:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785774990.349891:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00010000:00010000:3.0:1785774990.349917:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.349925:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.349931:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.349938:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.349945:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057cf800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.349950:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.350052:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.350065:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:3.0:1785774990.350068:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.350073:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.350080:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cf800/0x7b7109e1d0a2c32 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785774990.350094:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9dbae7b reply state 00000000ffc3dabe transno 4294968816 ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.350104:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.350111:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff9b76032ee200) 00010000:00010000:3.0:1785774990.350114:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774990.350116:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785774990.350150:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2c2b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 96 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.353088:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 95 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.353110:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032ee000) 00010000:00010000:3.0:1785774990.353113:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785774990.353117:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057ce400, rc 0) 00000100:00100000:3.0:1785774990.357489:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:22448:x1872519648755072:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 9120us (11366us total) trans 4294968816 rc 0/0 00000100:00100000:3.0:1785774990.357501:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24371 00000100:00100000:0.0:1785774990.389792:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774990.394206:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648755328 00000100:00100000:0.0:1785774990.394220:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648755328 00000100:00100000:0.0:1785774990.394276:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24372 00000100:00100000:0.0:1785774990.394285:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:22448:x1872519648755328:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774990.394323:0:8627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774990.394343:0:8627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a2c4e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb08 expref: -99 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.394681:0:8627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.394697:0:8627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 97 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.394704:0:8627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.395513:0:8627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 97 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.395529:0:8627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 97 pid: 6529 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785774990.395542:0:8627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b760471e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671392000:192.168.202.31@tcp:104: 00000100:00100000:0.0:1785774990.395639:0:8627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b7603f393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785774990.407522:0:8627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b760471e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:8627:1872519671392000:192.168.202.31@tcp:104: 00010000:00010000:0.0:1785774990.407552:0:8627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774990.420269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774990.420311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648755456 00000100:00100000:1.0:1785774990.420321:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648755456 00010000:00010000:1.0:1785774990.420363:0:6514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 98 pid: 6529 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785774990.420430:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1686 00000100:00100000:1.0:1785774990.420440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:2416:x1872519648755456:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785774990.420458:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785774990.420465:0:6514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 98 pid: 6529 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.420478:0:6514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 98 pid: 6529 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.420502:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce400/0x7b7109e1d0a2c40 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb01 expref: 98 pid: 6529 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.420518:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032ee000) 00010000:00010000:1.0:1785774990.420523:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.420533:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.420539:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.420573:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785774990.420622:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:2416:x1872519648755456:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 183us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774990.420642:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1686 00010000:00010000:1.0:1785774990.421186:0:8627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421194:0:8627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774990.421210:0:8627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00000004:00080000:1.0:1785774990.421364:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd:0x0], index 0: 0 00000004:00080000:1.0:1785774990.421370:0:8627:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc:0x0], index 1: 0 00010000:00010000:1.0:1785774990.421473:0:8627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421485:0:8627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421491:0:8627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421496:0:8627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774990.421500:0:8627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421506:0:8627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421515:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032ee000) 00010000:00010000:1.0:1785774990.421517:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785774990.421520:0:8627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421525:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154e00/0x7b7109e1d0a2c55 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8627 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421571:0:8627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a2c4e lrc: 1/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb08 expref: 97 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421579:0:8627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:1.0:1785774990.421581:0:8627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774990.421584:0:8627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154800/0x7b7109e1d0a2c4e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb08 expref: 97 pid: 8627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.421593:0:8627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154800, rc 0) 00000100:00100000:1.0:1785774990.421619:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:22448:x1872519648755328:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 27335us (31837us total) trans 4294968817 rc 301/301 00000100:00100000:1.0:1785774990.421626:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24372 00000100:00100000:0.0:1785774990.436516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774990.436588:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648755712 00000100:00100000:1.0:1785774990.436599:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648755712 00000100:00100000:1.0:1785774990.436661:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5341 00000100:00100000:1.0:1785774990.436671:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+96:22448:x1872519648755712:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1785774990.436950:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:22448:x1872519648755712:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 279us (442us total) trans 4294968818 rc 0/0 00000100:00100000:1.0:1785774990.436958:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5341 00000100:00100000:2.0:1785774990.442834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774990.443121:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648755840 00000100:00100000:3.0:1785774990.443131:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648755840 00000100:00100000:3.0:1785774990.443209:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24373 00000100:00100000:3.0:1785774990.443220:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+97:22448:x1872519648755840:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1785774990.443244:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785774990.443267:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2c63 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.443323:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2c63 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb0f expref: 98 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.443340:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057cfc00/0x7b7109e1d0a2c63 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb0f expref: 98 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.443358:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032eed00) 00010000:00010000:3.0:1785774990.443362:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785774990.443365:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76057cfc00, rc 0) 00000100:00100000:3.0:1785774990.443436:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:22448:x1872519648755840:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 218us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774990.443446:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24373 00000100:00100000:3.0:1785774990.462478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774990.462599:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648756096 00000100:00100000:0.0:1785774990.462608:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648756096 00000100:00100000:0.0:1785774990.462663:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5342 00000100:00100000:0.0:1785774990.462674:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+98:22448:x1872519648756096:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1785774990.462900:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:22448:x1872519648756096:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 227us (430us total) trans 4294968819 rc 0/0 00000100:00100000:0.0:1785774990.462908:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5342 00000100:00100000:3.0:1785774990.467472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774990.467609:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648756224 00000100:00100000:0.0:1785774990.467617:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648756224 00000100:00100000:0.0:1785774990.467666:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24374 00000100:00100000:0.0:1785774990.467675:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+99:22448:x1872519648756224:12345-192.168.202.31@tcp:44:lfs.0 00000001:00080000:0.0:1785774990.470389:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968819 is committed 00000100:00100000:0.0:1785774990.470602:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22448:x1872519648756224:12345-192.168.202.31@tcp:44:lfs.0 Request processed in 2923us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774990.470612:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24374 00010000:00010000:3.0:1785774990.471198:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471210:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471217:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471224:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773faf7a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.471228:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471237:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471252:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9b7605fce800) 00010000:00010000:3.0:1785774990.471255:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.471260:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471267:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2b28 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471283:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471288:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471294:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471299:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773faf6200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.471302:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471308:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471315:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9b7605fcee00) 00010000:00010000:3.0:1785774990.471318:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.471320:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471326:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6200/0x7b7109e1d0a2b4b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471336:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471342:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471347:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471352:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.471355:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471364:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471385:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9b7605dfe200) 00010000:00010000:3.0:1785774990.471388:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.471391:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471397:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045200/0x7b7109e1d0a2b6e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471507:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471513:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471519:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471523:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742044a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.471526:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471532:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471540:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9b77131b5300) 00010000:00010000:3.0:1785774990.471542:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.471545:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471554:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742044a00/0x7b7109e1d0a2b91 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471567:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471572:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471577:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471581:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7742045000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.471583:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471588:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471595:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9b7605fce400) 00010000:00010000:3.0:1785774990.471597:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.471599:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471604:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7742045000/0x7b7109e1d0a2bb4 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21784 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471614:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471620:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471627:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471633:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.471635:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471641:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471647:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9b7605dfee00) 00010000:00010000:3.0:1785774990.471649:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.471652:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471658:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2bd7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471668:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471674:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471680:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471685:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7606154200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.471688:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471697:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.471707:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9b7711ae8000) 00010000:00010000:3.0:1785774990.471709:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.475056:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.475076:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154200/0x7b7109e1d0a2bfa lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.475339:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.475347:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.475354:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.475360:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.475364:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.475387:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.477149:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9b7605fce900) 00010000:00010000:3.0:1785774990.477325:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.477333:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.477346:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c1d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.477368:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.477385:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.477390:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.477396:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76057ce800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774990.477399:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.478145:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.478525:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff9b76032ee200) 00010000:00010000:3.0:1785774990.478529:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774990.478533:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.478539:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b76057ce800/0x7b7109e1d0a2c39 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774990.562866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774990.570579:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648756480 00000100:00100000:0.0:1785774990.570591:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648756480 00000100:00100000:1.0:1785774990.587627:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24375 00000100:00100000:1.0:1785774990.587641:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22449:x1872519648756480:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1785774990.587668:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774990.587688:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a2c6a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb16 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588571:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588585:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588596:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588609:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588618:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588624:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588678:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588683:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588688:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588693:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588698:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774990.588702:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.588708:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590808:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:1.0:1785774990.590813:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774990.590818:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590827:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2c71 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590844:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590851:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590857:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590863:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774990.590866:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590873:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590880:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774990.590883:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774990.590886:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590893:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2c78 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590936:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a2c6a lrc: 1/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb16 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590947:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:1.0:1785774990.590950:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785774990.590954:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a2c6a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb16 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.590965:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9da00, rc 0) 00000100:00100000:1.0:1785774990.591050:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22449:x1872519648756480:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 3411us (28192us total) trans 0 rc 301/301 00000100:00100000:1.0:1785774990.591058:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24375 00000100:00100000:3.0:1785774990.599036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774990.601081:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648756736 00000100:00100000:0.0:1785774990.601094:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648756736 00000100:00100000:0.0:1785774990.601183:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24376 00000100:00100000:0.0:1785774990.601194:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+54:22449:x1872519648756736:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1785774990.601214:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774990.601248:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2c7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb1d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785774990.601355:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 4096 00010000:00010000:0.0:1785774990.601866:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2c7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb1d expref: 56 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.601881:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7605dfd000) 00010000:00010000:0.0:1785774990.601884:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785774990.601889:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7606154000/0x7b7109e1d0a2c7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb1d expref: 56 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.601907:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154000, rc 0) 00000100:00100000:0.0:1785774990.601973:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:22449:x1872519648756736:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 781us (2956us total) trans 4294968820 rc 301/301 00000100:00100000:0.0:1785774990.601980:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24376 00000100:00100000:2.0:1785774990.636336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774990.636384:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648756864 00000100:00100000:2.0:1785774990.636393:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648756864 00000100:00100000:2.0:1785774990.636447:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24377 00000100:00100000:2.0:1785774990.636456:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:22449:x1872519648756864:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1785774990.636525:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636540:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636551:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636564:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636569:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636576:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636627:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636633:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636639:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785774990.636681:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00000004:00200000:2.0:1785774990.636685:0:6529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1785774990.636697:0:6529:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636721:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636729:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636735:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636742:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636749:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773faf7a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774990.636755:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636763:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636778:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:2.0:1785774990.636782:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774990.636786:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636793:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7a00/0x7b7109e1d0a2c8d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636812:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636819:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636826:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636832:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773faf7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774990.636835:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636841:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636849:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff9b77199f5100) 00010000:00010000:2.0:1785774990.636851:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774990.636854:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636861:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2c94 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636873:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636879:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636885:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636891:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773faf6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1785774990.636894:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636900:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636907:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032eed00) 00010000:00010000:2.0:1785774990.636909:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785774990.636912:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.636917:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf6400/0x7b7109e1d0a2c9b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785774990.636984:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:22449:x1872519648756864:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 529us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774990.636992:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24377 00000100:00100000:2.0:1785774990.653254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774990.654924:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648757120 00000100:00100000:2.0:1785774990.654936:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648757120 00000100:00100000:2.0:1785774990.654993:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5343 00000100:00100000:2.0:1785774990.655003:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:22449:x1872519648757120:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1785774990.659568:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22449:x1872519648757120:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 4556us (6313us total) trans 4294968821 rc 0/0 00000100:00100000:2.0:1785774990.659580:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5343 00000100:00100000:2.0:1785774990.808435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774990.808992:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648757376 00000100:00100000:1.0:1785774990.809002:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648757376 00000100:00100000:1.0:1785774990.809075:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24378 00000100:00100000:1.0:1785774990.809086:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+56:22452:x1872519648757376:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774990.809110:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774990.809132:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a2ca2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb24 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809280:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809296:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809307:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809322:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809329:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809334:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809589:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a2cb7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809600:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a2cb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809608:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a2cb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785774990.809620:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1d5:0x0]: returning size 0 00010000:00010000:1.0:1785774990.809694:0:8469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809701:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809706:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809715:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809720:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9d600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774990.809723:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809730:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809743:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9b77199f5800) 00010000:00010000:1.0:1785774990.809746:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774990.809750:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809755:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d600/0x7b7109e1d0a2ca9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809766:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809770:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809776:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809780:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603f9c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1785774990.809783:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809787:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809793:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0xdbd367d0 (ffff9b7605dfe000) 00010000:00010000:1.0:1785774990.809795:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785774990.809797:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809801:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9c800/0x7b7109e1d0a2cb0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809849:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9da00/0x7b7109e1d0a2ca2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb24 expref: 59 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809864:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a2cb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb24 expref: 58 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.809870:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032eed00) 00010000:00010000:1.0:1785774990.809872:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785774990.809875:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9cc00, rc 0) 00000100:00100000:1.0:1785774990.810601:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22452:x1872519648757376:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1516us (2172us total) trans 4294968822 rc 0/0 00000100:00100000:1.0:1785774990.810610:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24378 00000100:00100000:3.0:1785774990.822109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774990.822205:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648757504 00000100:00100000:1.0:1785774990.822214:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648757504 00000100:00100000:1.0:1785774990.822268:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24379 00000100:00100000:1.0:1785774990.822276:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+58:22452:x1872519648757504:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774990.822313:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774990.822333:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a2cc5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb2b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.822364:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2ccc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.822389:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2ccc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.822406:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2ccc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.822514:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9d800/0x7b7109e1d0a2cc5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb2b expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.822530:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9ce00/0x7b7109e1d0a2ccc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb2b expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.822538:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032eed00) 00010000:00010000:1.0:1785774990.822541:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785774990.822544:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9ce00, rc 0) 00000100:00100000:1.0:1785774990.822598:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:22452:x1872519648757504:12345-192.168.202.31@tcp:101:dd.0 Request processed in 323us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774990.822603:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24379 00000100:00100000:3.0:1785774990.853256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774990.853512:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648757760 00000100:00100000:2.0:1785774990.853522:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648757760 00000100:00100000:2.0:1785774990.853579:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24380 00000100:00100000:2.0:1785774990.853587:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+59:22452:x1872519648757760:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:2.0:1785774990.853649:0:6529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785774990.853674:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b7603f9cc00/0x7b7109e1d0a2cb7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb24 expref: 59 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.853693:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032eed00) 00010000:00010000:2.0:1785774990.853698:0:6529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785774990.854558:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.854572:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785774990.854582:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785774990.858028:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968823 00000004:00010000:3.0:1785774990.858083:0:6529:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005aadf1d5 reply state 00000000593792b0 transno 4294968824 ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.858102:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774990.858112:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032eed00) 00010000:00010000:3.0:1785774990.858116:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1785774990.858119:0:6529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785774990.858276:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:22452:x1872519648757760:12345-192.168.202.31@tcp:36:dd.0 Request processed in 4686us (5026us total) trans 4294968824 rc 0/0 00000100:00100000:3.0:1785774990.858283:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24380 00000020:00080000:3.0:1785774990.858288:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785774990.873307:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774990.873464:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648757888 00000100:00100000:0.0:1785774990.873474:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648757888 00000100:00100000:0.0:1785774990.874256:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5453 00000100:00100000:0.0:1785774990.874269:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22452:x1872519648757888:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1785774990.874287:0:8661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785774990.874310:0:8661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442e6f21/0x7b7109e1d0a2cda lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb32 expref: -99 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785774990.874336:0:8661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1785774990.874357:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:0.0:1785774990.874362:0:8661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785774990.874383:0:8661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442e6f21/0x7b7109e1d0a2cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb32 expref: 18 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.874413:0:8661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000442e6f21/0x7b7109e1d0a2cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb32 expref: 18 pid: 8661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785774990.874427:0:8661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7606154000, rc 0) 00000100:00100000:0.0:1785774990.874491:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:22452:x1872519648757888:12345-192.168.202.31@tcp:101:dd.0 Request processed in 225us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774990.874499:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5453 00000100:00100000:2.0:1785774990.894898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774990.895484:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758016 00000100:00100000:1.0:1785774990.895493:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758016 00000100:00100000:1.0:1785774990.895549:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5454 00000100:00100000:1.0:1785774990.895557:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:22452:x1872519648758016:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1785774990.895575:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785774990.895594:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a2ce1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x11643ea02259cb39 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785774990.895617:0:14725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1785774990.895644:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=1232s v=(0 0) 00010000:00010000:1.0:1785774990.895649:0:14725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785774990.895656:0:14725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a2ce1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb39 expref: 17 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.895673:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006a35650/0x7b7109e1d0a2ce1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x11643ea02259cb39 expref: 17 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785774990.895689:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603f9d800, rc 0) 00000100:00100000:1.0:1785774990.895742:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:22452:x1872519648758016:12345-192.168.202.31@tcp:101:dd.0 Request processed in 186us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774990.895749:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5454 00000100:00100000:3.0:1785774990.911028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774990.911251:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758144 00000100:00100000:2.0:1785774990.911261:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758144 00002000:00010000:2.0:1785774990.911298:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/13 (0->18446744073709551615) 00002000:00100000:2.0:1785774990.911303:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e00a80 with x1872519648758144 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774990.911314:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e00a80. 00000100:00100000:2.0:1785774990.911347:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 123 00000100:00100000:2.0:1785774990.911355:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648758144:12345-192.168.202.31@tcp:10:dd.0 00000100:00100000:3.0:1785774990.915063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774990.915365:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758272 00000100:00100000:0.0:1785774990.915407:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758272 00002000:00010000:0.0:1785774990.915444:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/12 (0->18446744073709551615) 00002000:00100000:0.0:1785774990.915449:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e03800 with x1872519648758272 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774990.915460:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604e03800. 00000100:00100000:0.0:1785774990.915491:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 124 00000100:00100000:0.0:1785774990.915501:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648758272:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:0.0:1785774990.915661:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785774990.915665:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1785774989 00002000:00010000:0.0:1785774990.915668:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1785774990.915670:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1785774989 00002000:00010000:0.0:1785774990.915673:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1785774990.915729:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648758272:12345-192.168.202.31@tcp:10:dd.0 Request processed in 229us (674us total) trans 4294969998 rc 0/0 00000100:00100000:0.0:1785774990.915737:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 124 00002000:00010000:0.0:1785774990.915741:0:8452:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/12 (0->18446744073709551615) 00002000:00100000:0.0:1785774990.915744:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e03800 with x1872519648758272 ext(0->18446744073709551615) 00002000:00010000:0.0:1785774990.915749:0:8452:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604e03800. 00002000:00010000:2.0:1785774990.924854:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785774990.924863:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1785774989 00002000:00010000:2.0:1785774990.924866:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785774990.924869:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1785774989 00002000:00010000:2.0:1785774990.924871:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1785774990.924954:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2417:x1872519648758144:12345-192.168.202.31@tcp:10:dd.0 Request processed in 13584us (13921us total) trans 4294970033 rc 0/0 00000100:00100000:2.0:1785774990.924965:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 123 00002000:00010000:2.0:1785774990.924971:0:8453:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/13 (0->18446744073709551615) 00002000:00100000:2.0:1785774990.924975:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e00a80 with x1872519648758144 ext(0->18446744073709551615) 00002000:00010000:2.0:1785774990.924982:0:8453:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e00a80. 00010000:00010000:2.0:1785774991.141983:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785774992.147097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774992.151057:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758400 00000100:00100000:1.0:1785774992.151073:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758400 00002000:00100000:1.0:1785774992.151261:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (0->3145727) req@ffff9b760471dc00 x1872519648758400/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/0 e 0 to 0 dl 1785775003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774992.151272:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471dc00 with x1872519648758400 ext(0->3145727) 00002000:00010000:1.0:1785774992.151279:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471dc00 00000100:00100000:1.0:1785774992.151316:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 125 00000100:00100000:1.0:1785774992.151325:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2419:x1872519648758400:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:3.0:1785774992.160605:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774992.161460:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774992.161797:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758528 00000100:00100000:1.0:1785774992.161807:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758528 00000100:00100000:1.0:1785774992.161868:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5455 00000100:00100000:1.0:1785774992.161878:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648758528:12345-192.168.202.31@tcp:16:kworker.0 00010000:00010000:0.0:1785774992.164744:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785774992.173805:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970033 is committed 00000100:00100000:2.0:1785774992.187814:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2417:x1872519648758528:12345-192.168.202.31@tcp:16:kworker.0 Request processed in 25923us (26344us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774992.187833:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5455 00000100:00100000:0.0:1785774992.245968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774992.246024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774992.246129:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758656 00000100:00100000:2.0:1785774992.246142:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758656 00002000:00100000:2.0:1785774992.246260:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->3145727) req@ffff9b760471d180 x1872519648758656/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/0 e 0 to 0 dl 1785775003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774992.246273:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d180 with x1872519648758656 ext(0->3145727) 00002000:00010000:2.0:1785774992.246281:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d180 00000100:00100000:2.0:1785774992.246314:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 126 00000100:00100000:2.0:1785774992.246325:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648758656:12345-192.168.202.31@tcp:4:dd.0 00000100:00080000:3.0:1785774992.250187:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774992.250683:0:14730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758784 00000100:00100000:1.0:1785774992.250697:0:14730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758784 00000100:00100000:1.0:1785774992.250781:0:14730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5456 00000100:00100000:1.0:1785774992.250794:0:14730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648758784:12345-192.168.202.31@tcp:16:kworker.0 00000001:00080000:3.0:1785774992.258524:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969998 is committed 00000100:00100000:1.0:1785774992.259606:0:14730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648758784:12345-192.168.202.31@tcp:16:kworker.0 Request processed in 8806us (13572us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774992.259626:0:14730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5456 00000100:00100000:1.0:1785774992.275921:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2419:x1872519648758400:12345-192.168.202.31@tcp:4:dd.0 Request processed in 124578us (128814us total) trans 4294970034 rc 0/0 00000100:00100000:1.0:1785774992.275940:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 125 00002000:00100000:1.0:1785774992.275959:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (0->3145727) req@ffff9b760471dc00 x1872519648758400/t4294970034(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/448 e 0 to 0 dl 1785775003 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774992.275972:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471dc00 with x1872519648758400 ext(0->3145727) 00002000:00010000:1.0:1785774992.275982:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b760471dc00 00000100:00100000:3.0:1785774992.289775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774992.290036:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648758912 00000100:00100000:2.0:1785774992.290048:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648758912 00002000:00100000:2.0:1785774992.290108:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (3145728->4194303) req@ffff9b7604e03b80 x1872519648758912/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/0 e 0 to 0 dl 1785775003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774992.290122:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e03b80 with x1872519648758912 ext(3145728->4194303) 00002000:00010000:2.0:1785774992.290129:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e03b80 00000100:00100000:2.0:1785774992.290196:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 127 00000100:00100000:2.0:1785774992.290207:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648758912:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1785774992.296590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774992.304636:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759040 00000100:00100000:1.0:1785774992.304657:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759040 00000100:00100000:1.0:1785774992.304754:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5457 00000100:00100000:1.0:1785774992.304767:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2416:x1872519648759040:12345-192.168.202.31@tcp:16:kworker.0 00000001:00080000:3.0:1785774992.307745:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970034 is committed 00000100:00100000:1.0:1785774992.308010:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648759040:12345-192.168.202.31@tcp:16:kworker.0 Request processed in 3232us (11420us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774992.308023:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5457 00000100:00100000:1.0:1785774992.408691:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760471d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2416:x1872519648758656:12345-192.168.202.31@tcp:4:dd.0 Request processed in 162349us (162716us total) trans 4294969999 rc 0/0 00000100:00100000:1.0:1785774992.408710:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 126 00002000:00100000:1.0:1785774992.408727:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->3145727) req@ffff9b760471d180 x1872519648758656/t4294969999(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/448 e 0 to 0 dl 1785775003 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774992.408739:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b760471d180 with x1872519648758656 ext(0->3145727) 00002000:00010000:1.0:1785774992.408747:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b760471d180 00000100:00100000:3.0:1785774992.430762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774992.430969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774992.434470:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759296 00000100:00100000:0.0:1785774992.434489:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759296 00002000:00100000:0.0:1785774992.434566:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (3145728->4194303) req@ffff9b7604e03480 x1872519648759296/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/0 e 0 to 0 dl 1785775003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774992.434579:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e03480 with x1872519648759296 ext(3145728->4194303) 00002000:00010000:0.0:1785774992.434587:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604e03480 00000100:00100000:0.0:1785774992.434645:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 128 00000100:00100000:0.0:1785774992.434657:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648759296:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:1.0:1785774992.436318:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759168 00000100:00100000:1.0:1785774992.436327:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759168 00000100:00100000:1.0:1785774992.436392:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5458 00000100:00100000:1.0:1785774992.436401:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:2416:x1872519648759168:12345-192.168.202.31@tcp:16:kworker.0 00000100:00100000:2.0:1785774992.459516:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648758912:12345-192.168.202.31@tcp:4:dd.0 Request processed in 169293us (169739us total) trans 4294970035 rc 0/0 00000100:00100000:2.0:1785774992.459536:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 127 00002000:00100000:2.0:1785774992.459554:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (3145728->4194303) req@ffff9b7604e03b80 x1872519648758912/t4294970035(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/448 e 0 to 0 dl 1785775003 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774992.459565:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e03b80 with x1872519648758912 ext(3145728->4194303) 00002000:00010000:2.0:1785774992.459575:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b7604e03b80 00000001:00080000:0.0:1785774992.490059:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969999 is committed 00000100:00100000:1.0:1785774992.491016:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648759168:12345-192.168.202.31@tcp:16:kworker.0 Request processed in 54604us (60256us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774992.491032:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5458 00000100:00100000:0.0:1785774992.491102:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648759296:12345-192.168.202.31@tcp:4:dd.0 Request processed in 56442us (60126us total) trans 4294970000 rc 0/0 00000100:00100000:0.0:1785774992.491123:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 128 00002000:00100000:0.0:1785774992.491151:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (3145728->4194303) req@ffff9b7604e03480 x1872519648759296/t4294970000(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:683/0 lens 488/448 e 0 to 0 dl 1785775003 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785774992.491218:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7604e03480 with x1872519648759296 ext(3145728->4194303) 00002000:00010000:0.0:1785774992.491226:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7604e03480 00000100:00100000:0.0:1785774992.548551:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785774992.548588:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671392128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1785774992.548679:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774992.549937:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671392640:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.550072:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774992.550091:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671392384:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.550142:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785774992.556366:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671392128 00000100:00100000:1.0:1785774992.556387:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671392128 00000100:00100000:1.0:1785774992.556493:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671392640 00000100:00100000:1.0:1785774992.556497:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671392640 00000100:00100000:1.0:1785774992.556529:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:1.0:1785774992.556544:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671392128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1785774992.556608:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443889152 avail 1297649664 00000100:00100000:3.0:1785774992.557228:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671393152:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.557300:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774992.557333:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671393664:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.557367:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774992.557393:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1785774992.557399:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671392512:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.557427:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774992.557459:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671393024:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.557481:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774992.557500:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671393536:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.557520:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774992.557696:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393152 00000100:00100000:3.0:1785774992.557701:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393152 00000100:00100000:3.0:1785774992.557746:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393664 00000100:00100000:3.0:1785774992.557749:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393664 00000100:00100000:3.0:1785774992.557770:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393024 00000100:00100000:3.0:1785774992.557773:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393024 00000100:00100000:3.0:1785774992.557792:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393536 00000100:00100000:3.0:1785774992.557794:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393536 00000100:00100000:3.0:1785774992.557930:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1785774992.557939:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671393152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.557991:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671393152:12345-0@lo:400:kworker.0 Request processed in 52us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774992.557998:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1785774992.558077:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:3.0:1785774992.558084:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671393664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.558114:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671393664:12345-0@lo:400:kworker.0 Request processed in 31us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774992.558121:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:3.0:1785774992.558133:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1785774992.558139:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671393024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.558188:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671393024:12345-0@lo:400:kworker.0 Request processed in 49us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774992.558194:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1785774992.558205:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1785774992.558210:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671393536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.559341:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671393536:12345-0@lo:400:kworker.0 Request processed in 1127us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774992.559349:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00080000:3.0:1785774992.559386:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785774992.559391:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785774992.559428:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671393024:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.563917:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671393536:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.563937:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76044b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671393152:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.563940:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1785774992.563955:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671393664:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.563980:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671392640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.564104:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671392640:12345-0@lo:400:kworker.0 Request processed in 143us (14032us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774992.564120:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1785774992.564149:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671392640:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.564210:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671392384 00000100:00100000:0.0:1785774992.564221:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671392384 00000100:00100000:0.0:1785774992.564309:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671392512 00000100:00100000:0.0:1785774992.564313:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671392512 00000100:00100000:0.0:1785774992.564340:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1785774992.564347:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671392384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.564401:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1872519671392384:12345-0@lo:400:kworker.0 Request processed in 53us (14261us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774992.564407:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1785774992.564421:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1785774992.564432:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671392512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.564622:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1872519671392512:12345-0@lo:400:kworker.0 Request processed in 195us (7193us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774992.564627:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1785774992.564717:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1872519671392512:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.564861:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1872519671392384:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.564880:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671392896:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.564941:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774992.564988:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671392896 00000100:00100000:0.0:1785774992.564994:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671393408:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.564998:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671392896 00000100:00100000:0.0:1785774992.565028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774992.565070:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393408 00000100:00100000:0.0:1785774992.565074:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393408 00000100:00100000:0.0:1785774992.565107:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1785774992.565114:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671393408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.565146:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1872519671393408:12345-0@lo:400:kworker.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774992.565156:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00080000:0.0:1785774992.565195:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774992.565219:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1872519671393408:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.565238:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1785774992.565246:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671392256:0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.565307:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1785774992.565316:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671392896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.565400:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1872519671392896:12345-0@lo:400:kworker.0 Request processed in 85us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774992.565408:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00080000:0.0:1785774992.566821:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1785774992.566868:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774992.566898:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671392768:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.566923:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774992.566948:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671392768 00000100:00100000:0.0:1785774992.566952:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671392768 00000100:00100000:0.0:1785774992.566990:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1785774992.566997:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671392768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.567033:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1872519671392768:12345-0@lo:400:kworker.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774992.567040:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00080000:0.0:1785774992.567056:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774992.567074:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1872519671392768:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.567081:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671393280:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.567102:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774992.567119:0:8627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393280 00000100:00100000:0.0:1785774992.567122:0:8627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393280 00000100:00100000:0.0:1785774992.567148:0:8627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1785774992.567155:0:8627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671393280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.567200:0:8627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1872519671393280:12345-0@lo:400:kworker.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774992.567206:0:8627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00080000:0.0:1785774992.567219:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785774992.567236:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1872519671393280:0@lo:400:kworker.0 00000100:00100000:0.0:1785774992.567247:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1872519671392896:0@lo:400:kworker.0 00000100:00100000:1.0:1785774992.567990:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671392128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11441us (19301us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774992.568014:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00100000:3.0:1785774992.572602:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671392256 00000100:00100000:3.0:1785774992.572614:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671392256 00000100:00100000:3.0:1785774992.572670:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1785774992.572690:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785774992.572784:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671392256:12345-0@lo:400:kworker.0 Request processed in 106us (5916us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774992.572791:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1785774992.579680:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671392128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1785774992.603575:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671392256:0@lo:400:kworker.0 00000100:00100000:2.0:1785774993.030226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774993.030275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774993.030418:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759552 00000100:00100000:0.0:1785774993.030431:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759552 00000100:00100000:0.0:1785774993.030530:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1292 00000100:00100000:0.0:1785774993.030542:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648759552:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774993.030646:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648759552:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774993.030656:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1292 00000100:00080000:1.0:1785774993.030838:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785774993.030988:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759424 00000100:00100000:3.0:1785774993.030993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759424 00000100:00100000:3.0:1785774993.031044:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 625 00000100:00100000:3.0:1785774993.031052:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648759424:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774993.031086:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:318ef776-85ee-4f20-925c-4274ea44b22b+10:2417:x1872519648759424:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774993.031093:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 625 00000100:00100000:3.0:1785774993.032225:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774993.032303:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759680 00000100:00100000:0.0:1785774993.032310:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759680 00000100:00100000:0.0:1785774993.032380:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1293 00000100:00100000:0.0:1785774993.032389:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:2417:x1872519648759680:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774993.032457:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7604e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:2417:x1872519648759680:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 69us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774993.032464:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1293 00000100:00080000:1.0:1785774993.032533:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1785774993.188402:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785774993.483854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774993.485054:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759808 00000100:00100000:1.0:1785774993.485071:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759808 00002000:00100000:1.0:1785774993.485141:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xd:0x0] (4194304->8388607) req@ffff9b76044b0380 x1872519648759808/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:684/0 lens 488/0 e 0 to 0 dl 1785775004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785774993.485155:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b0380 with x1872519648759808 ext(4194304->8388607) 00002000:00010000:1.0:1785774993.485225:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b0380 00000100:00100000:1.0:1785774993.485267:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 129 00000100:00100000:1.0:1785774993.485277:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+20:2416:x1872519648759808:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774993.576102:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774993.576130:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671393792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774993.576243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774993.576291:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393792 00000100:00100000:2.0:1785774993.576299:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393792 00000100:00100000:2.0:1785774993.576363:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1785774993.576373:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671393792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1785774993.576399:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 490137280 pending 5292032 free 3923394560 avail 3688701952 00000100:00100000:2.0:1785774993.576439:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671393792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774993.576447:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1785774993.576526:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671393792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1785774993.581562:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785774993.581599:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671393920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785774993.581690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774993.581764:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671393920 00000100:00100000:0.0:1785774993.581773:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671393920 00000100:00100000:0.0:1785774993.581826:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1785774993.581836:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671393920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774993.581867:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 490137280 pending 5292032 free 3923394560 avail 3688701952 00000100:00100000:0.0:1785774993.581922:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1872519671393920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774993.581932:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1785774993.582001:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1872519671393920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774993.599597:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76044b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2416:x1872519648759808:12345-192.168.202.31@tcp:4:dd.0 Request processed in 114305us (115735us total) trans 4294970036 rc 0/0 00000100:00100000:2.0:1785774993.599616:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 129 00002000:00100000:2.0:1785774993.599632:0:8453:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xd:0x0] (4194304->8388607) req@ffff9b76044b0380 x1872519648759808/t4294970036(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:684/0 lens 488/448 e 0 to 0 dl 1785775004 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774993.599643:0:8453:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b76044b0380 with x1872519648759808 ext(4194304->8388607) 00002000:00010000:2.0:1785774993.599652:0:8453:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b76044b0380 00000100:00100000:1.0:1785774993.649713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1785774993.649891:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648759936 00000100:00100000:2.0:1785774993.649906:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648759936 00002000:00100000:2.0:1785774993.649974:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (4194304->8388607) req@ffff9b7605c95880 x1872519648759936/t0(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:684/0 lens 488/0 e 0 to 0 dl 1785775004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774993.649986:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c95880 with x1872519648759936 ext(4194304->8388607) 00002000:00010000:2.0:1785774993.650004:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c95880 00000100:00100000:2.0:1785774993.650101:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 130 00000100:00100000:2.0:1785774993.650112:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+19:2418:x1872519648759936:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1785774993.732335:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:2418:x1872519648759936:12345-192.168.202.31@tcp:4:dd.0 Request processed in 82039us (82451us total) trans 4294970001 rc 0/0 00000100:00100000:2.0:1785774993.732363:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 130 00002000:00100000:2.0:1785774993.732380:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (4194304->8388607) req@ffff9b7605c95880 x1872519648759936/t4294970001(0) o4->a414bc9c-b134-4145-be8f-5c99e1ade49d@192.168.202.31@tcp:684/0 lens 488/448 e 0 to 0 dl 1785775004 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785774993.732390:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b7605c95880 with x1872519648759936 ext(4194304->8388607) 00002000:00010000:2.0:1785774993.732399:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b7605c95880 00000100:00100000:0.0:1785774993.910617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774993.910728:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648760064 00000100:00100000:1.0:1785774993.910740:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648760064 00000100:00100000:1.0:1785774993.910808:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5459 00000100:00100000:1.0:1785774993.910819:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+22:2417:x1872519648760064:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1785774993.912885:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294970036 is committed 00000100:00100000:1.0:1785774993.913085:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2417:x1872519648760064:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2262us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774993.913096:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5459 00000100:00100000:0.0:1785774993.918409:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774993.918699:0:14530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648760192 00000100:00100000:1.0:1785774993.918711:0:14530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648760192 00000100:00100000:1.0:1785774993.918776:0:14530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5460 00000100:00100000:1.0:1785774993.918786:0:14530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+21:2417:x1872519648760192:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1785774993.925197:0:9532:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970001 is committed 00000100:00100000:1.0:1785774993.925528:0:14530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2417:x1872519648760192:12345-192.168.202.31@tcp:16:dd.0 Request processed in 6735us (7124us total) trans 0 rc 0/0 00000100:00100000:1.0:1785774993.925543:0:14530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5460 00000100:00100000:2.0:1785774993.948804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774993.948938:0:14532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648760448 00000100:00100000:0.0:1785774993.948962:0:14532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648760448 00000100:00100000:0.0:1785774993.949048:0:14532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5344 00000100:00100000:0.0:1785774993.949061:0:14532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770ef66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+61:22452:x1872519648760448:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:0.0:1785774993.949390:0:14532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968825 00000100:00100000:0.0:1785774993.949521:0:14532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770ef66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22452:x1872519648760448:12345-192.168.202.31@tcp:35:dd.0 Request processed in 463us (732us total) trans 4294968826 rc 0/0 00000100:00100000:0.0:1785774993.949530:0:14532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5344 00000020:00080000:0.0:1785774993.949536:0:14532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785774993.955585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1785774993.955863:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648760576 00000100:00100000:3.0:1785774993.955875:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648760576 00000100:00100000:3.0:1785774993.955966:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24381 00000100:00100000:3.0:1785774993.955978:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22452:x1872519648760576:12345-192.168.202.31@tcp:44:dd.0 00000100:00100000:3.0:1785774993.956315:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a414bc9c-b134-4145-be8f-5c99e1ade49d+63:22452:x1872519648760576:12345-192.168.202.31@tcp:44:dd.0 Request processed in 338us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774993.956323:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24381 00010000:00010000:0.0:1785774994.212860:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785774994.600142:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671394048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774994.600282:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774994.600550:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394048 00000100:00100000:2.0:1785774994.600561:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394048 00000100:00100000:2.0:1785774994.600633:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:2.0:1785774994.600644:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671394048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774994.600688:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445052416 avail 1298812928 00000100:00100000:2.0:1785774994.600741:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671394048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774994.600749:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00100000:1.0:1785774994.600873:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671394048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1785774994.600893:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785774994.600899:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671394176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1785774994.600939:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774994.601021:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394176 00000100:00100000:2.0:1785774994.601025:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394176 00000100:00100000:2.0:1785774994.601072:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1785774994.601079:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671394176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774994.601102:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 235067072 pending 0 free 3915137024 avail 3683614720 00000100:00100000:2.0:1785774994.601139:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1872519671394176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774994.601146:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00080000:1.0:1785774994.601567:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785774994.601596:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671394176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774995.109898:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785774995.109931:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671394304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785774995.110202:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774995.110372:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394304 00000100:00100000:3.0:1785774995.110383:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394304 00000100:00100000:3.0:1785774995.110460:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1785774995.110472:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671394304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785774995.110501:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 235067072 pending 0 free 3915137024 avail 3683614720 00000100:00100000:3.0:1785774995.110553:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671394304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774995.110561:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1785774995.110707:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671394304:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1785774995.110842:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785774995.237109:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785774996.136254:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968826 is committed 00010000:00010000:3.0:1785774996.136296:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774996.136308:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774996.136329:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774996.136336:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b773faf7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1785774996.136341:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774996.137576:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774996.137599:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1d5:0x0].0x0 (ffff9b76032eed00) 00010000:00010000:3.0:1785774996.137602:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785774996.137608:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774996.137613:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9b773faf7000/0x7b7109e1d0a2cd3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785774996.279929:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785774997.291107:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785774997.625607:0:23393:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_63c: @@@@@@ FAIL: expect OST striped 91 == 85 + 2 00000100:00100000:2.0:1785774997.669369:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7605c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671394432:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669480:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671394944:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669502:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669517:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671395456:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669535:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669547:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671395968:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669562:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669582:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1785774997.669587:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671394816:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669606:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669618:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671395328:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669634:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669646:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671395840:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669660:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669679:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671394560:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669697:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669710:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671395072:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669725:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669737:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671395584:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669752:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669764:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1785774997.669768:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671394688:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669784:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669796:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671395200:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669812:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669823:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671395712:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669838:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774997.669865:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394432 00000100:00100000:2.0:1785774997.669872:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394432 00000100:00100000:2.0:1785774997.669911:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1785774997.669918:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671394432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.669959:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed609441-cebf-42ae-a19c-5d7643dc37b0+24:3654:x1872519671394432:12345-0@lo:400:kworker.0 Request processed in 41us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.669966:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1785774997.669993:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394944 00000100:00100000:2.0:1785774997.669996:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394944 00000100:00100000:2.0:1785774997.670014:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394688 00000100:00100000:2.0:1785774997.670016:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394688 00000100:00100000:2.0:1785774997.670030:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:2.0:1785774997.670035:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671394944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670074:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671394944:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670081:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000100:00100000:2.0:1785774997.670092:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:2.0:1785774997.670097:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671394688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670122:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3655:x1872519671394688:12345-0@lo:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670127:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00000100:00100000:2.0:1785774997.670141:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395456 00000100:00100000:2.0:1785774997.670144:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395456 00000100:00100000:2.0:1785774997.670196:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395968 00000100:00100000:2.0:1785774997.670199:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395968 00000100:00100000:2.0:1785774997.670213:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395328 00000100:00100000:2.0:1785774997.670215:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395328 00000100:00100000:2.0:1785774997.670228:0:8661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395840 00000100:00100000:2.0:1785774997.670230:0:8661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395840 00000100:00100000:2.0:1785774997.670244:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1785774997.670248:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671395456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670274:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671395456:12345-0@lo:400:kworker.0 Request processed in 25us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670279:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1785774997.670288:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1785774997.670293:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671395968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670325:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671395968:12345-0@lo:400:kworker.0 Request processed in 31us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670330:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1785774997.670340:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1785774997.670345:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671395328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670368:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671395328:12345-0@lo:400:kworker.0 Request processed in 23us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670373:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1785774997.670383:0:8661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1785774997.670388:0:8661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671395840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670411:0:8661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1872519671395840:12345-0@lo:400:kworker.0 Request processed in 24us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670416:0:8661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1785774997.670435:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394816 00000100:00100000:2.0:1785774997.670439:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394816 00000100:00100000:2.0:1785774997.670455:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671394560 00000100:00100000:2.0:1785774997.670458:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671394560 00000100:00100000:2.0:1785774997.670467:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395072 00000100:00100000:2.0:1785774997.670469:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395072 00000100:00100000:2.0:1785774997.670479:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395584 00000100:00100000:2.0:1785774997.670482:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395584 00000100:00100000:2.0:1785774997.670491:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395200 00000100:00100000:2.0:1785774997.670493:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395200 00000100:00100000:2.0:1785774997.670502:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671395712 00000100:00100000:2.0:1785774997.670504:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671395712 00000100:00100000:2.0:1785774997.670514:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1785774997.670518:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671394816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670547:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7741b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1872519671394816:12345-0@lo:400:kworker.0 Request processed in 29us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670552:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1785774997.670560:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1785774997.670564:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671394560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670584:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1872519671394560:12345-0@lo:400:kworker.0 Request processed in 21us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670589:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1785774997.670596:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1785774997.670601:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671395072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670634:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1872519671395072:12345-0@lo:400:kworker.0 Request processed in 33us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670640:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1785774997.670648:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1785774997.670653:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671395584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670675:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1872519671395584:12345-0@lo:400:kworker.0 Request processed in 22us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670680:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1785774997.670688:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1785774997.670693:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671395200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670725:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1872519671395200:12345-0@lo:400:kworker.0 Request processed in 32us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670729:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1785774997.670737:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1785774997.670741:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671395712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670776:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1872519671395712:12345-0@lo:400:kworker.0 Request processed in 34us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774997.670780:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00080000:2.0:1785774997.670825:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1785774997.670828:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785774997.670830:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785774997.670832:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774997.670866:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1872519671394688:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670875:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1872519671395200:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670882:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1872519671395712:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670891:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1872519671394560:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670897:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1872519671395072:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670904:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1872519671395584:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670938:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1872519671394816:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670945:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671395328:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670951:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1872519671395840:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670959:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7605c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed609441-cebf-42ae-a19c-5d7643dc37b0:3654:1872519671394432:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670966:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671394944:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670973:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671395456:0@lo:400:kworker.0 00000100:00100000:2.0:1785774997.670980:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b7741b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671395968:0@lo:400:kworker.0 00000100:00100000:3.0:1785774997.674356:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785774997.674375:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773ff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671396096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1785774997.674437:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785774997.674479:0:20645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671396096 00000100:00100000:3.0:1785774997.674486:0:20645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671396096 00000100:00100000:3.0:1785774997.674529:0:20645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00100000:3.0:1785774997.674537:0:20645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671396096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1785774997.674566:0:20645:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443889152 avail 1297649664 00000100:00100000:3.0:1785774997.674606:0:20645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773ff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:3656:x1872519671396096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774997.674614:0:20645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00100000:3.0:1785774997.674654:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773ff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671396096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1785774998.149275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774998.149334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774998.149364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774998.149389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1785774998.149408:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1785774998.149528:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648760704 00000100:00100000:0.0:1785774998.149537:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648760704 00000100:00100000:0.0:1785774998.149594:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 627 00000100:00100000:0.0:1785774998.149603:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772a98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648760704:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1785774998.149670:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772a98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:318ef776-85ee-4f20-925c-4274ea44b22b+10:2416:x1872519648760704:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 68us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774998.149680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 627 00000100:00100000:3.0:1785774998.150072:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648761088 00000100:00100000:3.0:1785774998.150077:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648761088 00000100:00100000:3.0:1785774998.150129:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648761216 00000100:00100000:3.0:1785774998.150133:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648761216 00000100:00100000:3.0:1785774998.150154:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 812 00000100:00100000:3.0:1785774998.150190:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648761088:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774998.150230:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+18:2416:x1872519648761088:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 69us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774998.150236:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 812 00000100:00100000:3.0:1785774998.150250:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 813 00000100:00100000:3.0:1785774998.150256:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648761216:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1785774998.150279:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a414bc9c-b134-4145-be8f-5c99e1ade49d+17:2416:x1872519648761216:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1785774998.150288:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 813 00000100:00080000:0.0:1785774998.150405:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785774998.150410:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785774998.150865:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648760832 00000100:00100000:2.0:1785774998.150869:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648760832 00000100:00100000:2.0:1785774998.150913:0:21784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519648760960 00000100:00100000:2.0:1785774998.150915:0:21784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519648760960 00000100:00100000:2.0:1785774998.150935:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1300 00000100:00100000:2.0:1785774998.150941:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648760832:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774998.150979:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7605c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+16:2416:x1872519648760832:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774998.150986:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1300 00000100:00100000:2.0:1785774998.150998:0:21784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1301 00000100:00100000:2.0:1785774998.151003:0:21784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:2416:x1872519648760960:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1785774998.151020:0:21784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a414bc9c-b134-4145-be8f-5c99e1ade49d+55:2416:x1872519648760960:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 18us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774998.151025:0:21784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1301 00000100:00080000:0.0:1785774998.151338:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1785774998.151342:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785774998.308333:0:6517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774998.692549:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785774998.692572:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671396224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774998.692635:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774998.692812:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671396224 00000100:00100000:0.0:1785774998.692819:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671396224 00000100:00100000:0.0:1785774998.692857:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1785774998.692865:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671396224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785774998.692896:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484845248 pending 0 free 3915005952 avail 3683483648 00000100:00100000:0.0:1785774998.692936:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1872519671396224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774998.692942:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1785774998.692981:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1872519671396224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785774998.693776:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671396352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1785774998.693809:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785774998.693914:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671396352 00000100:00100000:0.0:1785774998.693919:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671396352 00000100:00100000:0.0:1785774998.693953:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1785774998.693960:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671396352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1785774998.693981:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484845248 pending 0 free 3915005952 avail 3683483648 00000100:00100000:0.0:1785774998.694024:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1872519671396352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1785774998.694032:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1785774998.694111:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1872519671396352:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1785774999.335764:0:14708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785774999.717154:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671396480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774999.717252:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774999.717328:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785774999.717336:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b76057d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671396608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1785774999.717361:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785774999.717387:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671396480 00000100:00100000:2.0:1785774999.717393:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671396480 00000100:00100000:2.0:1785774999.717431:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00100000:2.0:1785774999.717438:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671396480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1785774999.717468:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445052416 avail 1298812928 00000100:00100000:2.0:1785774999.718079:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1872519671396480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 640us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774999.718087:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00000100:00100000:1.0:1785774999.718196:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1872519671396480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1785774999.718277:0:14717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671396608 00000100:00100000:2.0:1785774999.718291:0:14717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671396608 00000100:00100000:2.0:1785774999.718325:0:14717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1785774999.718331:0:14717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671396608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1785774999.718350:0:14717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 235067072 pending 0 free 3915137024 avail 3683614720 00000100:00100000:2.0:1785774999.718383:0:14717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1872519671396608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1785774999.718390:0:14717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1785774999.718420:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b76057d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1872519671396608:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1785774999.718468:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785775000.229388:0:3656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b773fb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671396736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785775000.229451:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785775000.229562:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872519671396736 00000100:00100000:1.0:1785775000.229571:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872519671396736 00000100:00100000:1.0:1785775000.229642:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1785775000.229652:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76057d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671396736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785775000.229676:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 235067072 pending 0 free 3915137024 avail 3683614720 00000100:00100000:1.0:1785775000.229721:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76057d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1872519671396736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1785775000.229728:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00080000:2.0:1785775000.229826:0:6525:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785775000.229865:0:3656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b773fb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1872519671396736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785775000.356441:0:16275:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68921 lines, 68921 kept, 0 dropped, 0 bad.